[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:37.911127 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:38007
I20260709 13:05:37.912535 15384 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:37.913496 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:37.928627 15391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:37.928665 15393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:37.930050 15384 server_base.cc:1061] running on GCE node
W20260709 13:05:37.928673 15390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.029659 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.029893 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.030077 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602339030056 us; error 0 us; skew 500 ppm
I20260709 13:05:39.031086 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.037132 15384 webserver.cc:533] Webserver started at http://127.15.6.62:39037/ using document root <none> and password file <none>
I20260709 13:05:39.037949 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.038151 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.038563 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.044180 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "fc2acd6664b84745bc6f1c966354b36a"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.051474 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:39.056223 15399 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.057292 15384 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:05:39.057622 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "fc2acd6664b84745bc6f1c966354b36a"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.057920 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.109424 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.110898 15384 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:39.111325 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.177120 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:38007
I20260709 13:05:39.177196 15450 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:38007 every 8 connection(s)
I20260709 13:05:39.184405 15451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.204728 15451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a: Bootstrap starting.
I20260709 13:05:39.210203 15451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.211915 15451 log.cc:826] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:39.215941 15451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a: No bootstrap required, opened a new log
I20260709 13:05:39.235137 15451 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2acd6664b84745bc6f1c966354b36a" member_type: VOTER }
I20260709 13:05:39.235625 15451 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.235879 15451 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2acd6664b84745bc6f1c966354b36a, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.236752 15451 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2acd6664b84745bc6f1c966354b36a" member_type: VOTER }
I20260709 13:05:39.237213 15451 raft_consensus.cc:399] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:39.237485 15451 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:39.237793 15451 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.241640 15451 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2acd6664b84745bc6f1c966354b36a" member_type: VOTER }
I20260709 13:05:39.242300 15451 leader_election.cc:304] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc2acd6664b84745bc6f1c966354b36a; no voters: 
I20260709 13:05:39.243886 15451 leader_election.cc:290] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:39.244192 15454 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.246430 15454 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 1 LEADER]: Becoming Leader. State: Replica: fc2acd6664b84745bc6f1c966354b36a, State: Running, Role: LEADER
I20260709 13:05:39.247283 15454 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2acd6664b84745bc6f1c966354b36a" member_type: VOTER }
I20260709 13:05:39.248251 15451 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:39.256898 15455 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc2acd6664b84745bc6f1c966354b36a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2acd6664b84745bc6f1c966354b36a" member_type: VOTER } }
I20260709 13:05:39.256973 15456 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc2acd6664b84745bc6f1c966354b36a. Latest consensus state: current_term: 1 leader_uuid: "fc2acd6664b84745bc6f1c966354b36a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2acd6664b84745bc6f1c966354b36a" member_type: VOTER } }
I20260709 13:05:39.257472 15455 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.257572 15456 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.260905 15462 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:39.271754 15462 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:39.273800 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:39.288599 15462 catalog_manager.cc:1383] Generated new cluster ID: d8c281e0a43c4be8b65b6b62035a8ad4
I20260709 13:05:39.288878 15462 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:39.307513 15462 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:39.308892 15462 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:39.326503 15462 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a: Generated new TSK 0
I20260709 13:05:39.327340 15462 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:39.339744 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.347213 15473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.348347 15474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.351962 15384 server_base.cc:1061] running on GCE node
W20260709 13:05:39.352064 15476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.352929 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.353124 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.353298 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602339353282 us; error 0 us; skew 500 ppm
I20260709 13:05:39.353840 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.357651 15384 webserver.cc:533] Webserver started at http://127.15.6.1:40305/ using document root <none> and password file <none>
I20260709 13:05:39.358157 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.358356 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.358608 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.359670 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "e1b73be4e23c467a9951f284481ee01f"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.365142 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:05:39.369658 15481 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.370393 15384 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:39.370649 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "e1b73be4e23c467a9951f284481ee01f"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.370903 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.391779 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.393157 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.395648 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.399968 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.400202 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.400466 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.400630 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.495074 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:35363
I20260709 13:05:39.495157 15543 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:35363 every 8 connection(s)
I20260709 13:05:39.501647 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.513054 15548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.515590 15549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.519541 15551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.520920 15384 server_base.cc:1061] running on GCE node
I20260709 13:05:39.521656 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.521852 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.522022 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602339522005 us; error 0 us; skew 500 ppm
I20260709 13:05:39.522557 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.525425 15384 webserver.cc:533] Webserver started at http://127.15.6.2:33027/ using document root <none> and password file <none>
I20260709 13:05:39.526002 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.526204 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.526458 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.527539 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "c082a155a2ac41c8ae56b0851279326a"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.531590 15544 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38007
I20260709 13:05:39.532094 15544 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.533124 15544 heartbeater.cc:507] Master 127.15.6.62:38007 requested a full tablet report, sending...
I20260709 13:05:39.533563 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 13:05:39.535670 15416 ts_manager.cc:194] Registered new tserver with Master: e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363)
I20260709 13:05:39.538367 15416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42744
I20260709 13:05:39.538991 15556 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.539839 15384 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:05:39.540198 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "c082a155a2ac41c8ae56b0851279326a"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.540544 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.562654 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.564193 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.565685 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.569131 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.569368 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.569629 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.569824 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.651139 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:33371
I20260709 13:05:39.651237 15618 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:33371 every 8 connection(s)
I20260709 13:05:39.657879 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.667039 15622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.672712 15623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.673105 15619 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38007
I20260709 13:05:39.673708 15619 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.674669 15619 heartbeater.cc:507] Master 127.15.6.62:38007 requested a full tablet report, sending...
I20260709 13:05:39.677021 15416 ts_manager.cc:194] Registered new tserver with Master: c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:39.678768 15416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42754
W20260709 13:05:39.683540 15625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.684298 15384 server_base.cc:1061] running on GCE node
I20260709 13:05:39.685024 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.685199 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.685359 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602339685342 us; error 0 us; skew 500 ppm
I20260709 13:05:39.685847 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.688320 15384 webserver.cc:533] Webserver started at http://127.15.6.3:42727/ using document root <none> and password file <none>
I20260709 13:05:39.688757 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.688922 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.689152 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.690088 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "215b4647910c4682ae23bac5f7e54cad"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.694203 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:05:39.697317 15630 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.698060 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:39.698369 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "215b4647910c4682ae23bac5f7e54cad"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-pqzm"
I20260709 13:05:39.698698 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.711385 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.712919 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.715368 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.717926 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.718168 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.718436 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.718636 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.799124 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:43783
I20260709 13:05:39.799190 15692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:43783 every 8 connection(s)
I20260709 13:05:39.816648 15693 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38007
I20260709 13:05:39.816962 15693 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.817739 15693 heartbeater.cc:507] Master 127.15.6.62:38007 requested a full tablet report, sending...
I20260709 13:05:39.819595 15416 ts_manager.cc:194] Registered new tserver with Master: 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:39.819751 15384 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015361017s
I20260709 13:05:39.821293 15416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42760
I20260709 13:05:39.862973 15416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42774:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:39.867667 15416 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:39.947250 15584 tablet_service.cc:1511] Processing CreateTablet for tablet d3f63825b55843a3a0ed6398bfb7f446 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:39.948841 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f63825b55843a3a0ed6398bfb7f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.949851 15583 tablet_service.cc:1511] Processing CreateTablet for tablet a049fb792e3d44ac95a9a635742bf326 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:39.951107 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a049fb792e3d44ac95a9a635742bf326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.964210 15658 tablet_service.cc:1511] Processing CreateTablet for tablet d3f63825b55843a3a0ed6398bfb7f446 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:39.965466 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f63825b55843a3a0ed6398bfb7f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.976094 15711 tablet_bootstrap.cc:492] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:39.975746 15657 tablet_service.cc:1511] Processing CreateTablet for tablet a049fb792e3d44ac95a9a635742bf326 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:39.978495 15657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a049fb792e3d44ac95a9a635742bf326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.979486 15584 tablet_service.cc:1511] Processing CreateTablet for tablet 5e96ea0519dc4469bc9d74c75d405b54 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:39.981681 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e96ea0519dc4469bc9d74c75d405b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.989840 15509 tablet_service.cc:1511] Processing CreateTablet for tablet d3f63825b55843a3a0ed6398bfb7f446 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:39.991091 15509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f63825b55843a3a0ed6398bfb7f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.995756 15712 tablet_bootstrap.cc:492] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:39.996600 15508 tablet_service.cc:1511] Processing CreateTablet for tablet a049fb792e3d44ac95a9a635742bf326 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:39.996668 15507 tablet_service.cc:1511] Processing CreateTablet for tablet 5e96ea0519dc4469bc9d74c75d405b54 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:39.998066 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e96ea0519dc4469bc9d74c75d405b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.998683 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a049fb792e3d44ac95a9a635742bf326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.004927 15712 tablet_bootstrap.cc:654] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.017424 15658 tablet_service.cc:1511] Processing CreateTablet for tablet 5e96ea0519dc4469bc9d74c75d405b54 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:40.018620 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e96ea0519dc4469bc9d74c75d405b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.020177 15712 tablet_bootstrap.cc:492] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.020658 15712 ts_tablet_manager.cc:1403] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.012s
I20260709 13:05:40.023638 15712 raft_consensus.cc:359] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.024448 15712 raft_consensus.cc:385] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.024888 15712 raft_consensus.cc:740] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.025878 15712 consensus_queue.cc:260] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.029145 15714 tablet_bootstrap.cc:492] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.033556 15714 tablet_bootstrap.cc:654] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.034789 15693 heartbeater.cc:499] Master 127.15.6.62:38007 was elected leader, sending a full tablet report...
I20260709 13:05:40.035882 15712 ts_tablet_manager.cc:1434] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:05:40.036790 15712 tablet_bootstrap.cc:492] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:40.038966 15507 tablet_service.cc:1511] Processing CreateTablet for tablet a02529b2310e4280990398bfae369a22 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.040128 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02529b2310e4280990398bfae369a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.043036 15712 tablet_bootstrap.cc:654] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.052191 15584 tablet_service.cc:1511] Processing CreateTablet for tablet a02529b2310e4280990398bfae369a22 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.053411 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02529b2310e4280990398bfae369a22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:40.055814 15694 tablet.cc:2406] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:40.061012 15658 tablet_service.cc:1511] Processing CreateTablet for tablet a02529b2310e4280990398bfae369a22 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:40.062156 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02529b2310e4280990398bfae369a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.058636 15506 tablet_service.cc:1511] Processing CreateTablet for tablet c37bb9d88be645c7990829b6bdb7a3a7 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.067947 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37bb9d88be645c7990829b6bdb7a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.081984 15583 tablet_service.cc:1511] Processing CreateTablet for tablet c37bb9d88be645c7990829b6bdb7a3a7 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.082870 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37bb9d88be645c7990829b6bdb7a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.080401 15715 raft_consensus.cc:493] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.084245 15715 raft_consensus.cc:515] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.087818 15711 tablet_bootstrap.cc:654] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.092768 15715 leader_election.cc:290] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363)
I20260709 13:05:40.107183 15656 tablet_service.cc:1511] Processing CreateTablet for tablet c37bb9d88be645c7990829b6bdb7a3a7 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:40.110669 15656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37bb9d88be645c7990829b6bdb7a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.111758 15712 tablet_bootstrap.cc:492] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.112962 15507 tablet_service.cc:1511] Processing CreateTablet for tablet bc556d88114d4bd18334c6947d50e854 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.114470 15582 tablet_service.cc:1511] Processing CreateTablet for tablet bc556d88114d4bd18334c6947d50e854 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.115365 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc556d88114d4bd18334c6947d50e854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.116672 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc556d88114d4bd18334c6947d50e854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.117333 15712 ts_tablet_manager.cc:1403] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.022s
I20260709 13:05:40.126803 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
W20260709 13:05:40.130206 15632 leader_election.cc:343] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.130461 15714 tablet_bootstrap.cc:492] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.130955 15714 ts_tablet_manager.cc:1403] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.102s	user 0.023s	sys 0.014s
I20260709 13:05:40.139047 15714 raft_consensus.cc:359] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.140084 15714 raft_consensus.cc:385] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.140379 15714 raft_consensus.cc:740] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.140422 15712 raft_consensus.cc:359] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.141217 15712 raft_consensus.cc:385] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.141525 15712 raft_consensus.cc:740] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.141340 15714 consensus_queue.cc:260] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.146327 15712 consensus_queue.cc:260] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.151537 15712 ts_tablet_manager.cc:1434] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:05:40.157399 15714 ts_tablet_manager.cc:1434] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 13:05:40.171753 15658 tablet_service.cc:1511] Processing CreateTablet for tablet bc556d88114d4bd18334c6947d50e854 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:40.173367 15544 heartbeater.cc:499] Master 127.15.6.62:38007 was elected leader, sending a full tablet report...
I20260709 13:05:40.175150 15714 tablet_bootstrap.cc:492] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.175379 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc556d88114d4bd18334c6947d50e854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.177567 15712 tablet_bootstrap.cc:492] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:40.179561 15583 tablet_service.cc:1511] Processing CreateTablet for tablet 64c2a9ee6fff44feb02566809a9105f2 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.179967 15711 tablet_bootstrap.cc:492] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.180478 15711 ts_tablet_manager.cc:1403] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.020s
I20260709 13:05:40.183211 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 64c2a9ee6fff44feb02566809a9105f2 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.184644 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c2a9ee6fff44feb02566809a9105f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.183856 15711 raft_consensus.cc:359] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.185128 15711 raft_consensus.cc:385] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.185667 15711 raft_consensus.cc:740] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.186384 15711 consensus_queue.cc:260] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.181021 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c2a9ee6fff44feb02566809a9105f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.193385 15508 tablet_service.cc:1511] Processing CreateTablet for tablet b63e3b7db7f541668ce236a9f06ab8bb (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.195276 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b63e3b7db7f541668ce236a9f06ab8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.196499 15657 tablet_service.cc:1511] Processing CreateTablet for tablet 64c2a9ee6fff44feb02566809a9105f2 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:40.198897 15657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c2a9ee6fff44feb02566809a9105f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.199784 15714 tablet_bootstrap.cc:654] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.196334 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.197757 15584 tablet_service.cc:1511] Processing CreateTablet for tablet b63e3b7db7f541668ce236a9f06ab8bb (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.205385 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b63e3b7db7f541668ce236a9f06ab8bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:40.206252 15634 leader_election.cc:343] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.206678 15634 leader_election.cc:304] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad; no voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:40.210284 15619 heartbeater.cc:499] Master 127.15.6.62:38007 was elected leader, sending a full tablet report...
I20260709 13:05:40.208962 15715 raft_consensus.cc:2749] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.209447 15655 tablet_service.cc:1511] Processing CreateTablet for tablet b63e3b7db7f541668ce236a9f06ab8bb (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:40.215066 15655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b63e3b7db7f541668ce236a9f06ab8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.219179 15711 ts_tablet_manager.cc:1434] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:05:40.228186 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd8bb13d37942478b02ce121c5bfe78 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.229594 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd8bb13d37942478b02ce121c5bfe78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.232362 15711 tablet_bootstrap.cc:492] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:40.236236 15581 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd8bb13d37942478b02ce121c5bfe78 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.238134 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd8bb13d37942478b02ce121c5bfe78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.247690 15656 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd8bb13d37942478b02ce121c5bfe78 (DEFAULT_TABLE table=test-workload [id=fc1a69ccb30b456381ad3c7b6d5fa4c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:40.248927 15656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd8bb13d37942478b02ce121c5bfe78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:40.252215 15712 tablet_bootstrap.cc:654] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:40.265631 15464 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:40.266000 15714 tablet_bootstrap.cc:492] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.266445 15711 tablet_bootstrap.cc:654] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.266453 15714 ts_tablet_manager.cc:1403] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.092s	user 0.023s	sys 0.011s
I20260709 13:05:40.271234 15714 raft_consensus.cc:359] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.271966 15714 raft_consensus.cc:385] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.272393 15714 raft_consensus.cc:740] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.280946 15714 consensus_queue.cc:260] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.286093 15714 ts_tablet_manager.cc:1434] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:05:40.286966 15714 tablet_bootstrap.cc:492] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.303435 15712 tablet_bootstrap.cc:492] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.303916 15712 ts_tablet_manager.cc:1403] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.127s	user 0.020s	sys 0.015s
I20260709 13:05:40.304836 15714 tablet_bootstrap.cc:654] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.306445 15711 tablet_bootstrap.cc:492] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.306944 15711 ts_tablet_manager.cc:1403] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.010s
I20260709 13:05:40.306794 15712 raft_consensus.cc:359] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.307554 15712 raft_consensus.cc:385] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.307880 15712 raft_consensus.cc:740] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.308727 15712 consensus_queue.cc:260] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.309965 15711 raft_consensus.cc:359] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.310688 15711 raft_consensus.cc:385] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.311008 15711 raft_consensus.cc:740] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.311872 15711 consensus_queue.cc:260] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.313881 15711 ts_tablet_manager.cc:1434] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:05:40.314769 15711 tablet_bootstrap.cc:492] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:40.317662 15712 ts_tablet_manager.cc:1434] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:05:40.320922 15711 tablet_bootstrap.cc:654] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.324152 15712 tablet_bootstrap.cc:492] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:40.330755 15712 tablet_bootstrap.cc:654] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.336867 15714 tablet_bootstrap.cc:492] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.337291 15714 ts_tablet_manager.cc:1403] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.008s
I20260709 13:05:40.338021 15712 tablet_bootstrap.cc:492] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.338449 15712 ts_tablet_manager.cc:1403] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.008s
I20260709 13:05:40.338855 15711 tablet_bootstrap.cc:492] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.339494 15711 ts_tablet_manager.cc:1403] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.025s	user 0.000s	sys 0.022s
I20260709 13:05:40.340114 15714 raft_consensus.cc:359] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.340799 15714 raft_consensus.cc:385] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.341089 15714 raft_consensus.cc:740] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.341203 15712 raft_consensus.cc:359] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.341841 15712 raft_consensus.cc:385] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.342195 15712 raft_consensus.cc:740] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.341915 15714 consensus_queue.cc:260] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.342965 15712 consensus_queue.cc:260] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.344386 15714 ts_tablet_manager.cc:1434] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:05:40.345278 15714 tablet_bootstrap.cc:492] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.347506 15712 ts_tablet_manager.cc:1434] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:40.342806 15711 raft_consensus.cc:359] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.348172 15711 raft_consensus.cc:385] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.349094 15711 raft_consensus.cc:740] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.349876 15711 consensus_queue.cc:260] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.352231 15711 ts_tablet_manager.cc:1434] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:05:40.353159 15711 tablet_bootstrap.cc:492] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:40.359081 15711 tablet_bootstrap.cc:654] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.348470 15712 tablet_bootstrap.cc:492] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:40.368111 15712 tablet_bootstrap.cc:654] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.368983 15714 tablet_bootstrap.cc:654] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.370955 15711 tablet_bootstrap.cc:492] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.371454 15711 ts_tablet_manager.cc:1403] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 13:05:40.374326 15711 raft_consensus.cc:359] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.375119 15711 raft_consensus.cc:385] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.375454 15711 raft_consensus.cc:740] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.376338 15711 consensus_queue.cc:260] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.378742 15711 ts_tablet_manager.cc:1434] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:40.379705 15711 tablet_bootstrap.cc:492] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:40.385638 15711 tablet_bootstrap.cc:654] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.390118 15712 tablet_bootstrap.cc:492] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.390530 15712 ts_tablet_manager.cc:1403] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.014s
I20260709 13:05:40.392011 15714 tablet_bootstrap.cc:492] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.392479 15714 ts_tablet_manager.cc:1403] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.047s	user 0.002s	sys 0.014s
I20260709 13:05:40.393236 15712 raft_consensus.cc:359] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.393947 15712 raft_consensus.cc:385] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.394248 15712 raft_consensus.cc:740] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.395085 15712 consensus_queue.cc:260] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.395315 15714 raft_consensus.cc:359] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.396077 15714 raft_consensus.cc:385] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.396425 15714 raft_consensus.cc:740] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.397166 15714 consensus_queue.cc:260] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.399484 15714 ts_tablet_manager.cc:1434] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:05:40.400431 15714 tablet_bootstrap.cc:492] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.403704 15715 raft_consensus.cc:493] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.404163 15715 raft_consensus.cc:515] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.406157 15715 leader_election.cc:290] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.406738 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.407337 15519 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 0.
I20260709 13:05:40.407475 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:40.408092 15594 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 0.
I20260709 13:05:40.408669 15634 leader_election.cc:304] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:40.409499 15715 raft_consensus.cc:2804] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.409893 15715 raft_consensus.cc:493] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.410272 15715 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.414597 15712 ts_tablet_manager.cc:1434] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:05:40.414983 15721 raft_consensus.cc:493] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.415414 15721 raft_consensus.cc:515] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.417757 15721 leader_election.cc:290] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:40.420508 15715 raft_consensus.cc:515] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.421625 15712 tablet_bootstrap.cc:492] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:40.424217 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:40.421824 15714 tablet_bootstrap.cc:654] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.424751 15519 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.427527 15715 leader_election.cc:290] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.428900 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:40.429409 15594 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.433465 15519 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 1.
I20260709 13:05:40.434548 15634 leader_election.cc:304] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:40.435871 15715 raft_consensus.cc:2804] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.438177 15711 tablet_bootstrap.cc:492] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.438639 15711 ts_tablet_manager.cc:1403] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.029s
I20260709 13:05:40.435863 15594 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 1.
I20260709 13:05:40.443120 15714 tablet_bootstrap.cc:492] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.443640 15714 ts_tablet_manager.cc:1403] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.006s
I20260709 13:05:40.444609 15712 tablet_bootstrap.cc:654] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.447012 15715 raft_consensus.cc:697] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:40.448479 15715 consensus_queue.cc:237] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.449787 15714 raft_consensus.cc:359] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.452746 15714 raft_consensus.cc:385] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.453033 15714 raft_consensus.cc:740] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.456795 15721 raft_consensus.cc:493] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.457780 15721 raft_consensus.cc:515] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.459861 15720 raft_consensus.cc:493] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.460280 15720 raft_consensus.cc:515] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.460939 15721 leader_election.cc:290] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783), e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363)
I20260709 13:05:40.449870 15711 raft_consensus.cc:359] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.464020 15720 leader_election.cc:290] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:40.464177 15714 consensus_queue.cc:260] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.463380 15711 raft_consensus.cc:385] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.469309 15711 raft_consensus.cc:740] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.475785 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:40.476578 15668 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:40.467149 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:40.477495 15711 consensus_queue.cc:260] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.478533 15558 leader_election.cc:304] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:40.479744 15720 raft_consensus.cc:493] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.481978 15667 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:40.482324 15720 raft_consensus.cc:515] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.479828 15714 ts_tablet_manager.cc:1434] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:05:40.484625 15721 raft_consensus.cc:2804] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.485529 15720 leader_election.cc:290] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:40.486267 15558 leader_election.cc:304] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:40.487241 15721 raft_consensus.cc:493] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.487824 15721 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.491887 15711 ts_tablet_manager.cc:1434] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 13:05:40.494035 15714 tablet_bootstrap.cc:492] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.494818 15711 tablet_bootstrap.cc:492] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:40.494959 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.495544 15519 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:40.496641 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.497313 15518 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:40.504443 15711 tablet_bootstrap.cc:654] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.508740 15721 raft_consensus.cc:515] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.509593 15712 tablet_bootstrap.cc:492] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.510037 15712 ts_tablet_manager.cc:1403] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.019s
I20260709 13:05:40.510912 15721 leader_election.cc:290] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:40.512326 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:40.513075 15518 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.508178 15415 catalog_manager.cc:5697] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 1 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.517432 15712 raft_consensus.cc:359] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.520781 15712 raft_consensus.cc:385] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.521111 15712 raft_consensus.cc:740] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.515057 15721 raft_consensus.cc:2804] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.522553 15712 consensus_queue.cc:260] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.528766 15518 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:40.530071 15560 leader_election.cc:304] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:40.523955 15721 raft_consensus.cc:493] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.531482 15721 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.532987 15712 ts_tablet_manager.cc:1434] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:05:40.533965 15712 tablet_bootstrap.cc:492] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
W20260709 13:05:40.535457 15558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49593.1us
I20260709 13:05:40.538956 15711 tablet_bootstrap.cc:492] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.539400 15711 ts_tablet_manager.cc:1403] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.001s
I20260709 13:05:40.540555 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:40.541102 15667 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.542105 15711 raft_consensus.cc:359] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.542913 15711 raft_consensus.cc:385] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.543278 15711 raft_consensus.cc:740] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.544312 15721 raft_consensus.cc:515] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.544032 15711 consensus_queue.cc:260] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.546604 15739 raft_consensus.cc:2804] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.547341 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:40.548275 15715 raft_consensus.cc:493] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.548343 15668 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.548851 15721 leader_election.cc:290] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Requested vote from peers 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783), e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363)
I20260709 13:05:40.549017 15715 raft_consensus.cc:515] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.553345 15714 tablet_bootstrap.cc:654] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.549564 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:40.555014 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:40.555859 15518 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.556073 15715 leader_election.cc:290] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.556751 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.558143 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:40.558879 15592 raft_consensus.cc:2468] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 0.
I20260709 13:05:40.560832 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:40.560001 15632 leader_election.cc:304] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:40.562824 15715 raft_consensus.cc:2804] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.563205 15715 raft_consensus.cc:493] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.563508 15715 raft_consensus.cc:3060] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.562821 15593 raft_consensus.cc:2393] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1b73be4e23c467a9951f284481ee01f in current term 1: Already voted for candidate c082a155a2ac41c8ae56b0851279326a in this term.
I20260709 13:05:40.559990 15519 raft_consensus.cc:2468] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 0.
I20260709 13:05:40.568553 15668 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:40.570044 15558 leader_election.cc:304] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:40.573374 15667 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:40.575805 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:40.576153 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:40.575261 15721 raft_consensus.cc:2804] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.577103 15721 raft_consensus.cc:697] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:40.578095 15667 raft_consensus.cc:2393] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1b73be4e23c467a9951f284481ee01f in current term 1: Already voted for candidate c082a155a2ac41c8ae56b0851279326a in this term.
I20260709 13:05:40.579427 15735 raft_consensus.cc:493] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.578976 15518 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:40.579895 15735 raft_consensus.cc:515] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.582557 15735 leader_election.cc:290] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.578099 15668 raft_consensus.cc:2393] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1b73be4e23c467a9951f284481ee01f in current term 1: Already voted for candidate c082a155a2ac41c8ae56b0851279326a in this term.
I20260709 13:05:40.583904 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:40.584475 15593 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 0.
I20260709 13:05:40.584244 15715 raft_consensus.cc:515] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.585639 15632 leader_election.cc:304] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:40.586165 15715 leader_election.cc:290] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.586750 15715 raft_consensus.cc:2804] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.587077 15715 raft_consensus.cc:493] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.587380 15715 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.588335 15483 leader_election.cc:304] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1b73be4e23c467a9951f284481ee01f; no voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:40.589347 15720 raft_consensus.cc:2749] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.590224 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:40.590660 15712 tablet_bootstrap.cc:654] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.590718 15519 raft_consensus.cc:3060] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.577895 15721 consensus_queue.cc:237] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:40.596256 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:40.596851 15593 raft_consensus.cc:3060] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.598142 15720 raft_consensus.cc:493] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.598546 15720 raft_consensus.cc:515] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.600308 15720 leader_election.cc:290] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:40.600649 15715 raft_consensus.cc:515] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.601945 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:40.602495 15592 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 0.
I20260709 13:05:40.603806 15483 leader_election.cc:304] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:40.604638 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:40.606715 15592 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.604880 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:40.612298 15668 raft_consensus.cc:2393] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1b73be4e23c467a9951f284481ee01f in current term 1: Already voted for candidate 215b4647910c4682ae23bac5f7e54cad in this term.
I20260709 13:05:40.614166 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:40.614771 15517 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.605082 15715 leader_election.cc:290] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.626278 15592 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 1.
I20260709 13:05:40.624984 15517 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 1.
I20260709 13:05:40.627348 15720 raft_consensus.cc:2764] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:40.627671 15632 leader_election.cc:304] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:40.628535 15715 raft_consensus.cc:2804] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.628990 15715 raft_consensus.cc:697] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:40.629822 15715 consensus_queue.cc:237] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.631287 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.635783 15518 raft_consensus.cc:2376] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 1. Re-sending same reply.
I20260709 13:05:40.633773 15593 raft_consensus.cc:2468] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 1.
I20260709 13:05:40.606194 15519 raft_consensus.cc:2468] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 1.
I20260709 13:05:40.640112 15632 leader_election.cc:304] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:40.640959 15735 raft_consensus.cc:2804] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.646375 15714 tablet_bootstrap.cc:492] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.646500 15712 tablet_bootstrap.cc:492] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.646824 15714 ts_tablet_manager.cc:1403] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.002s
I20260709 13:05:40.646910 15712 ts_tablet_manager.cc:1403] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.113s	user 0.004s	sys 0.012s
I20260709 13:05:40.649598 15712 raft_consensus.cc:359] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.650297 15712 raft_consensus.cc:385] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.650592 15712 raft_consensus.cc:740] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.651293 15712 consensus_queue.cc:260] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.657612 15712 ts_tablet_manager.cc:1434] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:40.657528 15714 raft_consensus.cc:359] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.658253 15714 raft_consensus.cc:385] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.658540 15714 raft_consensus.cc:740] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.664958 15712 tablet_bootstrap.cc:492] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:40.663991 15739 raft_consensus.cc:697] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:40.686256 15735 raft_consensus.cc:697] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:40.687970 15739 consensus_queue.cc:237] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.688149 15735 consensus_queue.cc:237] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.685822 15714 consensus_queue.cc:260] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.694823 15751 raft_consensus.cc:493] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.695325 15751 raft_consensus.cc:515] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.704571 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.706406 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
W20260709 13:05:40.707505 15634 leader_election.cc:343] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.703413 15751 leader_election.cc:290] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.722433 15711 ts_tablet_manager.cc:1434] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.183s	user 0.011s	sys 0.006s
I20260709 13:05:40.723352 15711 tablet_bootstrap.cc:492] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
W20260709 13:05:40.724907 15632 leader_election.cc:343] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.725716 15632 leader_election.cc:304] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad; no voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:40.732611 15714 ts_tablet_manager.cc:1434] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.085s	user 0.012s	sys 0.016s
I20260709 13:05:40.733520 15714 tablet_bootstrap.cc:492] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.734305 15712 tablet_bootstrap.cc:654] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.735476 15750 raft_consensus.cc:493] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.736168 15750 raft_consensus.cc:515] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.731015 15751 raft_consensus.cc:2749] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.738785 15750 leader_election.cc:290] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:40.740696 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.741430 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:40.742065 15714 tablet_bootstrap.cc:654] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:40.742534 15634 leader_election.cc:343] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:40.744185 15632 leader_election.cc:343] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.745293 15632 leader_election.cc:304] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad; no voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:40.746336 15750 raft_consensus.cc:2749] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.755815 15483 leader_election.cc:304] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1b73be4e23c467a9951f284481ee01f; no voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:40.756812 15720 raft_consensus.cc:2749] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.762032 15711 tablet_bootstrap.cc:654] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.765612 15712 tablet_bootstrap.cc:492] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.766507 15714 tablet_bootstrap.cc:492] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.766006 15415 catalog_manager.cc:5697] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 0 to 1, leader changed from <none> to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 1 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.766930 15714 ts_tablet_manager.cc:1403] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.008s
I20260709 13:05:40.766017 15712 ts_tablet_manager.cc:1403] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.004s
I20260709 13:05:40.771417 15739 raft_consensus.cc:493] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.771708 15712 raft_consensus.cc:359] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.771909 15739 raft_consensus.cc:515] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.772511 15712 raft_consensus.cc:385] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.772809 15712 raft_consensus.cc:740] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.774077 15739 leader_election.cc:290] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:40.774688 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:40.775306 15519 raft_consensus.cc:2468] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:40.775621 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:40.776407 15560 leader_election.cc:304] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:40.777232 15711 tablet_bootstrap.cc:492] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.777729 15711 ts_tablet_manager.cc:1403] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.005s
I20260709 13:05:40.777805 15714 raft_consensus.cc:359] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.773527 15712 consensus_queue.cc:260] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.778532 15714 raft_consensus.cc:385] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.778756 15739 raft_consensus.cc:2804] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.778905 15714 raft_consensus.cc:740] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.779139 15739 raft_consensus.cc:493] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.779518 15739 raft_consensus.cc:3060] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.779633 15714 consensus_queue.cc:260] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.778474 15416 catalog_manager.cc:5697] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 1 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.781908 15668 raft_consensus.cc:2468] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:40.782509 15416 catalog_manager.cc:5697] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 1 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.783704 15714 ts_tablet_manager.cc:1434] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:40.784614 15714 tablet_bootstrap.cc:492] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.787186 15712 ts_tablet_manager.cc:1434] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:05:40.788311 15712 tablet_bootstrap.cc:492] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad: Bootstrap starting.
I20260709 13:05:40.781224 15711 raft_consensus.cc:359] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.790303 15711 raft_consensus.cc:385] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.790673 15714 tablet_bootstrap.cc:654] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.794329 15711 raft_consensus.cc:740] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.795186 15711 consensus_queue.cc:260] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.797341 15711 ts_tablet_manager.cc:1434] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:05:40.798275 15711 tablet_bootstrap.cc:492] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:40.792999 15739 raft_consensus.cc:515] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.794019 15712 tablet_bootstrap.cc:654] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.806793 15414 catalog_manager.cc:5697] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 0 to 1, leader changed from <none> to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 1 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.809593 15711 tablet_bootstrap.cc:654] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.811331 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:40.811844 15519 raft_consensus.cc:3060] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.817536 15519 raft_consensus.cc:2468] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:40.818535 15560 leader_election.cc:304] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:40.819352 15721 raft_consensus.cc:2804] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.819806 15721 raft_consensus.cc:697] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:40.820575 15721 consensus_queue.cc:237] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.821511 15711 tablet_bootstrap.cc:492] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.821911 15711 ts_tablet_manager.cc:1403] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:05:40.822981 15739 leader_election.cc:290] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:40.825477 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:40.828136 15668 raft_consensus.cc:3060] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.831277 15714 tablet_bootstrap.cc:492] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.831758 15714 ts_tablet_manager.cc:1403] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.008s
I20260709 13:05:40.831279 15711 raft_consensus.cc:359] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.832800 15711 raft_consensus.cc:385] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.833058 15711 raft_consensus.cc:740] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.833807 15711 consensus_queue.cc:260] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.835944 15711 ts_tablet_manager.cc:1434] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:05:40.836812 15711 tablet_bootstrap.cc:492] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a: Bootstrap starting.
I20260709 13:05:40.843501 15668 raft_consensus.cc:2468] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:40.844936 15714 raft_consensus.cc:359] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.845441 15714 raft_consensus.cc:385] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.845611 15714 raft_consensus.cc:740] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.848750 15714 consensus_queue.cc:260] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.849167 15712 tablet_bootstrap.cc:492] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad: No bootstrap required, opened a new log
I20260709 13:05:40.849669 15712 ts_tablet_manager.cc:1403] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.018s
I20260709 13:05:40.850010 15711 tablet_bootstrap.cc:654] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.850663 15714 ts_tablet_manager.cc:1434] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:05:40.851485 15714 tablet_bootstrap.cc:492] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f: Bootstrap starting.
I20260709 13:05:40.854460 15414 catalog_manager.cc:5697] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 0 to 1, leader changed from <none> to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 1 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.856179 15712 raft_consensus.cc:359] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.857264 15712 raft_consensus.cc:385] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.857518 15712 raft_consensus.cc:740] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.858224 15712 consensus_queue.cc:260] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.859671 15711 tablet_bootstrap.cc:492] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a: No bootstrap required, opened a new log
I20260709 13:05:40.860011 15711 ts_tablet_manager.cc:1403] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.001s
I20260709 13:05:40.860332 15712 ts_tablet_manager.cc:1434] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:05:40.860525 15714 tablet_bootstrap.cc:654] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.861716 15711 raft_consensus.cc:359] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.862149 15711 raft_consensus.cc:385] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.862362 15711 raft_consensus.cc:740] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.863057 15711 consensus_queue.cc:260] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.865477 15711 ts_tablet_manager.cc:1434] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:40.865758 15714 tablet_bootstrap.cc:492] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f: No bootstrap required, opened a new log
I20260709 13:05:40.866178 15714 ts_tablet_manager.cc:1403] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:05:40.868448 15714 raft_consensus.cc:359] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.869030 15714 raft_consensus.cc:385] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.869290 15714 raft_consensus.cc:740] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.869903 15714 consensus_queue.cc:260] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:40.871676 15714 ts_tablet_manager.cc:1434] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:05:40.883158 15735 consensus_queue.cc:1048] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.901109 15751 consensus_queue.cc:1048] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.008713 15720 raft_consensus.cc:493] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.009260 15720 raft_consensus.cc:515] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.010666 15721 raft_consensus.cc:493] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.011152 15720 leader_election.cc:290] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.011092 15721 raft_consensus.cc:515] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.012650 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a" is_pre_election: true
I20260709 13:05:41.012756 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:41.013371 15668 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 0.
I20260709 13:05:41.014392 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:41.013397 15721 leader_election.cc:290] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.014577 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:41.014953 15668 raft_consensus.cc:2468] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:41.013260 15594 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 0.
I20260709 13:05:41.015360 15519 raft_consensus.cc:2468] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:41.016058 15558 leader_election.cc:304] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:41.014561 15483 leader_election.cc:304] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.016834 15721 raft_consensus.cc:2804] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.017127 15720 raft_consensus.cc:2804] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.017228 15721 raft_consensus.cc:493] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.017535 15720 raft_consensus.cc:493] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.017663 15721 raft_consensus.cc:3060] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.017941 15720 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.021814 15721 raft_consensus.cc:515] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.023295 15721 leader_election.cc:290] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.024010 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:41.024290 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.024541 15519 raft_consensus.cc:3060] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.024922 15668 raft_consensus.cc:3060] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.024791 15720 raft_consensus.cc:515] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.028043 15720 leader_election.cc:290] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.028244 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.028944 15667 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.029018 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:41.029894 15594 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.031394 15519 raft_consensus.cc:2468] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:41.032459 15560 leader_election.cc:304] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.032979 15751 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.033458 15721 raft_consensus.cc:2804] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.034173 15721 raft_consensus.cc:697] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:41.034960 15721 consensus_queue.cc:237] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.036609 15594 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 1.
I20260709 13:05:41.038591 15668 raft_consensus.cc:2468] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:41.039778 15483 leader_election.cc:304] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.040717 15720 raft_consensus.cc:2804] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.045608 15667 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 1.
I20260709 13:05:41.048039 15739 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.053680 15720 raft_consensus.cc:697] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:41.054595 15720 consensus_queue.cc:237] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.060580 15414 catalog_manager.cc:5697] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 0 to 1, leader changed from <none> to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 1 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.064917 15750 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.078941 15744 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.088970 15414 catalog_manager.cc:5697] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 0 to 1, leader changed from <none> to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.142803 15751 consensus_queue.cc:1048] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.145506 15751 consensus_queue.cc:1048] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.201190 15721 raft_consensus.cc:493] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.201582 15721 raft_consensus.cc:515] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.203125 15721 leader_election.cc:290] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.203953 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f" is_pre_election: true
I20260709 13:05:41.204159 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad" is_pre_election: true
I20260709 13:05:41.204444 15518 raft_consensus.cc:2468] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:41.204808 15667 raft_consensus.cc:2468] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 0.
I20260709 13:05:41.205307 15560 leader_election.cc:304] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.205962 15721 raft_consensus.cc:2804] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.206269 15721 raft_consensus.cc:493] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.206521 15721 raft_consensus.cc:3060] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.210492 15721 raft_consensus.cc:515] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.212283 15721 leader_election.cc:290] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.212529 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:41.212996 15518 raft_consensus.cc:3060] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.213501 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.214038 15667 raft_consensus.cc:3060] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.216838 15518 raft_consensus.cc:2468] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:41.217701 15560 leader_election.cc:304] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.218237 15721 raft_consensus.cc:2804] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.218591 15721 raft_consensus.cc:697] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:41.219332 15721 consensus_queue.cc:237] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.219900 15667 raft_consensus.cc:2468] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 1.
I20260709 13:05:41.226925 15413 catalog_manager.cc:5697] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 0 to 1, leader changed from <none> to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 1 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.228452 15721 consensus_queue.cc:1048] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.237048 15721 consensus_queue.cc:1048] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.241098 15721 consensus_queue.cc:1048] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.244493 15745 consensus_queue.cc:1048] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.449199 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:05:41.449929 15593 raft_consensus.cc:606] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Received request to transfer leadership to TS e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:41.454909 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:05:41.455433 15593 raft_consensus.cc:606] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Received request to transfer leadership to TS e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:41.465822 15770 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.469138 15667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
mode: GRACEFUL
new_leader_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:37116
I20260709 13:05:41.469635 15667 raft_consensus.cc:606] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Received request to transfer leadership to TS e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:41.480103 15720 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.482210 15668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a02529b2310e4280990398bfae369a22"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
mode: GRACEFUL
new_leader_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:37116
I20260709 13:05:41.482714 15668 raft_consensus.cc:606] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Received request to transfer leadership to TS e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:41.487747 15668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
mode: GRACEFUL
new_leader_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:37116
I20260709 13:05:41.488200 15668 raft_consensus.cc:606] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Received request to transfer leadership to TS c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:41.506704 15518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
mode: GRACEFUL
new_leader_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:48820
I20260709 13:05:41.507118 15518 raft_consensus.cc:606] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 LEADER]: Received request to transfer leadership to TS c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:41.511441 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:05:41.511979 15593 raft_consensus.cc:606] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Received request to transfer leadership to TS 215b4647910c4682ae23bac5f7e54cad
I20260709 13:05:41.548010 15715 raft_consensus.cc:993] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad: : Instructing follower c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:41.548435 15715 raft_consensus.cc:1081] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Signalling peer c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:41.549927 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:05:41.550426 15593 raft_consensus.cc:493] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.550737 15593 raft_consensus.cc:3060] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.555099 15593 raft_consensus.cc:515] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.557041 15593 leader_election.cc:290] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 2 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.557374 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:41.557893 15518 raft_consensus.cc:3060] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.558743 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37bb9d88be645c7990829b6bdb7a3a7" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.559271 15668 raft_consensus.cc:3055] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.559556 15668 raft_consensus.cc:740] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:41.560297 15668 consensus_queue.cc:260] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.561542 15668 raft_consensus.cc:3060] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.562664 15518 raft_consensus.cc:2468] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 2.
I20260709 13:05:41.563524 15560 leader_election.cc:304] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.564118 15745 raft_consensus.cc:2804] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.564462 15745 raft_consensus.cc:697] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 2 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:41.565124 15745 consensus_queue.cc:237] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.567279 15668 raft_consensus.cc:2468] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 2.
I20260709 13:05:41.570614 15416 catalog_manager.cc:5697] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 1 to 2, leader changed from 215b4647910c4682ae23bac5f7e54cad (127.15.6.3) to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 2 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.592353 15744 raft_consensus.cc:993] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: : Instructing follower e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.592782 15745 raft_consensus.cc:1081] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Signalling peer e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.594233 15518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:48804
I20260709 13:05:41.594723 15518 raft_consensus.cc:493] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.595042 15518 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.600890 15518 raft_consensus.cc:515] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:41.602712 15518 leader_election.cc:290] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.603283 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:41.603848 15593 raft_consensus.cc:3055] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.603741 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.604185 15593 raft_consensus.cc:740] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:41.604360 15668 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.604938 15593 consensus_queue.cc:260] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:41.606058 15593 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.610352 15668 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.611469 15483 leader_election.cc:304] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.612119 15593 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.612223 15720 raft_consensus.cc:2804] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.612748 15720 raft_consensus.cc:697] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:41.613498 15720 consensus_queue.cc:237] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:41.620167 15416 catalog_manager.cc:5697] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 1 to 2, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.651394 15745 consensus_queue.cc:1048] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.664662 15721 consensus_queue.cc:1048] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.686853 15735 raft_consensus.cc:993] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: : Instructing follower e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.687258 15715 raft_consensus.cc:1081] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Signalling peer e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.688581 15518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:48796
I20260709 13:05:41.689033 15518 raft_consensus.cc:493] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.689349 15518 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.694216 15518 raft_consensus.cc:515] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.695865 15518 leader_election.cc:290] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.696521 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:41.696884 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.697077 15593 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.697489 15668 raft_consensus.cc:3055] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.697764 15668 raft_consensus.cc:740] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:41.698423 15668 consensus_queue.cc:260] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.699357 15668 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.703774 15593 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.704041 15668 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.704813 15483 leader_election.cc:304] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.705494 15720 raft_consensus.cc:2804] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.705964 15720 raft_consensus.cc:697] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:41.706753 15720 consensus_queue.cc:237] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.713490 15415 catalog_manager.cc:5697] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 1 to 2, leader changed from 215b4647910c4682ae23bac5f7e54cad (127.15.6.3) to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.787336 15739 raft_consensus.cc:993] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a: : Instructing follower e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.787729 15721 raft_consensus.cc:1081] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Signalling peer e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.789089 15518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:48804
I20260709 13:05:41.789531 15518 raft_consensus.cc:493] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.789816 15518 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.793977 15518 raft_consensus.cc:515] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.795362 15518 leader_election.cc:290] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.796505 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:41.796533 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.797230 15593 raft_consensus.cc:3055] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.797322 15668 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.797520 15593 raft_consensus.cc:740] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:41.798234 15593 consensus_queue.cc:260] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.799081 15593 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.803594 15668 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.804531 15593 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.804637 15483 leader_election.cc:304] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.805884 15720 raft_consensus.cc:2804] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.806429 15720 raft_consensus.cc:697] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:41.807371 15720 consensus_queue.cc:237] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.815398 15416 catalog_manager.cc:5697] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 1 to 2, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.825492 15744 consensus_queue.cc:1048] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.835990 15744 consensus_queue.cc:1048] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.837034 15744 raft_consensus.cc:993] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a: : Instructing follower 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:41.837399 15744 raft_consensus.cc:1081] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Signalling peer 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:41.840293 15667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:05:41.840829 15667 raft_consensus.cc:493] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.841202 15667 raft_consensus.cc:3060] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.846822 15715 raft_consensus.cc:993] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad: : Instructing follower e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.847215 15750 raft_consensus.cc:1081] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Signalling peer e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:41.848709 15519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a02529b2310e4280990398bfae369a22"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:48796
I20260709 13:05:41.849208 15519 raft_consensus.cc:493] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.849532 15519 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.847594 15667 raft_consensus.cc:515] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.853874 15667 leader_election.cc:290] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 2 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:41.854076 15517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:41.855769 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd8bb13d37942478b02ce121c5bfe78" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:41.856284 15593 raft_consensus.cc:3055] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.856577 15593 raft_consensus.cc:740] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:41.857242 15593 consensus_queue.cc:260] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.858165 15593 raft_consensus.cc:3060] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.862751 15668 raft_consensus.cc:1240] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Rejecting Update request from peer c082a155a2ac41c8ae56b0851279326a for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:41.862838 15519 raft_consensus.cc:515] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.863935 15593 raft_consensus.cc:2468] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 2.
I20260709 13:05:41.864769 15632 leader_election.cc:304] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:41.865331 15519 leader_election.cc:290] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.865762 15715 raft_consensus.cc:2804] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.866210 15715 raft_consensus.cc:697] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 2 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:41.866319 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.866601 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:41.866864 15667 raft_consensus.cc:3055] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.867085 15593 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.867249 15667 raft_consensus.cc:740] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:41.866920 15715 consensus_queue.cc:237] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.868048 15667 consensus_queue.cc:260] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.869164 15667 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.872841 15593 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.873095 15416 catalog_manager.cc:5697] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 1 to 2, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 2 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.873960 15483 leader_election.cc:304] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:41.874688 15720 raft_consensus.cc:2804] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.874897 15667 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:41.875140 15720 raft_consensus.cc:697] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:41.876420 15720 consensus_queue.cc:237] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.882021 15416 catalog_manager.cc:5697] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 1 to 2, leader changed from 215b4647910c4682ae23bac5f7e54cad (127.15.6.3) to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.979084 15770 raft_consensus.cc:993] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f: : Instructing follower c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:41.979498 15793 raft_consensus.cc:1081] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 LEADER]: Signalling peer c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:41.980886 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:40588
I20260709 13:05:41.981304 15593 raft_consensus.cc:493] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.981642 15593 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.985774 15593 raft_consensus.cc:515] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.987270 15593 leader_election.cc:290] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 2 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:41.987922 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:41.988206 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:41.988404 15519 raft_consensus.cc:3055] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.988675 15667 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.988745 15519 raft_consensus.cc:740] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:41.989537 15519 consensus_queue.cc:260] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:41.990401 15519 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.993018 15667 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 2.
I20260709 13:05:41.993875 15558 leader_election.cc:304] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:41.994572 15744 raft_consensus.cc:2804] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.994807 15519 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 2.
I20260709 13:05:41.994911 15744 raft_consensus.cc:697] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:41.995647 15744 consensus_queue.cc:237] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:42.000717 15416 catalog_manager.cc:5697] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 1 to 2, leader changed from e1b73be4e23c467a9951f284481ee01f (127.15.6.1) to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 2 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.012378 15519 raft_consensus.cc:1275] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.013441 15744 consensus_queue.cc:1048] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.019603 15667 raft_consensus.cc:1275] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.020869 15745 consensus_queue.cc:1048] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.033682 15593 raft_consensus.cc:1275] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.034663 15793 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.041572 15667 raft_consensus.cc:1275] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.043264 15793 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.248720 15667 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.249795 15793 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.254405 15593 raft_consensus.cc:1275] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.257470 15594 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.258327 15715 consensus_queue.cc:1048] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.259251 15795 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.268946 15519 raft_consensus.cc:3060] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.274718 15519 raft_consensus.cc:1275] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.275830 15750 consensus_queue.cc:1048] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.364673 15667 raft_consensus.cc:1275] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.365726 15720 consensus_queue.cc:1048] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.373543 15592 raft_consensus.cc:1275] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.374752 15720 consensus_queue.cc:1048] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.392230 15667 raft_consensus.cc:1275] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.393190 15720 consensus_queue.cc:1048] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.400077 15592 raft_consensus.cc:1275] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.401202 15795 consensus_queue.cc:1048] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.457863 15667 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.458914 15745 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.465211 15519 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.466645 15739 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.537940 15384 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:44.538692 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.559021 15519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
mode: GRACEFUL
new_leader_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:48822
I20260709 13:05:44.559509 15519 raft_consensus.cc:606] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Received request to transfer leadership to TS 215b4647910c4682ae23bac5f7e54cad
I20260709 13:05:44.568349 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:05:44.568748 15593 raft_consensus.cc:606] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 LEADER]: Received request to transfer leadership to TS 215b4647910c4682ae23bac5f7e54cad
I20260709 13:05:44.569641 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:44.570029 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:44.583967 15806 raft_consensus.cc:993] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: : Instructing follower 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:44.584337 15745 raft_consensus.cc:1081] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 LEADER]: Signalling peer 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:44.585477 15668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:05:44.585873 15668 raft_consensus.cc:493] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.586140 15668 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.590577 15668 raft_consensus.cc:515] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:44.592128 15668 leader_election.cc:290] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 3 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:44.592720 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:44.592978 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:44.593183 15519 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.593479 15593 raft_consensus.cc:3055] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.593719 15593 raft_consensus.cc:740] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:44.594277 15593 consensus_queue.cc:260] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:44.595069 15593 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.597355 15519 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 3.
I20260709 13:05:44.598208 15634 leader_election.cc:304] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:44.598814 15750 raft_consensus.cc:2804] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.599323 15593 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 3.
I20260709 13:05:44.599992 15750 raft_consensus.cc:697] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:44.600780 15750 consensus_queue.cc:237] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:44.606842 15416 catalog_manager.cc:5697] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 2 to 3, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 3 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.837144 15795 raft_consensus.cc:993] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f: : Instructing follower 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:44.837514 15802 raft_consensus.cc:1081] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Signalling peer 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:44.838811 15668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:05:44.839219 15668 raft_consensus.cc:493] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.839464 15668 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.844319 15668 raft_consensus.cc:515] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:44.845674 15668 leader_election.cc:290] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 3 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:44.846342 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:44.846594 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:44.846866 15519 raft_consensus.cc:3055] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.847051 15593 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.847193 15519 raft_consensus.cc:740] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:44.847865 15519 consensus_queue.cc:260] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:44.848682 15519 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.851265 15593 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 3.
I20260709 13:05:44.852088 15632 leader_election.cc:304] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:44.852655 15750 raft_consensus.cc:2804] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.852823 15519 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 3.
I20260709 13:05:44.853006 15750 raft_consensus.cc:697] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:44.853785 15750 consensus_queue.cc:237] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:44.862782 15416 catalog_manager.cc:5697] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 2 to 3, leader changed from e1b73be4e23c467a9951f284481ee01f (127.15.6.1) to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 3 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:45.035820 15593 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.036998 15750 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.046933 15518 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.048280 15750 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.284350 15518 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.285481 15750 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.293424 15593 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.295348 15816 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.570685 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:45.579945 15518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
mode: GRACEFUL
new_leader_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:48820
I20260709 13:05:45.580400 15518 raft_consensus.cc:606] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Received request to transfer leadership to TS c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:45.584384 15518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
mode: GRACEFUL
new_leader_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:48820
I20260709 13:05:45.584784 15518 raft_consensus.cc:606] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Received request to transfer leadership to TS c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:45.588814 15667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
mode: GRACEFUL
new_leader_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:37116
I20260709 13:05:45.589210 15667 raft_consensus.cc:606] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Received request to transfer leadership to TS c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:45.593231 15518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a02529b2310e4280990398bfae369a22"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
mode: GRACEFUL
new_leader_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:48820
I20260709 13:05:45.593607 15518 raft_consensus.cc:606] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Received request to transfer leadership to TS c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:45.603673 15667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
mode: GRACEFUL
new_leader_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:37116
I20260709 13:05:45.604153 15667 raft_consensus.cc:606] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Received request to transfer leadership to TS c082a155a2ac41c8ae56b0851279326a
I20260709 13:05:45.717410 15821 raft_consensus.cc:993] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: : Instructing follower c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:45.717824 15816 raft_consensus.cc:1081] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Signalling peer c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:45.719245 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:05:45.719643 15593 raft_consensus.cc:493] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.719933 15593 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.723598 15593 raft_consensus.cc:515] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:45.724905 15593 leader_election.cc:290] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 4 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:45.725629 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:45.725872 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:45.726186 15518 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.726365 15667 raft_consensus.cc:3055] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:45.726692 15667 raft_consensus.cc:740] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:45.727419 15667 consensus_queue.cc:260] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:45.728564 15667 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.732271 15518 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 4.
I20260709 13:05:45.733362 15560 leader_election.cc:304] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:45.734083 15745 raft_consensus.cc:2804] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:45.734453 15667 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 4.
I20260709 13:05:45.734983 15745 raft_consensus.cc:697] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:45.736040 15745 consensus_queue.cc:237] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:45.740859 15416 catalog_manager.cc:5697] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 3 to 4, leader changed from 215b4647910c4682ae23bac5f7e54cad (127.15.6.3) to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 4 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.866616 15828 raft_consensus.cc:993] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f: : Instructing follower c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:45.867094 15827 raft_consensus.cc:1081] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Signalling peer c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:45.868594 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:40588
I20260709 13:05:45.869076 15593 raft_consensus.cc:493] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.869377 15593 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.873028 15593 raft_consensus.cc:515] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:45.874262 15593 leader_election.cc:290] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 3 election: Requested vote from peers 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783), e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363)
I20260709 13:05:45.874914 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:45.875222 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:45.875378 15667 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.875701 15518 raft_consensus.cc:3055] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.875990 15518 raft_consensus.cc:740] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:45.876622 15518 consensus_queue.cc:260] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:45.877449 15518 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.879588 15667 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 3.
I20260709 13:05:45.880434 15558 leader_election.cc:304] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:45.881019 15745 raft_consensus.cc:2804] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.881372 15745 raft_consensus.cc:697] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:45.881672 15518 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 3.
I20260709 13:05:45.882028 15745 consensus_queue.cc:237] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:45.888055 15416 catalog_manager.cc:5697] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 2 to 3, leader changed from e1b73be4e23c467a9951f284481ee01f (127.15.6.1) to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 3 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.972532 15802 raft_consensus.cc:993] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f: : Instructing follower c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:45.972922 15827 raft_consensus.cc:1081] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Signalling peer c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:45.974133 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:40588
I20260709 13:05:45.974529 15593 raft_consensus.cc:493] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.974783 15593 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.978745 15593 raft_consensus.cc:515] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:45.980134 15593 leader_election.cc:290] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 3 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:45.980747 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:45.981086 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a049fb792e3d44ac95a9a635742bf326" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:45.981248 15518 raft_consensus.cc:3055] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.981549 15667 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.981544 15518 raft_consensus.cc:740] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:45.982311 15518 consensus_queue.cc:260] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:45.983139 15518 raft_consensus.cc:3060] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.985782 15667 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 3.
I20260709 13:05:45.986577 15558 leader_election.cc:304] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:45.987128 15823 raft_consensus.cc:2804] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.987466 15823 raft_consensus.cc:697] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:45.987469 15518 raft_consensus.cc:2468] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 3.
I20260709 13:05:45.988279 15823 consensus_queue.cc:237] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:45.994269 15416 catalog_manager.cc:5697] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 2 to 3, leader changed from e1b73be4e23c467a9951f284481ee01f (127.15.6.1) to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 3 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.091228 15821 raft_consensus.cc:993] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad: : Instructing follower c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:46.091617 15821 raft_consensus.cc:1081] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Signalling peer c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:46.092945 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:05:46.093309 15593 raft_consensus.cc:493] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.093536 15593 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.097234 15593 raft_consensus.cc:515] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:46.098451 15593 leader_election.cc:290] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 4 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:46.099124 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:46.099395 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:46.099594 15518 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.099915 15667 raft_consensus.cc:3055] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:46.100144 15667 raft_consensus.cc:740] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:46.100716 15667 consensus_queue.cc:260] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:46.101482 15667 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.103452 15518 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 4.
I20260709 13:05:46.104264 15560 leader_election.cc:304] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c082a155a2ac41c8ae56b0851279326a, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:46.104846 15823 raft_consensus.cc:2804] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:46.105283 15823 raft_consensus.cc:697] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:46.105376 15667 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 4.
I20260709 13:05:46.106078 15823 consensus_queue.cc:237] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:46.111419 15416 catalog_manager.cc:5697] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 3 to 4, leader changed from 215b4647910c4682ae23bac5f7e54cad (127.15.6.3) to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 4 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.120496 15667 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.121490 15823 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.128525 15518 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.132627 15745 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.179896 15802 raft_consensus.cc:993] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f: : Instructing follower c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:46.180258 15827 raft_consensus.cc:1081] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Signalling peer c082a155a2ac41c8ae56b0851279326a to start an election
I20260709 13:05:46.181466 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a02529b2310e4280990398bfae369a22"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
 from {username='slave'} at 127.0.0.1:40588
I20260709 13:05:46.181859 15593 raft_consensus.cc:493] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:46.182098 15593 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.185863 15593 raft_consensus.cc:515] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:46.187209 15593 leader_election.cc:290] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 3 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:46.187922 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:46.188184 15667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02529b2310e4280990398bfae369a22" candidate_uuid: "c082a155a2ac41c8ae56b0851279326a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:46.188350 15518 raft_consensus.cc:3055] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:46.188618 15667 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.188627 15518 raft_consensus.cc:740] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:46.189284 15518 consensus_queue.cc:260] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:46.190037 15518 raft_consensus.cc:3060] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.192564 15667 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 3.
I20260709 13:05:46.193306 15558 leader_election.cc:304] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, c082a155a2ac41c8ae56b0851279326a; no voters: 
I20260709 13:05:46.193811 15518 raft_consensus.cc:2468] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c082a155a2ac41c8ae56b0851279326a in term 3.
I20260709 13:05:46.193868 15833 raft_consensus.cc:2804] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.194249 15833 raft_consensus.cc:697] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Becoming Leader. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:46.195030 15833 consensus_queue.cc:237] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:46.200726 15415 catalog_manager.cc:5697] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a reported cstate change: term changed from 2 to 3, leader changed from e1b73be4e23c467a9951f284481ee01f (127.15.6.1) to c082a155a2ac41c8ae56b0851279326a (127.15.6.2). New cstate: current_term: 3 leader_uuid: "c082a155a2ac41c8ae56b0851279326a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.338136 15667 raft_consensus.cc:1275] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.339272 15833 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.346662 15518 raft_consensus.cc:1275] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.348088 15823 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.509436 15667 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.510615 15838 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.518769 15518 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.520061 15838 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.562554 15667 raft_consensus.cc:1275] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.564116 15518 raft_consensus.cc:1275] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.564016 15838 consensus_queue.cc:1048] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.565234 15838 consensus_queue.cc:1048] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.773723 15518 raft_consensus.cc:1275] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.774744 15745 consensus_queue.cc:1048] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.782130 15667 raft_consensus.cc:1275] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Refusing update from remote peer c082a155a2ac41c8ae56b0851279326a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.784935 15823 consensus_queue.cc:1048] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.608225 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.614789 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:05:48.615332 15593 raft_consensus.cc:606] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Received request to transfer leadership to TS 215b4647910c4682ae23bac5f7e54cad
I20260709 13:05:48.617422 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:05:48.617760 15593 raft_consensus.cc:606] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Received request to transfer leadership to TS e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:48.619433 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:05:48.619758 15593 raft_consensus.cc:606] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Received request to transfer leadership to TS 215b4647910c4682ae23bac5f7e54cad
I20260709 13:05:48.621490 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:05:48.621819 15593 raft_consensus.cc:606] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Received request to transfer leadership to TS e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:48.623502 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446"
dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
mode: GRACEFUL
new_leader_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:05:48.623843 15593 raft_consensus.cc:606] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Received request to transfer leadership to TS e1b73be4e23c467a9951f284481ee01f
I20260709 13:05:48.624621 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:48.624992 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.678246 15847 raft_consensus.cc:993] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a: : Instructing follower e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:48.678766 15848 raft_consensus.cc:1081] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Signalling peer e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:48.680231 15519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:48804
I20260709 13:05:48.680644 15519 raft_consensus.cc:493] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.680913 15519 raft_consensus.cc:3060] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.685531 15847 raft_consensus.cc:993] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: : Instructing follower 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:48.685946 15848 raft_consensus.cc:1081] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Signalling peer 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:48.686592 15519 raft_consensus.cc:515] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.687647 15667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:05:48.688133 15667 raft_consensus.cc:493] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.688442 15667 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.688601 15519 leader_election.cc:290] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:48.689459 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:48.690315 15593 raft_consensus.cc:3055] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.690470 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a9ee6fff44feb02566809a9105f2" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:48.690621 15593 raft_consensus.cc:740] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:48.691067 15668 raft_consensus.cc:3060] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.691509 15593 consensus_queue.cc:260] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.692732 15593 raft_consensus.cc:3060] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.693307 15667 raft_consensus.cc:515] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.694747 15667 leader_election.cc:290] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 5 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:48.695458 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:48.696013 15519 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.696035 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63e3b7db7f541668ce236a9f06ab8bb" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:48.696635 15592 raft_consensus.cc:3055] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:48.696928 15592 raft_consensus.cc:740] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:48.697371 15668 raft_consensus.cc:2468] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:48.697679 15592 consensus_queue.cc:260] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.698776 15592 raft_consensus.cc:3060] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.698673 15483 leader_election.cc:304] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:48.700531 15593 raft_consensus.cc:2468] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:48.701717 15519 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 5.
I20260709 13:05:48.703305 15849 raft_consensus.cc:2804] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.703429 15634 leader_election.cc:304] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:48.704444 15821 raft_consensus.cc:2804] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:48.704545 15592 raft_consensus.cc:2468] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 5.
I20260709 13:05:48.704567 15849 raft_consensus.cc:697] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:48.706431 15849 consensus_queue.cc:237] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.708144 15821 raft_consensus.cc:697] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 5 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:48.709131 15821 consensus_queue.cc:237] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.715317 15416 catalog_manager.cc:5697] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 1 to 2, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.717026 15413 catalog_manager.cc:5697] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 4 to 5, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 5 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.916262 15847 raft_consensus.cc:993] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a: : Instructing follower e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:48.916620 15848 raft_consensus.cc:1081] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Signalling peer e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:48.917852 15519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:48804
I20260709 13:05:48.918226 15519 raft_consensus.cc:493] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.918476 15519 raft_consensus.cc:3060] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.922386 15519 raft_consensus.cc:515] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.923632 15519 leader_election.cc:290] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:48.924413 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:48.924664 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc556d88114d4bd18334c6947d50e854" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:48.924952 15592 raft_consensus.cc:3055] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.925127 15668 raft_consensus.cc:3060] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.925285 15592 raft_consensus.cc:740] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:48.926083 15592 consensus_queue.cc:260] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.927235 15592 raft_consensus.cc:3060] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.930717 15668 raft_consensus.cc:2468] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:48.931653 15483 leader_election.cc:304] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:48.932420 15849 raft_consensus.cc:2804] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.932811 15849 raft_consensus.cc:697] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:48.933138 15592 raft_consensus.cc:2468] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 2.
I20260709 13:05:48.933600 15849 consensus_queue.cc:237] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:48.939906 15413 catalog_manager.cc:5697] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 1 to 2, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.000465 15847 raft_consensus.cc:993] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a: : Instructing follower 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:49.000865 15848 raft_consensus.cc:1081] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Signalling peer 215b4647910c4682ae23bac5f7e54cad to start an election
I20260709 13:05:49.002116 15668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54"
dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:05:49.002478 15668 raft_consensus.cc:493] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.002686 15668 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.006228 15668 raft_consensus.cc:515] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:49.007469 15668 leader_election.cc:290] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 5 election: Requested vote from peers e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363), c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371)
I20260709 13:05:49.008206 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
I20260709 13:05:49.008644 15519 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.008508 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e96ea0519dc4469bc9d74c75d405b54" candidate_uuid: "215b4647910c4682ae23bac5f7e54cad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:49.009019 15592 raft_consensus.cc:3055] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.009276 15592 raft_consensus.cc:740] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:49.009887 15592 consensus_queue.cc:260] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:49.010744 15592 raft_consensus.cc:3060] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.012370 15519 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 5.
I20260709 13:05:49.013142 15634 leader_election.cc:304] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:49.013720 15821 raft_consensus.cc:2804] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:49.014072 15821 raft_consensus.cc:697] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 5 LEADER]: Becoming Leader. State: Replica: 215b4647910c4682ae23bac5f7e54cad, State: Running, Role: LEADER
I20260709 13:05:49.014763 15821 consensus_queue.cc:237] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } }
I20260709 13:05:49.015305 15592 raft_consensus.cc:2468] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215b4647910c4682ae23bac5f7e54cad in term 5.
I20260709 13:05:49.021359 15413 catalog_manager.cc:5697] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad reported cstate change: term changed from 4 to 5, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to 215b4647910c4682ae23bac5f7e54cad (127.15.6.3). New cstate: current_term: 5 leader_uuid: "215b4647910c4682ae23bac5f7e54cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.046046 15847 raft_consensus.cc:993] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: : Instructing follower e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:49.046389 15848 raft_consensus.cc:1081] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Signalling peer e1b73be4e23c467a9951f284481ee01f to start an election
I20260709 13:05:49.047613 15519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446"
dest_uuid: "e1b73be4e23c467a9951f284481ee01f"
 from {username='slave'} at 127.0.0.1:48804
I20260709 13:05:49.048092 15519 raft_consensus.cc:493] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.048344 15519 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:49.051923 15519 raft_consensus.cc:515] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:49.053124 15519 leader_election.cc:290] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 4 election: Requested vote from peers c082a155a2ac41c8ae56b0851279326a (127.15.6.2:33371), 215b4647910c4682ae23bac5f7e54cad (127.15.6.3:43783)
I20260709 13:05:49.053839 15592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c082a155a2ac41c8ae56b0851279326a"
I20260709 13:05:49.054087 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f63825b55843a3a0ed6398bfb7f446" candidate_uuid: "e1b73be4e23c467a9951f284481ee01f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "215b4647910c4682ae23bac5f7e54cad"
I20260709 13:05:49.054385 15592 raft_consensus.cc:3055] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:49.054553 15668 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:49.054729 15592 raft_consensus.cc:740] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c082a155a2ac41c8ae56b0851279326a, State: Running, Role: LEADER
I20260709 13:05:49.055518 15592 consensus_queue.cc:260] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:49.056658 15592 raft_consensus.cc:3060] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:49.060176 15668 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 4.
I20260709 13:05:49.061105 15483 leader_election.cc:304] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215b4647910c4682ae23bac5f7e54cad, e1b73be4e23c467a9951f284481ee01f; no voters: 
I20260709 13:05:49.061693 15849 raft_consensus.cc:2804] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:49.062014 15592 raft_consensus.cc:2468] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b73be4e23c467a9951f284481ee01f in term 4.
I20260709 13:05:49.062027 15849 raft_consensus.cc:697] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 4 LEADER]: Becoming Leader. State: Replica: e1b73be4e23c467a9951f284481ee01f, State: Running, Role: LEADER
I20260709 13:05:49.063056 15849 consensus_queue.cc:237] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } }
I20260709 13:05:49.069288 15413 catalog_manager.cc:5697] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f reported cstate change: term changed from 3 to 4, leader changed from c082a155a2ac41c8ae56b0851279326a (127.15.6.2) to e1b73be4e23c467a9951f284481ee01f (127.15.6.1). New cstate: current_term: 4 leader_uuid: "e1b73be4e23c467a9951f284481ee01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.114266 15519 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:49.115263 15821 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.125790 15592 raft_consensus.cc:1275] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:49.127765 15864 consensus_queue.cc:1048] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.136413 15592 raft_consensus.cc:1275] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.137369 15849 consensus_queue.cc:1048] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.145632 15668 raft_consensus.cc:1275] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.147228 15850 consensus_queue.cc:1048] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:49.325580 15668 raft_consensus.cc:1275] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.326653 15870 consensus_queue.cc:1048] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.335587 15592 raft_consensus.cc:1275] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.336715 15849 consensus_queue.cc:1048] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.477229 15519 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:49.478348 15864 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b73be4e23c467a9951f284481ee01f" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.480641 15668 raft_consensus.cc:1275] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:49.482372 15849 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "215b4647910c4682ae23bac5f7e54cad" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.488919 15592 raft_consensus.cc:1275] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Refusing update from remote peer 215b4647910c4682ae23bac5f7e54cad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:49.490603 15851 consensus_queue.cc:1048] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:49.497542 15593 raft_consensus.cc:1275] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Refusing update from remote peer e1b73be4e23c467a9951f284481ee01f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:49.500560 15850 consensus_queue.cc:1048] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c082a155a2ac41c8ae56b0851279326a" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:49.625710 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.630741 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
I20260709 13:05:49.653434 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.654067 15384 tablet_replica.cc:333] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.654747 15384 raft_consensus.cc:2243] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.655224 15384 raft_consensus.cc:2272] T 0cd8bb13d37942478b02ce121c5bfe78 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.656430 15634 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:49.658061 15384 tablet_replica.cc:333] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.658705 15384 raft_consensus.cc:2243] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:49.659252 15634 consensus_peers.cc:597] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad -> Peer e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363): Couldn't send request to peer e1b73be4e23c467a9951f284481ee01f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.659314 15384 raft_consensus.cc:2272] T 64c2a9ee6fff44feb02566809a9105f2 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.661134 15384 tablet_replica.cc:333] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.661612 15384 raft_consensus.cc:2243] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.662250 15384 raft_consensus.cc:2272] T bc556d88114d4bd18334c6947d50e854 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.663882 15384 tablet_replica.cc:333] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.664323 15384 raft_consensus.cc:2243] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.664698 15384 raft_consensus.cc:2272] T b63e3b7db7f541668ce236a9f06ab8bb P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.666285 15384 tablet_replica.cc:333] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.666716 15384 raft_consensus.cc:2243] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.667083 15384 raft_consensus.cc:2272] T a02529b2310e4280990398bfae369a22 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.668586 15384 tablet_replica.cc:333] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.668982 15384 raft_consensus.cc:2243] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.669341 15384 raft_consensus.cc:2272] T a049fb792e3d44ac95a9a635742bf326 P e1b73be4e23c467a9951f284481ee01f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.670768 15384 tablet_replica.cc:333] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.671161 15384 raft_consensus.cc:2243] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.671535 15384 raft_consensus.cc:2272] T 5e96ea0519dc4469bc9d74c75d405b54 P e1b73be4e23c467a9951f284481ee01f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.673552 15384 tablet_replica.cc:333] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.674033 15384 raft_consensus.cc:2243] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.674405 15384 raft_consensus.cc:2272] T c37bb9d88be645c7990829b6bdb7a3a7 P e1b73be4e23c467a9951f284481ee01f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.676018 15384 tablet_replica.cc:333] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f: stopping tablet replica
I20260709 13:05:49.676400 15384 raft_consensus.cc:2243] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.677006 15384 raft_consensus.cc:2272] T d3f63825b55843a3a0ed6398bfb7f446 P e1b73be4e23c467a9951f284481ee01f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.762763 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
I20260709 13:05:49.778556 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
I20260709 13:05:49.801847 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.802453 15384 tablet_replica.cc:333] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.803135 15384 raft_consensus.cc:2243] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.803601 15384 raft_consensus.cc:2272] T 64c2a9ee6fff44feb02566809a9105f2 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.805589 15384 tablet_replica.cc:333] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.806042 15384 raft_consensus.cc:2243] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.806381 15384 raft_consensus.cc:2272] T 0cd8bb13d37942478b02ce121c5bfe78 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.807776 15384 tablet_replica.cc:333] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.808241 15384 raft_consensus.cc:2243] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.808542 15384 raft_consensus.cc:2272] T bc556d88114d4bd18334c6947d50e854 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.810178 15384 tablet_replica.cc:333] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.810580 15384 raft_consensus.cc:2243] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.810894 15384 raft_consensus.cc:2272] T b63e3b7db7f541668ce236a9f06ab8bb P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.812580 15384 tablet_replica.cc:333] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.812975 15384 raft_consensus.cc:2243] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.813568 15384 raft_consensus.cc:2272] T a02529b2310e4280990398bfae369a22 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.815022 15384 tablet_replica.cc:333] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.815603 15384 raft_consensus.cc:2243] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.816529 15384 raft_consensus.cc:2272] T c37bb9d88be645c7990829b6bdb7a3a7 P c082a155a2ac41c8ae56b0851279326a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.818495 15384 tablet_replica.cc:333] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.818969 15384 raft_consensus.cc:2243] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.819403 15384 raft_consensus.cc:2272] T 5e96ea0519dc4469bc9d74c75d405b54 P c082a155a2ac41c8ae56b0851279326a [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.820291 15560 consensus_peers.cc:597] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a -> Peer e1b73be4e23c467a9951f284481ee01f (127.15.6.1:35363): Couldn't send request to peer e1b73be4e23c467a9951f284481ee01f. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:35363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.821230 15384 tablet_replica.cc:333] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.821669 15384 raft_consensus.cc:2243] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.822283 15384 raft_consensus.cc:2272] T a049fb792e3d44ac95a9a635742bf326 P c082a155a2ac41c8ae56b0851279326a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.823818 15384 tablet_replica.cc:333] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a: stopping tablet replica
I20260709 13:05:49.824216 15384 raft_consensus.cc:2243] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.824560 15384 raft_consensus.cc:2272] T d3f63825b55843a3a0ed6398bfb7f446 P c082a155a2ac41c8ae56b0851279326a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.849190 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
I20260709 13:05:49.863840 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
I20260709 13:05:49.882438 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.883029 15384 tablet_replica.cc:333] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.883553 15384 raft_consensus.cc:2243] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.883982 15384 raft_consensus.cc:2272] T bc556d88114d4bd18334c6947d50e854 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.885783 15384 tablet_replica.cc:333] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.886230 15384 raft_consensus.cc:2243] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.886857 15384 raft_consensus.cc:2272] T 0cd8bb13d37942478b02ce121c5bfe78 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.888447 15384 tablet_replica.cc:333] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.888899 15384 raft_consensus.cc:2243] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.889235 15384 raft_consensus.cc:2272] T 64c2a9ee6fff44feb02566809a9105f2 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.891371 15384 tablet_replica.cc:333] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.891853 15384 raft_consensus.cc:2243] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.892455 15384 raft_consensus.cc:2272] T b63e3b7db7f541668ce236a9f06ab8bb P 215b4647910c4682ae23bac5f7e54cad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.894209 15384 tablet_replica.cc:333] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.894784 15384 raft_consensus.cc:2243] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.895206 15384 raft_consensus.cc:2272] T a02529b2310e4280990398bfae369a22 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.896651 15384 tablet_replica.cc:333] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.897049 15384 raft_consensus.cc:2243] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.897401 15384 raft_consensus.cc:2272] T a049fb792e3d44ac95a9a635742bf326 P 215b4647910c4682ae23bac5f7e54cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.898810 15384 tablet_replica.cc:333] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.899210 15384 raft_consensus.cc:2243] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.899852 15384 raft_consensus.cc:2272] T 5e96ea0519dc4469bc9d74c75d405b54 P 215b4647910c4682ae23bac5f7e54cad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.901533 15384 tablet_replica.cc:333] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.901932 15384 raft_consensus.cc:2243] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.902274 15384 raft_consensus.cc:2272] T c37bb9d88be645c7990829b6bdb7a3a7 P 215b4647910c4682ae23bac5f7e54cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.903574 15384 tablet_replica.cc:333] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad: stopping tablet replica
I20260709 13:05:49.903981 15384 raft_consensus.cc:2243] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.904330 15384 raft_consensus.cc:2272] T d3f63825b55843a3a0ed6398bfb7f446 P 215b4647910c4682ae23bac5f7e54cad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.927714 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
I20260709 13:05:49.942138 15384 master.cc:562] Master@127.15.6.62:38007 shutting down...
I20260709 13:05:50.069415 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.069931 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.070242 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P fc2acd6664b84745bc6f1c966354b36a: stopping tablet replica
I20260709 13:05:50.088201 15384 master.cc:584] Master@127.15.6.62:38007 shutdown complete.
215b4647910c4682ae23bac5f7e54cad  1
c082a155a2ac41c8ae56b0851279326a  4
e1b73be4e23c467a9951f284481ee01f  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12215 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:50.123687 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:39633
I20260709 13:05:50.124759 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.129693 15882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.129906 15883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.132011 15885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.132098 15384 server_base.cc:1061] running on GCE node
I20260709 13:05:50.132964 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.133132 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.133289 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602350133272 us; error 0 us; skew 500 ppm
I20260709 13:05:50.133769 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.135903 15384 webserver.cc:533] Webserver started at http://127.15.6.62:34929/ using document root <none> and password file <none>
I20260709 13:05:50.136343 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.136507 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.136754 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.137759 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "da0cdde971e04da791eb74253661b3c4"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.142136 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:50.145179 15890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.145856 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:50.146111 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "da0cdde971e04da791eb74253661b3c4"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.146340 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.159310 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.160408 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.195487 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:39633
I20260709 13:05:50.195583 15941 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:39633 every 8 connection(s)
I20260709 13:05:50.199077 15942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.207649 15942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4: Bootstrap starting.
I20260709 13:05:50.211853 15942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.215435 15942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4: No bootstrap required, opened a new log
I20260709 13:05:50.217316 15942 raft_consensus.cc:359] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0cdde971e04da791eb74253661b3c4" member_type: VOTER }
I20260709 13:05:50.217646 15942 raft_consensus.cc:385] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.217818 15942 raft_consensus.cc:740] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0cdde971e04da791eb74253661b3c4, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.218250 15942 consensus_queue.cc:260] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0cdde971e04da791eb74253661b3c4" member_type: VOTER }
I20260709 13:05:50.218648 15942 raft_consensus.cc:399] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:50.218828 15942 raft_consensus.cc:493] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:50.219026 15942 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.222543 15942 raft_consensus.cc:515] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0cdde971e04da791eb74253661b3c4" member_type: VOTER }
I20260709 13:05:50.222956 15942 leader_election.cc:304] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da0cdde971e04da791eb74253661b3c4; no voters: 
I20260709 13:05:50.223917 15942 leader_election.cc:290] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:50.224165 15945 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.225306 15945 raft_consensus.cc:697] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 1 LEADER]: Becoming Leader. State: Replica: da0cdde971e04da791eb74253661b3c4, State: Running, Role: LEADER
I20260709 13:05:50.225924 15945 consensus_queue.cc:237] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0cdde971e04da791eb74253661b3c4" member_type: VOTER }
I20260709 13:05:50.226536 15942 sys_catalog.cc:565] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:50.230070 15947 sys_catalog.cc:455] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da0cdde971e04da791eb74253661b3c4. Latest consensus state: current_term: 1 leader_uuid: "da0cdde971e04da791eb74253661b3c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0cdde971e04da791eb74253661b3c4" member_type: VOTER } }
I20260709 13:05:50.230677 15947 sys_catalog.cc:458] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:50.232002 15946 sys_catalog.cc:455] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da0cdde971e04da791eb74253661b3c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0cdde971e04da791eb74253661b3c4" member_type: VOTER } }
I20260709 13:05:50.232535 15946 sys_catalog.cc:458] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:50.239089 15954 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:50.239133 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:50.243834 15954 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:50.251269 15954 catalog_manager.cc:1383] Generated new cluster ID: 277d909f83c347fb85781e0bb3b4eace
I20260709 13:05:50.251473 15954 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:50.286018 15954 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:50.287084 15954 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:50.306411 15954 catalog_manager.cc:6070] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4: Generated new TSK 0
I20260709 13:05:50.306866 15954 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:50.369691 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.375120 15963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.375888 15964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.378048 15384 server_base.cc:1061] running on GCE node
W20260709 13:05:50.378134 15966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.378966 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.379138 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.379292 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602350379267 us; error 0 us; skew 500 ppm
I20260709 13:05:50.379761 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.381795 15384 webserver.cc:533] Webserver started at http://127.15.6.1:45165/ using document root <none> and password file <none>
I20260709 13:05:50.382242 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.382417 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.382649 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.383592 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "6d89c51a229c43beaa0b32dc74d4104c"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.387558 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:50.390396 15971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.391002 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:50.391244 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "6d89c51a229c43beaa0b32dc74d4104c"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.391498 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.408270 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.409349 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.410651 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.412659 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.412837 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.413043 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.413200 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.450306 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:45461
I20260709 13:05:50.450389 16033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:45461 every 8 connection(s)
I20260709 13:05:50.454692 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.460860 16038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.461665 16039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.463984 16041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.465004 15384 server_base.cc:1061] running on GCE node
I20260709 13:05:50.465934 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.466133 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.466307 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602350466289 us; error 0 us; skew 500 ppm
I20260709 13:05:50.466780 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.469329 15384 webserver.cc:533] Webserver started at http://127.15.6.2:45951/ using document root <none> and password file <none>
I20260709 13:05:50.469337 16034 heartbeater.cc:344] Connected to a master server at 127.15.6.62:39633
I20260709 13:05:50.469725 16034 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.469820 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.470042 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.470275 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.470410 16034 heartbeater.cc:507] Master 127.15.6.62:39633 requested a full tablet report, sending...
I20260709 13:05:50.471289 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "950d8e29e5164c1bacc44ac5c378638e"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.472230 15907 ts_manager.cc:194] Registered new tserver with Master: 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461)
I20260709 13:05:50.473814 15907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58792
I20260709 13:05:50.475514 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:50.478406 16046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.479060 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:50.479300 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "950d8e29e5164c1bacc44ac5c378638e"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.479542 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.525067 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.526726 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.528604 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.531477 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.531730 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.532028 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.532234 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.570452 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:41161
I20260709 13:05:50.570571 16108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:41161 every 8 connection(s)
I20260709 13:05:50.574574 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.582093 16113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.582599 16112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.585896 16115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.586290 15384 server_base.cc:1061] running on GCE node
I20260709 13:05:50.586932 16109 heartbeater.cc:344] Connected to a master server at 127.15.6.62:39633
I20260709 13:05:50.587193 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:50.587252 16109 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:50.587448 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.587626 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602350587611 us; error 0 us; skew 500 ppm
I20260709 13:05:50.588058 16109 heartbeater.cc:507] Master 127.15.6.62:39633 requested a full tablet report, sending...
I20260709 13:05:50.588182 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.589973 15907 ts_manager.cc:194] Registered new tserver with Master: 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161)
I20260709 13:05:50.590565 15384 webserver.cc:533] Webserver started at http://127.15.6.3:42265/ using document root <none> and password file <none>
I20260709 13:05:50.591027 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.591217 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.591446 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.591372 15907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58808
I20260709 13:05:50.592749 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.596792 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:50.599690 16120 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.600364 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:50.600612 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-pqzm"
I20260709 13:05:50.600886 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.620743 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.621753 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.623009 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.624960 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.625140 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.625342 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.625490 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.661723 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:33403
I20260709 13:05:50.661804 16182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:33403 every 8 connection(s)
I20260709 13:05:50.673945 16183 heartbeater.cc:344] Connected to a master server at 127.15.6.62:39633
I20260709 13:05:50.674242 16183 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.674878 16183 heartbeater.cc:507] Master 127.15.6.62:39633 requested a full tablet report, sending...
I20260709 13:05:50.676546 15907 ts_manager.cc:194] Registered new tserver with Master: 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:50.677608 15384 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013060299s
I20260709 13:05:50.677661 15907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58818
I20260709 13:05:50.698949 15907 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58830:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:50.701530 15907 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:50.784399 16074 tablet_service.cc:1511] Processing CreateTablet for tablet bddb18534b4c411e9e11c7f6c369ea9e (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:50.785765 16074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb18534b4c411e9e11c7f6c369ea9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.790637 16073 tablet_service.cc:1511] Processing CreateTablet for tablet 211f75bcffb945a19722564567feb1b8 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:50.791946 16073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211f75bcffb945a19722564567feb1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.791836 16148 tablet_service.cc:1511] Processing CreateTablet for tablet bddb18534b4c411e9e11c7f6c369ea9e (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:50.793668 16146 tablet_service.cc:1511] Processing CreateTablet for tablet ffc42fc7362a4e9e9597859f15d2bb18 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:50.793678 16067 tablet_service.cc:1511] Processing CreateTablet for tablet a345b6da844241b793ecd71ed0e5af9c (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:50.794679 16066 tablet_service.cc:1511] Processing CreateTablet for tablet b80ebf0e6e2b46508d208c0b01bffa6b (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:50.795137 16067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a345b6da844241b793ecd71ed0e5af9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.795565 16145 tablet_service.cc:1511] Processing CreateTablet for tablet bb1b3f46b3e54797b1af255e9048a7cb (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:50.796424 16065 tablet_service.cc:1511] Processing CreateTablet for tablet 99402b2c62e0458e8ae777dcaeb05eac (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:50.796864 16072 tablet_service.cc:1511] Processing CreateTablet for tablet ffc42fc7362a4e9e9597859f15d2bb18 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:50.797629 16065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99402b2c62e0458e8ae777dcaeb05eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.797443 16068 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab2c8d23eb2404794f71a969e073d65 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:50.799135 16148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb18534b4c411e9e11c7f6c369ea9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.799244 16071 tablet_service.cc:1511] Processing CreateTablet for tablet bb1b3f46b3e54797b1af255e9048a7cb (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:50.800855 16070 tablet_service.cc:1511] Processing CreateTablet for tablet 15f8695c04ae45cc9391988c92faa5a0 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:50.802004 16069 tablet_service.cc:1511] Processing CreateTablet for tablet d17686ae0ed14dc5abea4e05b80f84cf (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:50.804392 16143 tablet_service.cc:1511] Processing CreateTablet for tablet d17686ae0ed14dc5abea4e05b80f84cf (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:50.805065 16139 tablet_service.cc:1511] Processing CreateTablet for tablet 99402b2c62e0458e8ae777dcaeb05eac (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:50.805619 16143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17686ae0ed14dc5abea4e05b80f84cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.806244 16139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99402b2c62e0458e8ae777dcaeb05eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.810240 16147 tablet_service.cc:1511] Processing CreateTablet for tablet 211f75bcffb945a19722564567feb1b8 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:50.810648 16144 tablet_service.cc:1511] Processing CreateTablet for tablet 15f8695c04ae45cc9391988c92faa5a0 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:50.811480 16147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211f75bcffb945a19722564567feb1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.811882 16141 tablet_service.cc:1511] Processing CreateTablet for tablet a345b6da844241b793ecd71ed0e5af9c (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:50.812753 16140 tablet_service.cc:1511] Processing CreateTablet for tablet b80ebf0e6e2b46508d208c0b01bffa6b (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:50.812994 16142 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab2c8d23eb2404794f71a969e073d65 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:50.814184 16141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a345b6da844241b793ecd71ed0e5af9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.819330 16146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc42fc7362a4e9e9597859f15d2bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.820006 16144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f8695c04ae45cc9391988c92faa5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.820628 16145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1b3f46b3e54797b1af255e9048a7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.812346 16072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc42fc7362a4e9e9597859f15d2bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.828984 16140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80ebf0e6e2b46508d208c0b01bffa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.829325 16070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f8695c04ae45cc9391988c92faa5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.832067 16069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17686ae0ed14dc5abea4e05b80f84cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.833943 16071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1b3f46b3e54797b1af255e9048a7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.834643 16066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80ebf0e6e2b46508d208c0b01bffa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.837177 15999 tablet_service.cc:1511] Processing CreateTablet for tablet bddb18534b4c411e9e11c7f6c369ea9e (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:50.838384 15999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb18534b4c411e9e11c7f6c369ea9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.840078 16142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab2c8d23eb2404794f71a969e073d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.844089 16068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab2c8d23eb2404794f71a969e073d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.845551 15998 tablet_service.cc:1511] Processing CreateTablet for tablet 211f75bcffb945a19722564567feb1b8 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:50.846796 15998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211f75bcffb945a19722564567feb1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.865825 15997 tablet_service.cc:1511] Processing CreateTablet for tablet ffc42fc7362a4e9e9597859f15d2bb18 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:50.867208 15997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc42fc7362a4e9e9597859f15d2bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.870139 15996 tablet_service.cc:1511] Processing CreateTablet for tablet bb1b3f46b3e54797b1af255e9048a7cb (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:50.871347 15996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1b3f46b3e54797b1af255e9048a7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.882134 15995 tablet_service.cc:1511] Processing CreateTablet for tablet 15f8695c04ae45cc9391988c92faa5a0 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:50.884493 15995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f8695c04ae45cc9391988c92faa5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.902942 15994 tablet_service.cc:1511] Processing CreateTablet for tablet d17686ae0ed14dc5abea4e05b80f84cf (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:50.903330 15993 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab2c8d23eb2404794f71a969e073d65 (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:50.905032 15994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17686ae0ed14dc5abea4e05b80f84cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.908370 16198 tablet_bootstrap.cc:492] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:50.908685 15990 tablet_service.cc:1511] Processing CreateTablet for tablet 99402b2c62e0458e8ae777dcaeb05eac (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:50.913769 15992 tablet_service.cc:1511] Processing CreateTablet for tablet a345b6da844241b793ecd71ed0e5af9c (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:50.913951 15991 tablet_service.cc:1511] Processing CreateTablet for tablet b80ebf0e6e2b46508d208c0b01bffa6b (DEFAULT_TABLE table=test-workload [id=07e49afbdd38497eae4cbc20b3cae3af]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:50.916045 15993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab2c8d23eb2404794f71a969e073d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.922025 16198 tablet_bootstrap.cc:654] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.928056 15991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80ebf0e6e2b46508d208c0b01bffa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.929387 15990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99402b2c62e0458e8ae777dcaeb05eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.928371 16199 tablet_bootstrap.cc:492] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:50.930686 15992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a345b6da844241b793ecd71ed0e5af9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.936151 16200 tablet_bootstrap.cc:492] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:50.971776 16199 tablet_bootstrap.cc:654] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.972926 16198 tablet_bootstrap.cc:492] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:50.973380 16198 ts_tablet_manager.cc:1403] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.002s
I20260709 13:05:50.975225 16200 tablet_bootstrap.cc:654] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.979897 16198 raft_consensus.cc:359] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:50.980868 16198 raft_consensus.cc:385] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.981262 16198 raft_consensus.cc:740] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.982053 16198 consensus_queue.cc:260] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:50.986370 16199 tablet_bootstrap.cc:492] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:50.986670 16200 tablet_bootstrap.cc:492] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:50.986696 16109 heartbeater.cc:499] Master 127.15.6.62:39633 was elected leader, sending a full tablet report...
I20260709 13:05:50.986778 16199 ts_tablet_manager.cc:1403] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.007s
I20260709 13:05:50.987232 16200 ts_tablet_manager.cc:1403] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.010s
I20260709 13:05:50.989408 16199 raft_consensus.cc:359] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:50.986393 16198 ts_tablet_manager.cc:1434] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:50.989887 16199 raft_consensus.cc:385] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.990347 16199 raft_consensus.cc:740] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.989893 16200 raft_consensus.cc:359] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:50.990808 16200 raft_consensus.cc:385] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.990904 16198 tablet_bootstrap.cc:492] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:50.991168 16200 raft_consensus.cc:740] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.991263 16199 consensus_queue.cc:260] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:50.992111 16200 consensus_queue.cc:260] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:50.997511 16198 tablet_bootstrap.cc:654] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.000605 16199 ts_tablet_manager.cc:1434] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.008s
I20260709 13:05:51.001304 16183 heartbeater.cc:499] Master 127.15.6.62:39633 was elected leader, sending a full tablet report...
I20260709 13:05:51.014518 16034 heartbeater.cc:499] Master 127.15.6.62:39633 was elected leader, sending a full tablet report...
I20260709 13:05:51.015218 16198 tablet_bootstrap.cc:492] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.015678 16198 ts_tablet_manager.cc:1403] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:05:51.016436 16199 tablet_bootstrap.cc:492] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.017998 16208 raft_consensus.cc:493] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.018323 16198 raft_consensus.cc:359] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.018447 16208 raft_consensus.cc:515] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.019045 16198 raft_consensus.cc:385] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.019341 16198 raft_consensus.cc:740] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.020156 16198 consensus_queue.cc:260] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.022130 16198 ts_tablet_manager.cc:1434] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:51.022923 16198 tablet_bootstrap.cc:492] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.022966 16199 tablet_bootstrap.cc:654] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.026190 16200 ts_tablet_manager.cc:1434] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.039s	user 0.012s	sys 0.016s
I20260709 13:05:51.027154 16200 tablet_bootstrap.cc:492] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.029624 16198 tablet_bootstrap.cc:654] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.033531 16200 tablet_bootstrap.cc:654] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.036362 16208 leader_election.cc:290] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.037636 16199 tablet_bootstrap.cc:492] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.038123 16199 ts_tablet_manager.cc:1403] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:05:51.041031 16199 raft_consensus.cc:359] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.041742 16199 raft_consensus.cc:385] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.042040 16199 raft_consensus.cc:740] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.042948 16199 consensus_queue.cc:260] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.045259 16199 ts_tablet_manager.cc:1434] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:51.046248 16199 tablet_bootstrap.cc:492] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.052534 16199 tablet_bootstrap.cc:654] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.057467 16200 tablet_bootstrap.cc:492] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.057847 16200 ts_tablet_manager.cc:1403] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:05:51.060016 16200 raft_consensus.cc:359] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.060498 16200 raft_consensus.cc:385] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.060710 16200 raft_consensus.cc:740] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.061275 16200 consensus_queue.cc:260] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.062767 16200 ts_tablet_manager.cc:1434] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:05:51.063632 16200 tablet_bootstrap.cc:492] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.070134 16199 tablet_bootstrap.cc:492] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.070652 16199 ts_tablet_manager.cc:1403] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:05:51.073495 16200 tablet_bootstrap.cc:654] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.073421 16199 raft_consensus.cc:359] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.075254 16199 raft_consensus.cc:385] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.075609 16199 raft_consensus.cc:740] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.076382 16199 consensus_queue.cc:260] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.078681 16199 ts_tablet_manager.cc:1434] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:51.079646 16199 tablet_bootstrap.cc:492] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.083638 16200 tablet_bootstrap.cc:492] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.084116 16200 ts_tablet_manager.cc:1403] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:05:51.085886 16199 tablet_bootstrap.cc:654] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.087206 16200 raft_consensus.cc:359] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.087903 16200 raft_consensus.cc:385] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.088181 16200 raft_consensus.cc:740] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.088873 16200 consensus_queue.cc:260] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.090905 16200 ts_tablet_manager.cc:1434] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:51.091854 16200 tablet_bootstrap.cc:492] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.092620 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
W20260709 13:05:51.094242 15972 leader_election.cc:343] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.098129 16200 tablet_bootstrap.cc:654] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.106031 16199 tablet_bootstrap.cc:492] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.106602 16199 ts_tablet_manager.cc:1403] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.000s
I20260709 13:05:51.109567 16199 raft_consensus.cc:359] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.110414 16199 raft_consensus.cc:385] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.110546 16158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.110798 16199 raft_consensus.cc:740] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.111260 16158 raft_consensus.cc:2468] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.111754 16199 consensus_queue.cc:260] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.114609 16199 ts_tablet_manager.cc:1434] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:51.115665 16199 tablet_bootstrap.cc:492] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.112756 15973 leader_election.cc:304] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.120121 16208 raft_consensus.cc:2804] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.120493 16208 raft_consensus.cc:493] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.120812 16208 raft_consensus.cc:3060] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.123127 16199 tablet_bootstrap.cc:654] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.126147 16198 tablet_bootstrap.cc:492] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.126579 16198 ts_tablet_manager.cc:1403] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.104s	user 0.038s	sys 0.061s
I20260709 13:05:51.128798 16208 raft_consensus.cc:515] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.129462 16198 raft_consensus.cc:359] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.130158 16198 raft_consensus.cc:385] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.130430 16198 raft_consensus.cc:740] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.131357 16200 tablet_bootstrap.cc:492] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.131237 16198 consensus_queue.cc:260] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.131783 16200 ts_tablet_manager.cc:1403] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.018s
I20260709 13:05:51.131925 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
W20260709 13:05:51.133409 15972 leader_election.cc:343] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.134521 16200 raft_consensus.cc:359] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.134943 16198 ts_tablet_manager.cc:1434] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:51.135166 16200 raft_consensus.cc:385] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.135463 16200 raft_consensus.cc:740] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.135878 16198 tablet_bootstrap.cc:492] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.136147 16200 consensus_queue.cc:260] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.138231 16200 ts_tablet_manager.cc:1434] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:05:51.139134 16200 tablet_bootstrap.cc:492] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.142041 16198 tablet_bootstrap.cc:654] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.145072 16200 tablet_bootstrap.cc:654] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.151140 16205 raft_consensus.cc:493] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.151607 16205 raft_consensus.cc:515] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.153389 16198 tablet_bootstrap.cc:492] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.153942 16198 ts_tablet_manager.cc:1403] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.004s
I20260709 13:05:51.156657 16206 raft_consensus.cc:493] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.157120 16206 raft_consensus.cc:515] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.158309 16200 tablet_bootstrap.cc:492] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.158196 16198 raft_consensus.cc:359] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.158826 16200 ts_tablet_manager.cc:1403] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:05:51.159073 16198 raft_consensus.cc:385] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.159375 16205 leader_election.cc:290] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161)
I20260709 13:05:51.159442 16198 raft_consensus.cc:740] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.160568 16158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.160481 16198 consensus_queue.cc:260] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.161185 16158 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.161571 16200 raft_consensus.cc:359] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.162205 16200 raft_consensus.cc:385] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.162357 15973 leader_election.cc:304] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 
I20260709 13:05:51.162525 16200 raft_consensus.cc:740] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.163232 16198 ts_tablet_manager.cc:1434] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:05:51.164283 16198 tablet_bootstrap.cc:492] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.166864 16208 leader_election.cc:290] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.167392 16208 raft_consensus.cc:2804] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.167707 16208 raft_consensus.cc:493] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.168051 16208 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.170087 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
I20260709 13:05:51.170704 16084 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.163229 16200 consensus_queue.cc:260] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.173693 16198 tablet_bootstrap.cc:654] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.159278 16206 leader_election.cc:290] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.177942 16206 raft_consensus.cc:493] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.178380 16206 raft_consensus.cc:515] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.181224 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
W20260709 13:05:51.182629 15972 leader_election.cc:343] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.184578 16206 leader_election.cc:290] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.193572 16200 ts_tablet_manager.cc:1434] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.016s
I20260709 13:05:51.194715 16200 tablet_bootstrap.cc:492] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.200152 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
I20260709 13:05:51.187211 16208 raft_consensus.cc:515] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.200695 16200 tablet_bootstrap.cc:654] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.200744 16084 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 0.
I20260709 13:05:51.202054 16121 leader_election.cc:304] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.202560 16199 tablet_bootstrap.cc:492] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.202877 16205 raft_consensus.cc:2804] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.202993 16199 ts_tablet_manager.cc:1403] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.088s	user 0.033s	sys 0.035s
I20260709 13:05:51.203243 16205 raft_consensus.cc:493] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.203572 16205 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.203512 16208 leader_election.cc:290] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.205821 16199 raft_consensus.cc:359] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.206499 16199 raft_consensus.cc:385] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.206785 16199 raft_consensus.cc:740] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.207603 16199 consensus_queue.cc:260] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.212723 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:51.213326 16084 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.213335 16208 raft_consensus.cc:493] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.214504 16208 raft_consensus.cc:515] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.213913 16205 raft_consensus.cc:515] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.216684 16208 leader_election.cc:290] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.218111 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ebf0e6e2b46508d208c0b01bffa6b" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
W20260709 13:05:51.219897 15972 leader_election.cc:343] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:51.222824 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:33403, user_credentials={real_user=slave}} blocked reactor thread for 60538us
I20260709 13:05:51.223987 16199 ts_tablet_manager.cc:1434] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.021s	user 0.015s	sys 0.005s
I20260709 13:05:51.224483 16158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.224836 16199 tablet_bootstrap.cc:492] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.225035 16158 raft_consensus.cc:3060] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.227938 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.228556 16157 raft_consensus.cc:2468] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.233155 16158 raft_consensus.cc:2468] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
W20260709 13:05:51.234726 15955 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:51.235951 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.236647 16157 raft_consensus.cc:2393] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d89c51a229c43beaa0b32dc74d4104c in current term 1: Already voted for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in this term.
I20260709 13:05:51.238240 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ebf0e6e2b46508d208c0b01bffa6b" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.239436 16199 tablet_bootstrap.cc:654] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.239488 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c" is_pre_election: true
I20260709 13:05:51.240756 16009 raft_consensus.cc:2393] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d8e6c6722f047e49dd2353eb5a8d544 in current term 1: Already voted for candidate 6d89c51a229c43beaa0b32dc74d4104c in this term.
I20260709 13:05:51.240445 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:51.242302 16008 raft_consensus.cc:2393] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d8e6c6722f047e49dd2353eb5a8d544 in current term 1: Already voted for candidate 6d89c51a229c43beaa0b32dc74d4104c in this term.
I20260709 13:05:51.240484 15973 leader_election.cc:304] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 950d8e29e5164c1bacc44ac5c378638e
W20260709 13:05:51.243680 15973 leader_election.cc:343] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.244973 16222 raft_consensus.cc:2804] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.245370 16222 raft_consensus.cc:493] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.243993 16205 leader_election.cc:290] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 1 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161)
I20260709 13:05:51.244674 15973 leader_election.cc:304] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c; no voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.246783 16208 raft_consensus.cc:2749] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.246969 16200 tablet_bootstrap.cc:492] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.247407 16200 ts_tablet_manager.cc:1403] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.008s
I20260709 13:05:51.247572 16084 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.247984 15973 leader_election.cc:304] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.249408 16208 raft_consensus.cc:2804] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.249559 15972 leader_election.cc:304] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 5d8e6c6722f047e49dd2353eb5a8d544
I20260709 13:05:51.249935 16208 raft_consensus.cc:697] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:51.250921 16223 raft_consensus.cc:2804] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.250741 16208 consensus_queue.cc:237] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.250823 16200 raft_consensus.cc:359] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.251463 16223 raft_consensus.cc:697] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:51.251588 16200 raft_consensus.cc:385] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.251955 16200 raft_consensus.cc:740] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.252365 16223 consensus_queue.cc:237] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.252853 16200 consensus_queue.cc:260] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.245687 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:51.255724 16083 raft_consensus.cc:2393] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d8e6c6722f047e49dd2353eb5a8d544 in current term 1: Already voted for candidate 6d89c51a229c43beaa0b32dc74d4104c in this term.
I20260709 13:05:51.257006 16121 leader_election.cc:304] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544; no voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.257061 16200 ts_tablet_manager.cc:1434] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:51.248710 16222 raft_consensus.cc:3060] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.258884 16205 raft_consensus.cc:2749] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.260658 16200 tablet_bootstrap.cc:492] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.267004 16200 tablet_bootstrap.cc:654] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.266635 16222 raft_consensus.cc:515] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.269424 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:51.269934 16222 leader_election.cc:290] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.270951 16158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
W20260709 13:05:51.271073 15972 leader_election.cc:343] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.271394 16198 tablet_bootstrap.cc:492] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.271513 16158 raft_consensus.cc:3060] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.271821 16198 ts_tablet_manager.cc:1403] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.041s
I20260709 13:05:51.274035 16199 tablet_bootstrap.cc:492] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.274516 16199 ts_tablet_manager.cc:1403] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.016s
I20260709 13:05:51.274513 16198 raft_consensus.cc:359] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.275272 16198 raft_consensus.cc:385] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.275566 16198 raft_consensus.cc:740] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.276347 16198 consensus_queue.cc:260] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.277693 16199 raft_consensus.cc:359] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.278124 16158 raft_consensus.cc:2468] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.278405 16199 raft_consensus.cc:385] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.278831 16199 raft_consensus.cc:740] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.279242 15973 leader_election.cc:304] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.279634 16199 consensus_queue.cc:260] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.283962 16223 raft_consensus.cc:2804] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.284526 16223 raft_consensus.cc:697] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:51.285276 16223 consensus_queue.cc:237] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.285753 16200 tablet_bootstrap.cc:492] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.286175 16200 ts_tablet_manager.cc:1403] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.026s	user 0.001s	sys 0.009s
I20260709 13:05:51.284087 16204 raft_consensus.cc:493] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.287261 16204 raft_consensus.cc:515] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.284015 16199 ts_tablet_manager.cc:1434] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:05:51.291361 16199 tablet_bootstrap.cc:492] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.292575 16200 raft_consensus.cc:359] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.293412 16200 raft_consensus.cc:385] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.293692 16200 raft_consensus.cc:740] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.294634 16204 leader_election.cc:290] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403), 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461)
I20260709 13:05:51.294442 16200 consensus_queue.cc:260] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.295480 16198 ts_tablet_manager.cc:1434] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:05:51.296928 16200 ts_tablet_manager.cc:1434] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:05:51.296696 15905 catalog_manager.cc:5697] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 1 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.297871 16200 tablet_bootstrap.cc:492] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.298470 16199 tablet_bootstrap.cc:654] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.298470 15905 catalog_manager.cc:5697] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 1 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.304244 16200 tablet_bootstrap.cc:654] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.309478 16198 tablet_bootstrap.cc:492] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.322031 16198 tablet_bootstrap.cc:654] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.327589 16198 tablet_bootstrap.cc:492] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.328065 16198 ts_tablet_manager.cc:1403] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.006s
I20260709 13:05:51.330885 16198 raft_consensus.cc:359] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.331578 16198 raft_consensus.cc:385] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.331905 16198 raft_consensus.cc:740] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.333033 16204 raft_consensus.cc:493] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.332665 16198 consensus_queue.cc:260] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.333673 16204 raft_consensus.cc:515] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.335732 16204 leader_election.cc:290] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.352207 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c" is_pre_election: true
I20260709 13:05:51.352928 16008 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 0.
I20260709 13:05:51.353960 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c" is_pre_election: true
I20260709 13:05:51.355702 16048 leader_election.cc:304] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
W20260709 13:05:51.356679 16048 leader_election.cc:343] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.357304 16204 raft_consensus.cc:2804] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.357672 16204 raft_consensus.cc:493] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.358007 16204 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.365404 16204 raft_consensus.cc:515] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.373251 16158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.373435 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.374392 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.375034 16157 raft_consensus.cc:2468] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 0.
W20260709 13:05:51.377460 16048 leader_election.cc:343] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:51.378383 16048 leader_election.cc:343] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.379055 16048 leader_election.cc:304] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:51.380522 15907 catalog_manager.cc:5697] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 1 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.381744 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:51.382362 16009 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.389675 16009 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 1.
I20260709 13:05:51.390794 16048 leader_election.cc:304] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 5d8e6c6722f047e49dd2353eb5a8d544
I20260709 13:05:51.393877 16204 leader_election.cc:290] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Requested vote from peers 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403), 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461)
I20260709 13:05:51.394441 16204 raft_consensus.cc:2804] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.394762 16204 raft_consensus.cc:493] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.395087 16204 raft_consensus.cc:3060] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.399274 16223 raft_consensus.cc:493] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.399744 16223 raft_consensus.cc:515] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.402434 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b3f46b3e54797b1af255e9048a7cb" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
I20260709 13:05:51.403040 16083 raft_consensus.cc:2468] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.404326 15972 leader_election.cc:304] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.405159 16208 raft_consensus.cc:2804] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.405521 16208 raft_consensus.cc:493] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.405838 16208 raft_consensus.cc:3060] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.413425 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b3f46b3e54797b1af255e9048a7cb" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.414045 16157 raft_consensus.cc:2468] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.415347 16223 leader_election.cc:290] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.416661 16208 raft_consensus.cc:515] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.419278 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b3f46b3e54797b1af255e9048a7cb" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:51.419785 16083 raft_consensus.cc:3060] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.425338 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b3f46b3e54797b1af255e9048a7cb" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.425882 16157 raft_consensus.cc:3060] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.434422 16083 raft_consensus.cc:2468] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.435587 15972 leader_election.cc:304] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.436383 16222 raft_consensus.cc:2804] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.436833 16222 raft_consensus.cc:697] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:51.437644 16222 consensus_queue.cc:237] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.442030 16208 leader_election.cc:290] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.449205 16157 raft_consensus.cc:2468] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.450525 16200 tablet_bootstrap.cc:492] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.450955 16200 ts_tablet_manager.cc:1403] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.153s	user 0.048s	sys 0.089s
I20260709 13:05:51.453353 16199 tablet_bootstrap.cc:492] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
W20260709 13:05:51.454761 16048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:45461, user_credentials={real_user=slave}} blocked reactor thread for 64068.2us
I20260709 13:05:51.454041 16239 raft_consensus.cc:2804] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.454732 16200 raft_consensus.cc:359] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.455497 16200 raft_consensus.cc:385] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.455561 16239 raft_consensus.cc:697] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:51.455814 16200 raft_consensus.cc:740] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.455003 16199 ts_tablet_manager.cc:1403] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.164s	user 0.056s	sys 0.090s
I20260709 13:05:51.456489 16200 consensus_queue.cc:260] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.458006 16200 ts_tablet_manager.cc:1434] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:51.458639 16200 tablet_bootstrap.cc:492] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.459178 16199 raft_consensus.cc:359] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.459874 16199 raft_consensus.cc:385] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.460141 16199 raft_consensus.cc:740] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.460825 16199 consensus_queue.cc:260] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.462847 16199 ts_tablet_manager.cc:1434] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:51.463305 16200 tablet_bootstrap.cc:654] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.464906 15905 catalog_manager.cc:5697] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 1 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.466288 16204 raft_consensus.cc:515] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.456471 16239 consensus_queue.cc:237] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.468008 16200 tablet_bootstrap.cc:492] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.468405 16200 ts_tablet_manager.cc:1403] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:51.463729 16199 tablet_bootstrap.cc:492] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.470813 16200 raft_consensus.cc:359] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.471045 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:51.471451 16200 raft_consensus.cc:385] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.472090 16200 raft_consensus.cc:740] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
W20260709 13:05:51.472430 16048 leader_election.cc:343] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.472762 16200 consensus_queue.cc:260] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.474184 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.474699 16157 raft_consensus.cc:3060] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.474763 16200 ts_tablet_manager.cc:1434] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:51.475734 16200 tablet_bootstrap.cc:492] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c: Bootstrap starting.
I20260709 13:05:51.478924 16199 tablet_bootstrap.cc:654] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.473644 16204 leader_election.cc:290] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.481001 16200 tablet_bootstrap.cc:654] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.480922 16157 raft_consensus.cc:2468] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 1.
I20260709 13:05:51.482872 16048 leader_election.cc:304] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:51.483850 16204 raft_consensus.cc:2804] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.484355 16204 raft_consensus.cc:697] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:51.485121 16204 consensus_queue.cc:237] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.491185 15906 catalog_manager.cc:5697] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 0 to 1, leader changed from <none> to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 1 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.495887 16199 tablet_bootstrap.cc:492] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.496382 16199 ts_tablet_manager.cc:1403] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.002s
I20260709 13:05:51.498939 16199 raft_consensus.cc:359] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.499696 16199 raft_consensus.cc:385] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.500056 16199 raft_consensus.cc:740] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.500849 16199 consensus_queue.cc:260] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.504817 16198 ts_tablet_manager.cc:1434] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.176s	user 0.030s	sys 0.055s
I20260709 13:05:51.505755 16198 tablet_bootstrap.cc:492] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.508181 16199 ts_tablet_manager.cc:1434] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:51.509131 16199 tablet_bootstrap.cc:492] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.517469 15907 catalog_manager.cc:5697] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 0 to 1, leader changed from <none> to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 1 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.518760 16199 tablet_bootstrap.cc:654] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.520315 16198 tablet_bootstrap.cc:654] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.524940 16200 tablet_bootstrap.cc:492] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c: No bootstrap required, opened a new log
I20260709 13:05:51.525327 16200 ts_tablet_manager.cc:1403] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.032s
I20260709 13:05:51.526010 16199 tablet_bootstrap.cc:492] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.526392 16199 ts_tablet_manager.cc:1403] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:05:51.526839 16198 tablet_bootstrap.cc:492] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.527315 16198 ts_tablet_manager.cc:1403] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:05:51.527673 16200 raft_consensus.cc:359] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.528340 16200 raft_consensus.cc:385] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.528601 16200 raft_consensus.cc:740] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.528704 16199 raft_consensus.cc:359] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.529297 16199 raft_consensus.cc:385] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.529656 16199 raft_consensus.cc:740] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.529297 16200 consensus_queue.cc:260] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.530237 16199 consensus_queue.cc:260] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.530414 16198 raft_consensus.cc:359] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.531177 16198 raft_consensus.cc:385] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.531507 16200 ts_tablet_manager.cc:1434] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:05:51.532232 16199 ts_tablet_manager.cc:1434] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:05:51.533034 16199 tablet_bootstrap.cc:492] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544: Bootstrap starting.
I20260709 13:05:51.531514 16198 raft_consensus.cc:740] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.533972 16198 consensus_queue.cc:260] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.538563 16198 ts_tablet_manager.cc:1434] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:51.539428 16198 tablet_bootstrap.cc:492] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.545182 16198 tablet_bootstrap.cc:654] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.545490 16199 tablet_bootstrap.cc:654] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.549705 16198 tablet_bootstrap.cc:492] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.549988 16198 ts_tablet_manager.cc:1403] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:51.550354 16199 tablet_bootstrap.cc:492] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544: No bootstrap required, opened a new log
I20260709 13:05:51.550669 16199 ts_tablet_manager.cc:1403] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:05:51.551520 16198 raft_consensus.cc:359] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.551983 16198 raft_consensus.cc:385] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.552171 16198 raft_consensus.cc:740] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.552343 16199 raft_consensus.cc:359] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.552872 16199 raft_consensus.cc:385] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.552652 16198 consensus_queue.cc:260] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.553069 16199 raft_consensus.cc:740] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.554059 16198 ts_tablet_manager.cc:1434] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:05:51.553742 16199 consensus_queue.cc:260] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.554998 16198 tablet_bootstrap.cc:492] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.555562 16199 ts_tablet_manager.cc:1434] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:51.560385 16198 tablet_bootstrap.cc:654] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.564556 16198 tablet_bootstrap.cc:492] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.564908 16198 ts_tablet_manager.cc:1403] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:51.566643 16198 raft_consensus.cc:359] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.567035 16198 raft_consensus.cc:385] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.567229 16198 raft_consensus.cc:740] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.567693 16198 consensus_queue.cc:260] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.569072 16198 ts_tablet_manager.cc:1434] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:51.569670 16198 tablet_bootstrap.cc:492] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e: Bootstrap starting.
I20260709 13:05:51.573361 16198 tablet_bootstrap.cc:654] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.576831 16198 tablet_bootstrap.cc:492] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e: No bootstrap required, opened a new log
I20260709 13:05:51.577106 16198 ts_tablet_manager.cc:1403] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e: Time spent bootstrapping tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:05:51.578992 16198 raft_consensus.cc:359] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.579578 16198 raft_consensus.cc:385] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.579838 16198 raft_consensus.cc:740] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.580439 16198 consensus_queue.cc:260] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.581943 16198 ts_tablet_manager.cc:1434] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:51.592381 16222 raft_consensus.cc:493] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.592731 16222 raft_consensus.cc:515] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.593660 16204 raft_consensus.cc:493] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.594063 16204 raft_consensus.cc:515] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.594341 16222 leader_election.cc:290] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.594990 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
I20260709 13:05:51.595412 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.595916 16204 leader_election.cc:290] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.595501 16083 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.596107 16157 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.597100 15972 leader_election.cc:304] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.597432 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.597844 16222 raft_consensus.cc:2804] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.597908 16157 raft_consensus.cc:2468] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 0.
I20260709 13:05:51.597016 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c" is_pre_election: true
I20260709 13:05:51.598222 16222 raft_consensus.cc:493] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.598749 16222 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.598763 16009 raft_consensus.cc:2468] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 0.
I20260709 13:05:51.598874 16048 leader_election.cc:304] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.599921 16204 raft_consensus.cc:2804] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.600168 16204 raft_consensus.cc:493] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.600406 16204 raft_consensus.cc:3060] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.603770 16222 raft_consensus.cc:515] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.604871 16204 raft_consensus.cc:515] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.605545 16222 leader_election.cc:290] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.606057 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:51.606494 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.606587 16204 leader_election.cc:290] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.606575 16083 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.607080 16157 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.607671 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.607851 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:51.608242 16156 raft_consensus.cc:3060] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.608383 16009 raft_consensus.cc:3060] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.613113 16083 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.613345 16157 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.614307 15972 leader_election.cc:304] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.614646 16009 raft_consensus.cc:2468] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 1.
I20260709 13:05:51.615037 16156 raft_consensus.cc:2468] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 1.
I20260709 13:05:51.615047 16222 raft_consensus.cc:2804] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.615625 16222 raft_consensus.cc:697] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:51.615665 16048 leader_election.cc:304] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.616484 16204 raft_consensus.cc:2804] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.616540 16222 consensus_queue.cc:237] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.616988 16204 raft_consensus.cc:697] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:51.617733 16208 raft_consensus.cc:493] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.617712 16204 consensus_queue.cc:237] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.618254 16208 raft_consensus.cc:515] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.620188 16208 leader_election.cc:290] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.620651 16223 raft_consensus.cc:493] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.620779 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
I20260709 13:05:51.621356 16083 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.621115 16223 raft_consensus.cc:515] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.622469 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.622872 16223 leader_election.cc:290] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.623018 16156 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 0.
I20260709 13:05:51.623708 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e" is_pre_election: true
I20260709 13:05:51.624294 15972 leader_election.cc:304] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.624992 16223 raft_consensus.cc:2804] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.625322 16223 raft_consensus.cc:493] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.625790 16223 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.625223 15907 catalog_manager.cc:5697] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 1 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.625860 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.626623 16156 raft_consensus.cc:2393] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d89c51a229c43beaa0b32dc74d4104c in current term 1: Already voted for candidate 950d8e29e5164c1bacc44ac5c378638e in this term.
I20260709 13:05:51.627676 15973 leader_election.cc:304] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c; no voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.628739 16222 raft_consensus.cc:3060] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.635466 16223 raft_consensus.cc:515] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.635850 16222 raft_consensus.cc:2749] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.638058 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:51.638242 16223 leader_election.cc:290] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.638478 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.638581 16083 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.638931 16156 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.642258 15907 catalog_manager.cc:5697] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 0 to 1, leader changed from <none> to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 1 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.643122 16156 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.644039 16083 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 1.
I20260709 13:05:51.644122 15973 leader_election.cc:304] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 
I20260709 13:05:51.644744 16223 raft_consensus.cc:2804] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.645134 16223 raft_consensus.cc:697] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:51.645757 16223 consensus_queue.cc:237] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.652002 15907 catalog_manager.cc:5697] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 1 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.658165 16223 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.667523 16222 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.679136 16204 raft_consensus.cc:493] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.679540 16204 raft_consensus.cc:515] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.681545 16204 leader_election.cc:290] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.682132 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c" is_pre_election: true
I20260709 13:05:51.682826 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.683461 16156 raft_consensus.cc:2393] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 950d8e29e5164c1bacc44ac5c378638e in current term 1: Already voted for candidate 6d89c51a229c43beaa0b32dc74d4104c in this term.
I20260709 13:05:51.684376 16048 leader_election.cc:304] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 950d8e29e5164c1bacc44ac5c378638e; no voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:51.685010 16204 raft_consensus.cc:3060] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.688997 16239 raft_consensus.cc:493] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.689185 16204 raft_consensus.cc:2749] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.689453 16239 raft_consensus.cc:515] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.690913 16239 leader_election.cc:290] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.691627 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ebf0e6e2b46508d208c0b01bffa6b" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c" is_pre_election: true
I20260709 13:05:51.691674 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ebf0e6e2b46508d208c0b01bffa6b" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" is_pre_election: true
I20260709 13:05:51.692167 16009 raft_consensus.cc:2468] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 0.
I20260709 13:05:51.692242 16156 raft_consensus.cc:2468] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 0.
I20260709 13:05:51.693077 16048 leader_election.cc:304] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.693612 16239 raft_consensus.cc:2804] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.694017 16239 raft_consensus.cc:493] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.694264 16239 raft_consensus.cc:3060] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.698468 16239 raft_consensus.cc:515] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.699927 16239 leader_election.cc:290] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.700416 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ebf0e6e2b46508d208c0b01bffa6b" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:51.700747 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ebf0e6e2b46508d208c0b01bffa6b" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.700982 16009 raft_consensus.cc:3060] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.701318 16156 raft_consensus.cc:3060] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.707017 16009 raft_consensus.cc:2468] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 1.
I20260709 13:05:51.707154 16156 raft_consensus.cc:2468] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 1.
I20260709 13:05:51.708052 16048 leader_election.cc:304] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:51.708653 16239 raft_consensus.cc:2804] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.709133 16239 raft_consensus.cc:697] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:51.709793 16239 consensus_queue.cc:237] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:51.716163 15907 catalog_manager.cc:5697] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 0 to 1, leader changed from <none> to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 1 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.755028 16223 consensus_queue.cc:1048] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.760068 16223 consensus_queue.cc:1048] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.766546 16083 raft_consensus.cc:3060] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.774051 16223 consensus_queue.cc:1048] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.777277 16223 consensus_queue.cc:1048] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.837880 16223 consensus_queue.cc:1048] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.847390 16222 consensus_queue.cc:1048] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.875218 16239 consensus_queue.cc:1048] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.882534 16239 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.890074 16241 consensus_queue.cc:1048] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.894240 16083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
mode: GRACEFUL
new_leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:55394
I20260709 13:05:51.894915 16083 raft_consensus.cc:606] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Received request to transfer leadership to TS 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:51.902549 16204 raft_consensus.cc:993] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e: : Instructing follower 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:51.903098 16204 raft_consensus.cc:1081] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Signalling peer 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:51.905675 16008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:33656
I20260709 13:05:51.906172 16008 raft_consensus.cc:493] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.906517 16008 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.908237 16156 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.913020 16008 raft_consensus.cc:515] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.915938 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:51.916496 16083 raft_consensus.cc:3055] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.916409 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:51.916880 16083 raft_consensus.cc:740] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:51.917028 16157 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.917207 16241 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.918099 16083 consensus_queue.cc:260] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.917639 16008 leader_election.cc:290] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 2 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:51.919258 16083 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.923111 16157 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 2.
I20260709 13:05:51.924227 15973 leader_election.cc:304] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 
I20260709 13:05:51.924994 16222 raft_consensus.cc:2804] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.925434 16222 raft_consensus.cc:697] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:51.925858 16083 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 2.
I20260709 13:05:51.926178 16222 consensus_queue.cc:237] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:51.933130 15906 catalog_manager.cc:5697] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 1 to 2, leader changed from 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2) to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 2 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.937157 16008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:33658
I20260709 13:05:51.937711 16008 raft_consensus.cc:606] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Received request to transfer leadership to TS 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.942541 16008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:33658
I20260709 13:05:51.942945 16008 raft_consensus.cc:606] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Received request to transfer leadership to TS 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:51.949551 16083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
mode: GRACEFUL
new_leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:55394
I20260709 13:05:51.949981 16083 raft_consensus.cc:606] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Received request to transfer leadership to TS 5d8e6c6722f047e49dd2353eb5a8d544
I20260709 13:05:52.065605 16222 consensus_queue.cc:1048] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.075309 16223 consensus_queue.cc:1048] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.083156 16241 consensus_queue.cc:1048] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.083633 16223 raft_consensus.cc:993] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:52.084110 16223 raft_consensus.cc:1081] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Signalling peer 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:52.085639 16083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:55378
I20260709 13:05:52.086423 16083 raft_consensus.cc:493] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.086817 16083 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.094074 16083 raft_consensus.cc:515] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.095404 16204 consensus_queue.cc:1048] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.097344 16083 leader_election.cc:290] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 2 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:52.100570 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:52.101248 16156 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.104650 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:52.105214 16008 raft_consensus.cc:3055] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.106544 16239 raft_consensus.cc:993] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e: : Instructing follower 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:52.107034 16239 raft_consensus.cc:1081] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Signalling peer 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:52.106313 16008 raft_consensus.cc:740] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:52.108671 16008 consensus_queue.cc:260] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.109112 16157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac"
dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:59558
I20260709 13:05:52.109882 16008 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.110020 16157 raft_consensus.cc:493] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.110527 16157 raft_consensus.cc:3060] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.113684 16156 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 2.
I20260709 13:05:52.114812 16048 leader_election.cc:304] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:52.115454 16157 raft_consensus.cc:515] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.115674 16239 raft_consensus.cc:2804] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.116140 16008 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 2.
I20260709 13:05:52.116241 16239 raft_consensus.cc:697] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:52.117097 16239 consensus_queue.cc:237] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.118990 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:52.119182 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99402b2c62e0458e8ae777dcaeb05eac" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:52.119727 16083 raft_consensus.cc:3055] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.119653 16008 raft_consensus.cc:3060] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.120767 16083 raft_consensus.cc:740] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:52.121588 16083 consensus_queue.cc:260] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.122598 16083 raft_consensus.cc:3060] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.126165 15906 catalog_manager.cc:5697] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 1 to 2, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 2 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.127022 16008 raft_consensus.cc:2468] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 2.
I20260709 13:05:52.127683 16083 raft_consensus.cc:2468] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 2.
I20260709 13:05:52.128053 16206 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.128404 16157 leader_election.cc:290] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 2 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161)
I20260709 13:05:52.128108 16122 leader_election.cc:304] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 
I20260709 13:05:52.129225 16205 raft_consensus.cc:2804] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.136554 16206 raft_consensus.cc:993] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:52.137024 16206 raft_consensus.cc:1081] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Signalling peer 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:52.141057 16205 raft_consensus.cc:697] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Becoming Leader. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Running, Role: LEADER
I20260709 13:05:52.141961 16205 consensus_queue.cc:237] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.142892 16084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:55378
I20260709 13:05:52.143450 16084 raft_consensus.cc:493] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.143945 16206 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.147101 16239 consensus_queue.cc:1048] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.143960 16084 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.152386 15907 catalog_manager.cc:5697] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 reported cstate change: term changed from 1 to 2, leader changed from 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2) to 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.158308 16084 raft_consensus.cc:515] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.162348 16084 leader_election.cc:290] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 2 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:52.162693 16239 consensus_queue.cc:1048] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.163757 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:52.163826 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:52.164409 16156 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.164479 16008 raft_consensus.cc:3055] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.170169 16156 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 2.
I20260709 13:05:52.171056 16048 leader_election.cc:304] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:52.172199 16239 raft_consensus.cc:2804] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.172643 16239 raft_consensus.cc:697] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:52.164887 16008 raft_consensus.cc:740] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:52.173408 16239 consensus_queue.cc:237] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.173666 16008 consensus_queue.cc:260] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:52.174782 16008 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.180543 16008 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 2.
I20260709 13:05:52.183820 15906 catalog_manager.cc:5697] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 1 to 2, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 2 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.373520 16156 raft_consensus.cc:1275] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.374708 16223 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.383307 16084 raft_consensus.cc:1275] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.384796 16223 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.525393 16008 raft_consensus.cc:1275] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.526436 16279 consensus_queue.cc:1048] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.532778 16084 raft_consensus.cc:1275] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.534032 16205 consensus_queue.cc:1048] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.569309 16008 raft_consensus.cc:1275] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.570335 16239 consensus_queue.cc:1048] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.576907 16156 raft_consensus.cc:1275] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.578125 16204 consensus_queue.cc:1048] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.659444 16008 raft_consensus.cc:1275] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.660567 16204 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.667258 16156 raft_consensus.cc:1275] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.669054 16241 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:54.977248 15384 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:54.977892 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:54.992268 16009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211f75bcffb945a19722564567feb1b8"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:33660
I20260709 13:05:54.992741 16009 raft_consensus.cc:606] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Received request to transfer leadership to TS 5d8e6c6722f047e49dd2353eb5a8d544
I20260709 13:05:54.994872 16009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:33660
I20260709 13:05:54.995266 16009 raft_consensus.cc:606] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 LEADER]: Received request to transfer leadership to TS 5d8e6c6722f047e49dd2353eb5a8d544
I20260709 13:05:54.996161 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:54.996565 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:55.004671 16223 raft_consensus.cc:993] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:55.005039 16293 raft_consensus.cc:1081] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Signalling peer 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:55.006284 16156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211f75bcffb945a19722564567feb1b8"
dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:59548
I20260709 13:05:55.006699 16156 raft_consensus.cc:493] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.006937 16156 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.011397 16156 raft_consensus.cc:515] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:55.012887 16156 leader_election.cc:290] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 2 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161)
I20260709 13:05:55.013597 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:55.013821 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:55.014124 16009 raft_consensus.cc:3055] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:55.014283 16083 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.014459 16009 raft_consensus.cc:740] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:55.015184 16009 consensus_queue.cc:260] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:55.016075 16009 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.018986 16083 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 2.
I20260709 13:05:55.019944 16121 leader_election.cc:304] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:55.020597 16289 raft_consensus.cc:2804] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:55.020682 16009 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 2.
I20260709 13:05:55.021576 16289 raft_consensus.cc:697] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Becoming Leader. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Running, Role: LEADER
I20260709 13:05:55.022409 16289 consensus_queue.cc:237] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:55.028720 15906 catalog_manager.cc:5697] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 reported cstate change: term changed from 1 to 2, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.063482 16223 raft_consensus.cc:993] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:55.063834 16293 raft_consensus.cc:1081] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 LEADER]: Signalling peer 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:55.064978 16156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e"
dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:59548
I20260709 13:05:55.065358 16156 raft_consensus.cc:493] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.065589 16156 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.069420 16156 raft_consensus.cc:515] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:55.070639 16156 leader_election.cc:290] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 3 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461)
I20260709 13:05:55.071341 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:55.071542 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:55.071780 16083 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.072115 16009 raft_consensus.cc:3055] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:55.072362 16009 raft_consensus.cc:740] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:55.072973 16009 consensus_queue.cc:260] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:55.073771 16009 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.075923 16083 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 3.
I20260709 13:05:55.076704 16121 leader_election.cc:304] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:55.077252 16289 raft_consensus.cc:2804] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:55.077586 16289 raft_consensus.cc:697] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 LEADER]: Becoming Leader. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Running, Role: LEADER
I20260709 13:05:55.077950 16009 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 3.
I20260709 13:05:55.078254 16289 consensus_queue.cc:237] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:55.084540 15906 catalog_manager.cc:5697] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 reported cstate change: term changed from 2 to 3, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.515084 16083 raft_consensus.cc:1275] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.516227 16289 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:55.524580 16009 raft_consensus.cc:1275] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.526219 16289 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:55.571411 16083 raft_consensus.cc:1275] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.572404 16303 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:55.579504 16009 raft_consensus.cc:1275] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:55.581172 16294 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:55.997215 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:56.018132 16156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e"
dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
mode: GRACEFUL
new_leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:59562
I20260709 13:05:56.018590 16156 raft_consensus.cc:606] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 LEADER]: Received request to transfer leadership to TS 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:56.022802 16156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211f75bcffb945a19722564567feb1b8"
dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
mode: GRACEFUL
new_leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:59562
I20260709 13:05:56.023207 16156 raft_consensus.cc:606] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Received request to transfer leadership to TS 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:56.034066 16083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
mode: GRACEFUL
new_leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:55394
I20260709 13:05:56.034461 16083 raft_consensus.cc:606] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Received request to transfer leadership to TS 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:56.038313 16083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
mode: GRACEFUL
new_leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:55394
I20260709 13:05:56.038677 16083 raft_consensus.cc:606] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Received request to transfer leadership to TS 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:56.042681 16083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
mode: GRACEFUL
new_leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:55394
I20260709 13:05:56.043066 16083 raft_consensus.cc:606] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Received request to transfer leadership to TS 6d89c51a229c43beaa0b32dc74d4104c
I20260709 13:05:56.065315 16303 raft_consensus.cc:993] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544: : Instructing follower 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.065680 16294 raft_consensus.cc:1081] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 LEADER]: Signalling peer 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.066924 16009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:33654
I20260709 13:05:56.067327 16009 raft_consensus.cc:493] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.067626 16009 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.072019 16009 raft_consensus.cc:515] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:56.073451 16009 leader_election.cc:290] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 4 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:56.074179 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:56.074363 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb18534b4c411e9e11c7f6c369ea9e" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:56.074623 16083 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.074802 16156 raft_consensus.cc:3055] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.075079 16156 raft_consensus.cc:740] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Running, Role: LEADER
I20260709 13:05:56.075608 16156 consensus_queue.cc:260] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:56.076385 16156 raft_consensus.cc:3060] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.078903 16083 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 4.
I20260709 13:05:56.079844 15972 leader_election.cc:304] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:56.080082 16156 raft_consensus.cc:2468] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 4.
I20260709 13:05:56.080647 16293 raft_consensus.cc:2804] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.081647 16293 raft_consensus.cc:697] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 4 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:56.082337 16293 consensus_queue.cc:237] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } }
I20260709 13:05:56.087304 15907 catalog_manager.cc:5697] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 3 to 4, leader changed from 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3) to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 4 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.224236 16204 raft_consensus.cc:993] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e: : Instructing follower 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.224630 16316 raft_consensus.cc:1081] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Signalling peer 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.225943 16009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:33656
I20260709 13:05:56.226363 16009 raft_consensus.cc:493] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.226608 16009 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.230798 16009 raft_consensus.cc:515] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.232228 16009 leader_election.cc:290] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 3 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:56.232913 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:56.233273 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab2c8d23eb2404794f71a969e073d65" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:56.233451 16083 raft_consensus.cc:3055] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.233734 16083 raft_consensus.cc:740] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:56.233801 16156 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.234514 16083 consensus_queue.cc:260] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.235590 16083 raft_consensus.cc:3060] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.239568 16156 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 3.
I20260709 13:05:56.240471 15973 leader_election.cc:304] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 
I20260709 13:05:56.241061 16293 raft_consensus.cc:2804] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.241061 16083 raft_consensus.cc:2468] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 3.
I20260709 13:05:56.241678 16293 raft_consensus.cc:697] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:56.242448 16293 consensus_queue.cc:237] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.249248 15907 catalog_manager.cc:5697] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 2 to 3, leader changed from 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2) to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 3 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.346339 16204 raft_consensus.cc:993] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e: : Instructing follower 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.346728 16316 raft_consensus.cc:1081] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Signalling peer 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.347976 16009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:33656
I20260709 13:05:56.348436 16009 raft_consensus.cc:493] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.348724 16009 raft_consensus.cc:3060] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.352869 16009 raft_consensus.cc:515] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.354364 16009 leader_election.cc:290] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 2 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:56.354979 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:56.355290 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17686ae0ed14dc5abea4e05b80f84cf" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:56.355455 16083 raft_consensus.cc:3055] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.355723 16083 raft_consensus.cc:740] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:56.355756 16156 raft_consensus.cc:3060] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.356354 16083 consensus_queue.cc:260] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.357108 16083 raft_consensus.cc:3060] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.359714 16156 raft_consensus.cc:2468] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 2.
I20260709 13:05:56.360576 15973 leader_election.cc:304] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 
I20260709 13:05:56.361115 16083 raft_consensus.cc:2468] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 2.
I20260709 13:05:56.361299 16293 raft_consensus.cc:2804] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.361917 16293 raft_consensus.cc:697] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 2 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:56.362586 16293 consensus_queue.cc:237] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.368745 15907 catalog_manager.cc:5697] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 1 to 2, leader changed from 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2) to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 2 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.550624 16303 raft_consensus.cc:993] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544: : Instructing follower 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.550985 16294 raft_consensus.cc:1081] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Signalling peer 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.552198 16009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211f75bcffb945a19722564567feb1b8"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:33654
I20260709 13:05:56.552592 16009 raft_consensus.cc:493] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.552826 16009 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.556900 16009 raft_consensus.cc:515] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.558265 16009 leader_election.cc:290] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 3 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:56.558946 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:56.559185 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:56.559526 16083 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.559648 16156 raft_consensus.cc:3055] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.559996 16156 raft_consensus.cc:740] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Running, Role: LEADER
I20260709 13:05:56.560653 16156 consensus_queue.cc:260] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.561666 16156 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.565030 16083 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 3.
I20260709 13:05:56.565904 15972 leader_election.cc:304] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d89c51a229c43beaa0b32dc74d4104c, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:56.566576 16293 raft_consensus.cc:2804] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.566920 16293 raft_consensus.cc:697] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:56.567036 16156 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 3.
I20260709 13:05:56.567631 16293 consensus_queue.cc:237] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.573671 15907 catalog_manager.cc:5697] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 2 to 3, leader changed from 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3) to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 3 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.605918 16204 raft_consensus.cc:993] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e: : Instructing follower 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.606254 16316 raft_consensus.cc:1081] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Signalling peer 6d89c51a229c43beaa0b32dc74d4104c to start an election
I20260709 13:05:56.607429 16009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
 from {username='slave'} at 127.0.0.1:33656
I20260709 13:05:56.607833 16009 raft_consensus.cc:493] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.608083 16009 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.612113 16009 raft_consensus.cc:515] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.613476 16009 leader_election.cc:290] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 3 election: Requested vote from peers 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:56.614105 16083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:56.614323 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "6d89c51a229c43beaa0b32dc74d4104c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:56.614506 16083 raft_consensus.cc:3055] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:56.614737 16083 raft_consensus.cc:740] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:56.614780 16156 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.615255 16083 consensus_queue.cc:260] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.616003 16083 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.618508 16156 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 3.
I20260709 13:05:56.619261 15973 leader_election.cc:304] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 6d89c51a229c43beaa0b32dc74d4104c; no voters: 
I20260709 13:05:56.619560 16083 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d89c51a229c43beaa0b32dc74d4104c in term 3.
I20260709 13:05:56.619947 16293 raft_consensus.cc:2804] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.620404 16293 raft_consensus.cc:697] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Becoming Leader. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:56.621054 16293 consensus_queue.cc:237] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:56.626791 15907 catalog_manager.cc:5697] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c reported cstate change: term changed from 2 to 3, leader changed from 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2) to 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1). New cstate: current_term: 3 leader_uuid: "6d89c51a229c43beaa0b32dc74d4104c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.630541 16083 raft_consensus.cc:1275] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:56.631552 16293 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.641798 16156 raft_consensus.cc:1275] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:56.643185 16323 consensus_queue.cc:1048] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.711316 16156 raft_consensus.cc:1275] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.712390 16323 consensus_queue.cc:1048] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.719509 16083 raft_consensus.cc:1275] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.720920 16323 consensus_queue.cc:1048] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.807698 16156 raft_consensus.cc:1275] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.808749 16293 consensus_queue.cc:1048] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.816493 16083 raft_consensus.cc:1275] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.817977 16311 consensus_queue.cc:1048] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.947677 16083 raft_consensus.cc:1275] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.948774 16311 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.956310 16156 raft_consensus.cc:1275] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:56.958480 16293 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.153108 16156 raft_consensus.cc:1275] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.154172 16293 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:57.161782 16083 raft_consensus.cc:1275] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Refusing update from remote peer 6d89c51a229c43beaa0b32dc74d4104c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:57.163442 16323 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.048849 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.055915 16009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:33660
I20260709 13:05:59.056476 16009 raft_consensus.cc:606] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Received request to transfer leadership to TS 5d8e6c6722f047e49dd2353eb5a8d544
I20260709 13:05:59.058867 16009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211f75bcffb945a19722564567feb1b8"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:33660
I20260709 13:05:59.059229 16009 raft_consensus.cc:606] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Received request to transfer leadership to TS 5d8e6c6722f047e49dd2353eb5a8d544
I20260709 13:05:59.061209 16009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:33660
I20260709 13:05:59.061559 16009 raft_consensus.cc:606] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Received request to transfer leadership to TS 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:59.063360 16009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18"
dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
mode: GRACEFUL
new_leader_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:33660
I20260709 13:05:59.063720 16009 raft_consensus.cc:606] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Received request to transfer leadership to TS 950d8e29e5164c1bacc44ac5c378638e
I20260709 13:05:59.064550 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:59.064951 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:59.135594 16337 raft_consensus.cc:993] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:59.136129 16337 raft_consensus.cc:1081] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Signalling peer 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:59.137766 16084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:55378
I20260709 13:05:59.138222 16084 raft_consensus.cc:493] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.138526 16084 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.143779 16084 raft_consensus.cc:515] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.145323 16084 leader_election.cc:290] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 4 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:59.146422 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:59.146428 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a345b6da844241b793ecd71ed0e5af9c" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:59.147037 16156 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.147146 16009 raft_consensus.cc:3055] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:59.147441 16009 raft_consensus.cc:740] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:59.148276 16009 consensus_queue.cc:260] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.149194 16009 raft_consensus.cc:3060] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.151469 16156 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 4.
I20260709 13:05:59.152462 16048 leader_election.cc:304] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:59.153213 16316 raft_consensus.cc:2804] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.153612 16009 raft_consensus.cc:2468] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 4.
I20260709 13:05:59.154212 16316 raft_consensus.cc:697] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 4 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:59.155339 16316 consensus_queue.cc:237] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.161808 15907 catalog_manager.cc:5697] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 3 to 4, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 4 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.247639 16330 raft_consensus.cc:993] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:59.248150 16330 raft_consensus.cc:1081] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Signalling peer 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:59.249603 16156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0"
dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:59548
I20260709 13:05:59.249979 16156 raft_consensus.cc:493] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.250226 16156 raft_consensus.cc:3060] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.254172 16156 raft_consensus.cc:515] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.255486 16156 leader_election.cc:290] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 2 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161)
I20260709 13:05:59.256374 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:59.256476 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f8695c04ae45cc9391988c92faa5a0" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:59.256780 16009 raft_consensus.cc:3055] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.257015 16084 raft_consensus.cc:3060] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.257076 16009 raft_consensus.cc:740] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:59.257858 16009 consensus_queue.cc:260] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.258842 16009 raft_consensus.cc:3060] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.261968 16084 raft_consensus.cc:2468] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 2.
I20260709 13:05:59.262970 16009 raft_consensus.cc:2468] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 2.
I20260709 13:05:59.263021 16121 leader_election.cc:304] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:59.263962 16294 raft_consensus.cc:2804] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.264849 16294 raft_consensus.cc:697] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Becoming Leader. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Running, Role: LEADER
I20260709 13:05:59.265488 16294 consensus_queue.cc:237] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.271442 15907 catalog_manager.cc:5697] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 reported cstate change: term changed from 1 to 2, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.372422 16337 raft_consensus.cc:993] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:59.372869 16330 raft_consensus.cc:1081] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Signalling peer 5d8e6c6722f047e49dd2353eb5a8d544 to start an election
I20260709 13:05:59.374121 16156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211f75bcffb945a19722564567feb1b8"
dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
 from {username='slave'} at 127.0.0.1:59548
I20260709 13:05:59.374492 16156 raft_consensus.cc:493] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.374743 16156 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.378566 16156 raft_consensus.cc:515] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.379842 16156 leader_election.cc:290] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 4 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161)
I20260709 13:05:59.380535 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:59.380725 16084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211f75bcffb945a19722564567feb1b8" candidate_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
I20260709 13:05:59.381028 16009 raft_consensus.cc:3055] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:59.381282 16084 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.381415 16009 raft_consensus.cc:740] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:59.382108 16009 consensus_queue.cc:260] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.382863 16009 raft_consensus.cc:3060] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.385510 16084 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 4.
I20260709 13:05:59.386330 16121 leader_election.cc:304] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:59.386620 16009 raft_consensus.cc:2468] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d8e6c6722f047e49dd2353eb5a8d544 in term 4.
I20260709 13:05:59.386963 16294 raft_consensus.cc:2804] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.387395 16294 raft_consensus.cc:697] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 LEADER]: Becoming Leader. State: Replica: 5d8e6c6722f047e49dd2353eb5a8d544, State: Running, Role: LEADER
I20260709 13:05:59.388155 16294 consensus_queue.cc:237] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.393810 15907 catalog_manager.cc:5697] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 reported cstate change: term changed from 3 to 4, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.445747 16337 raft_consensus.cc:993] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c: : Instructing follower 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:59.446120 16330 raft_consensus.cc:1081] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Signalling peer 950d8e29e5164c1bacc44ac5c378638e to start an election
I20260709 13:05:59.447263 16084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18"
dest_uuid: "950d8e29e5164c1bacc44ac5c378638e"
 from {username='slave'} at 127.0.0.1:55378
I20260709 13:05:59.447698 16084 raft_consensus.cc:493] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.447988 16084 raft_consensus.cc:3060] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.452219 16084 raft_consensus.cc:515] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.453958 16084 leader_election.cc:290] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 2 election: Requested vote from peers 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461), 5d8e6c6722f047e49dd2353eb5a8d544 (127.15.6.3:33403)
I20260709 13:05:59.454527 16009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d89c51a229c43beaa0b32dc74d4104c"
I20260709 13:05:59.454875 16156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc42fc7362a4e9e9597859f15d2bb18" candidate_uuid: "950d8e29e5164c1bacc44ac5c378638e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d8e6c6722f047e49dd2353eb5a8d544"
I20260709 13:05:59.455062 16009 raft_consensus.cc:3055] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.455312 16156 raft_consensus.cc:3060] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.455332 16009 raft_consensus.cc:740] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d89c51a229c43beaa0b32dc74d4104c, State: Running, Role: LEADER
I20260709 13:05:59.456069 16009 consensus_queue.cc:260] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.456822 16009 raft_consensus.cc:3060] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.459234 16156 raft_consensus.cc:2468] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 2.
I20260709 13:05:59.460000 16048 leader_election.cc:304] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d8e6c6722f047e49dd2353eb5a8d544, 950d8e29e5164c1bacc44ac5c378638e; no voters: 
I20260709 13:05:59.460577 16316 raft_consensus.cc:2804] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.460656 16009 raft_consensus.cc:2468] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 950d8e29e5164c1bacc44ac5c378638e in term 2.
I20260709 13:05:59.460942 16316 raft_consensus.cc:697] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Becoming Leader. State: Replica: 950d8e29e5164c1bacc44ac5c378638e, State: Running, Role: LEADER
I20260709 13:05:59.461836 16316 consensus_queue.cc:237] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } }
I20260709 13:05:59.468423 15907 catalog_manager.cc:5697] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e reported cstate change: term changed from 1 to 2, leader changed from 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1) to 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2). New cstate: current_term: 2 leader_uuid: "950d8e29e5164c1bacc44ac5c378638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.670548 16156 raft_consensus.cc:1275] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:59.671664 16316 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:59.680899 16009 raft_consensus.cc:1275] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:59.682776 16316 consensus_queue.cc:1048] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:59.728248 16009 raft_consensus.cc:1275] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.729277 16294 consensus_queue.cc:1048] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.737447 16084 raft_consensus.cc:1275] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.739012 16355 consensus_queue.cc:1048] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:59.866470 16084 raft_consensus.cc:1275] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:59.867380 16009 raft_consensus.cc:1275] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Refusing update from remote peer 5d8e6c6722f047e49dd2353eb5a8d544: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:59.867655 16294 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "950d8e29e5164c1bacc44ac5c378638e" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:59.868414 16355 consensus_queue.cc:1048] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:59.928149 16156 raft_consensus.cc:1275] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.929206 16316 consensus_queue.cc:1048] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8e6c6722f047e49dd2353eb5a8d544" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.936986 16009 raft_consensus.cc:1275] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Refusing update from remote peer 950d8e29e5164c1bacc44ac5c378638e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.938136 16316 consensus_queue.cc:1048] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d89c51a229c43beaa0b32dc74d4104c" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 45461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.065753 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.071565 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
I20260709 13:06:00.087925 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.088614 15384 tablet_replica.cc:333] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.089156 15384 raft_consensus.cc:2243] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.089895 15384 raft_consensus.cc:2272] T 4ab2c8d23eb2404794f71a969e073d65 P 6d89c51a229c43beaa0b32dc74d4104c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.091615 15384 tablet_replica.cc:333] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.092099 15384 raft_consensus.cc:2243] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.092468 15384 raft_consensus.cc:2272] T 99402b2c62e0458e8ae777dcaeb05eac P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.094059 15384 tablet_replica.cc:333] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.094519 15384 raft_consensus.cc:2243] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.095175 15384 raft_consensus.cc:2272] T bb1b3f46b3e54797b1af255e9048a7cb P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.096683 15384 tablet_replica.cc:333] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.097142 15384 raft_consensus.cc:2243] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.097795 15384 raft_consensus.cc:2272] T bddb18534b4c411e9e11c7f6c369ea9e P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.099354 15384 tablet_replica.cc:333] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.099812 15384 raft_consensus.cc:2243] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.100462 15384 raft_consensus.cc:2272] T d17686ae0ed14dc5abea4e05b80f84cf P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.101936 15384 tablet_replica.cc:333] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.102401 15384 raft_consensus.cc:2243] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.102762 15384 raft_consensus.cc:2272] T 15f8695c04ae45cc9391988c92faa5a0 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.104590 15384 tablet_replica.cc:333] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.105014 15384 raft_consensus.cc:2243] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.105358 15384 raft_consensus.cc:2272] T 211f75bcffb945a19722564567feb1b8 P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.107185 15384 tablet_replica.cc:333] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.107595 15384 raft_consensus.cc:2243] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.107949 15384 raft_consensus.cc:2272] T a345b6da844241b793ecd71ed0e5af9c P 6d89c51a229c43beaa0b32dc74d4104c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.109742 15384 tablet_replica.cc:333] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.110167 15384 raft_consensus.cc:2243] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.110520 15384 raft_consensus.cc:2272] T b80ebf0e6e2b46508d208c0b01bffa6b P 6d89c51a229c43beaa0b32dc74d4104c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.112088 15384 tablet_replica.cc:333] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c: stopping tablet replica
I20260709 13:06:00.112470 15384 raft_consensus.cc:2243] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.112807 15384 raft_consensus.cc:2272] T ffc42fc7362a4e9e9597859f15d2bb18 P 6d89c51a229c43beaa0b32dc74d4104c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.130043 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
W20260709 13:06:00.138291 16122 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:45461: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 13:06:00.141753 16122 consensus_peers.cc:597] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 -> Peer 6d89c51a229c43beaa0b32dc74d4104c (127.15.6.1:45461): Couldn't send request to peer 6d89c51a229c43beaa0b32dc74d4104c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:45461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.148972 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
I20260709 13:06:00.170617 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.171248 15384 tablet_replica.cc:333] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.171866 15384 raft_consensus.cc:2243] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.172307 15384 raft_consensus.cc:2272] T 4ab2c8d23eb2404794f71a969e073d65 P 950d8e29e5164c1bacc44ac5c378638e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.174067 15384 tablet_replica.cc:333] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.174528 15384 raft_consensus.cc:2243] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.175220 15384 raft_consensus.cc:2272] T b80ebf0e6e2b46508d208c0b01bffa6b P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.176795 15384 tablet_replica.cc:333] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.177280 15384 raft_consensus.cc:2243] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.177955 15384 raft_consensus.cc:2272] T ffc42fc7362a4e9e9597859f15d2bb18 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.180171 15384 tablet_replica.cc:333] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.180655 15384 raft_consensus.cc:2243] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.181111 15384 raft_consensus.cc:2272] T bb1b3f46b3e54797b1af255e9048a7cb P 950d8e29e5164c1bacc44ac5c378638e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.182749 15384 tablet_replica.cc:333] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.183190 15384 raft_consensus.cc:2243] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.183539 15384 raft_consensus.cc:2272] T 15f8695c04ae45cc9391988c92faa5a0 P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.185446 15384 tablet_replica.cc:333] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.185884 15384 raft_consensus.cc:2243] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.186261 15384 raft_consensus.cc:2272] T 211f75bcffb945a19722564567feb1b8 P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.188158 15384 tablet_replica.cc:333] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.188588 15384 raft_consensus.cc:2243] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.188987 15384 raft_consensus.cc:2272] T d17686ae0ed14dc5abea4e05b80f84cf P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.190411 15384 tablet_replica.cc:333] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.190811 15384 raft_consensus.cc:2243] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.191174 15384 raft_consensus.cc:2272] T 99402b2c62e0458e8ae777dcaeb05eac P 950d8e29e5164c1bacc44ac5c378638e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.192719 15384 tablet_replica.cc:333] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.193135 15384 raft_consensus.cc:2243] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.193758 15384 raft_consensus.cc:2272] T a345b6da844241b793ecd71ed0e5af9c P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.195693 15384 tablet_replica.cc:333] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e: stopping tablet replica
I20260709 13:06:00.196213 15384 raft_consensus.cc:2243] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.196707 15384 raft_consensus.cc:2272] T bddb18534b4c411e9e11c7f6c369ea9e P 950d8e29e5164c1bacc44ac5c378638e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.214504 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
I20260709 13:06:00.232091 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
I20260709 13:06:00.251118 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:00.251729 15384 tablet_replica.cc:333] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.252359 15384 raft_consensus.cc:2243] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.252807 15384 raft_consensus.cc:2272] T 4ab2c8d23eb2404794f71a969e073d65 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.254503 15384 tablet_replica.cc:333] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.254964 15384 raft_consensus.cc:2243] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.255330 15384 raft_consensus.cc:2272] T bddb18534b4c411e9e11c7f6c369ea9e P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.257035 15384 tablet_replica.cc:333] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.257506 15384 raft_consensus.cc:2243] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.257880 15384 raft_consensus.cc:2272] T bb1b3f46b3e54797b1af255e9048a7cb P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.260017 15384 tablet_replica.cc:333] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.260577 15384 raft_consensus.cc:2243] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:06:00.261269 16121 consensus_peers.cc:597] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 -> Peer 950d8e29e5164c1bacc44ac5c378638e (127.15.6.2:41161): Couldn't send request to peer 950d8e29e5164c1bacc44ac5c378638e. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:41161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.261456 15384 raft_consensus.cc:2272] T 99402b2c62e0458e8ae777dcaeb05eac P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.263005 15384 tablet_replica.cc:333] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.263445 15384 raft_consensus.cc:2243] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.264076 15384 raft_consensus.cc:2272] T 211f75bcffb945a19722564567feb1b8 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.266002 15384 tablet_replica.cc:333] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.266424 15384 raft_consensus.cc:2243] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.267030 15384 raft_consensus.cc:2272] T 15f8695c04ae45cc9391988c92faa5a0 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.268657 15384 tablet_replica.cc:333] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.269100 15384 raft_consensus.cc:2243] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.269434 15384 raft_consensus.cc:2272] T d17686ae0ed14dc5abea4e05b80f84cf P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.270828 15384 tablet_replica.cc:333] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.271231 15384 raft_consensus.cc:2243] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.271566 15384 raft_consensus.cc:2272] T b80ebf0e6e2b46508d208c0b01bffa6b P 5d8e6c6722f047e49dd2353eb5a8d544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.273010 15384 tablet_replica.cc:333] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.273407 15384 raft_consensus.cc:2243] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.273737 15384 raft_consensus.cc:2272] T ffc42fc7362a4e9e9597859f15d2bb18 P 5d8e6c6722f047e49dd2353eb5a8d544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.275401 15384 tablet_replica.cc:333] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544: stopping tablet replica
I20260709 13:06:00.275784 15384 raft_consensus.cc:2243] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:00.276181 15384 raft_consensus.cc:2272] T a345b6da844241b793ecd71ed0e5af9c P 5d8e6c6722f047e49dd2353eb5a8d544 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.301821 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
I20260709 13:06:00.317715 15384 master.cc:562] Master@127.15.6.62:39633 shutting down...
I20260709 13:06:00.338008 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:00.338461 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:00.338917 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P da0cdde971e04da791eb74253661b3c4: stopping tablet replica
I20260709 13:06:00.357255 15384 master.cc:584] Master@127.15.6.62:39633 shutdown complete.
5d8e6c6722f047e49dd2353eb5a8d544  1
6d89c51a229c43beaa0b32dc74d4104c  5
950d8e29e5164c1bacc44ac5c378638e  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10267 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:06:00.391297 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:43625
I20260709 13:06:00.392371 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:00.397403 16365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.397442 16364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.397840 16367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.399642 15384 server_base.cc:1061] running on GCE node
I20260709 13:06:00.400362 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:00.400549 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:00.400695 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602360400678 us; error 0 us; skew 500 ppm
I20260709 13:06:00.401201 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:00.403326 15384 webserver.cc:533] Webserver started at http://127.15.6.62:36053/ using document root <none> and password file <none>
I20260709 13:06:00.403761 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:00.403980 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:00.404238 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:00.405242 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "424acc41090849a586f609f5c6254e5b"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.409137 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:06:00.412217 16372 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.412814 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:00.413066 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "424acc41090849a586f609f5c6254e5b"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.413300 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:00.431102 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:00.432202 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:00.466741 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:43625
I20260709 13:06:00.466843 16423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:43625 every 8 connection(s)
I20260709 13:06:00.470219 16424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.479096 16424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Bootstrap starting.
I20260709 13:06:00.483264 16424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.486860 16424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: No bootstrap required, opened a new log
I20260709 13:06:00.488699 16424 raft_consensus.cc:359] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "424acc41090849a586f609f5c6254e5b" member_type: VOTER }
I20260709 13:06:00.489028 16424 raft_consensus.cc:385] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.489199 16424 raft_consensus.cc:740] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 424acc41090849a586f609f5c6254e5b, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.489683 16424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "424acc41090849a586f609f5c6254e5b" member_type: VOTER }
I20260709 13:06:00.490073 16424 raft_consensus.cc:399] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:00.490257 16424 raft_consensus.cc:493] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:00.490450 16424 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.493970 16424 raft_consensus.cc:515] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "424acc41090849a586f609f5c6254e5b" member_type: VOTER }
I20260709 13:06:00.494385 16424 leader_election.cc:304] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 424acc41090849a586f609f5c6254e5b; no voters: 
I20260709 13:06:00.495283 16424 leader_election.cc:290] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:00.495545 16427 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.496788 16427 raft_consensus.cc:697] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 1 LEADER]: Becoming Leader. State: Replica: 424acc41090849a586f609f5c6254e5b, State: Running, Role: LEADER
I20260709 13:06:00.497397 16427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "424acc41090849a586f609f5c6254e5b" member_type: VOTER }
I20260709 13:06:00.497892 16424 sys_catalog.cc:565] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:00.502002 16429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 424acc41090849a586f609f5c6254e5b. Latest consensus state: current_term: 1 leader_uuid: "424acc41090849a586f609f5c6254e5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "424acc41090849a586f609f5c6254e5b" member_type: VOTER } }
I20260709 13:06:00.502542 16429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:00.503517 16428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "424acc41090849a586f609f5c6254e5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "424acc41090849a586f609f5c6254e5b" member_type: VOTER } }
I20260709 13:06:00.504056 16428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:00.509406 16435 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:00.513927 16435 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:00.515865 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:00.521644 16435 catalog_manager.cc:1383] Generated new cluster ID: ebb90c91095341ee8dcd4dfc757b63b4
I20260709 13:06:00.521888 16435 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:00.541841 16435 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:00.543344 16435 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:00.557902 16435 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Generated new TSK 0
I20260709 13:06:00.558493 16435 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:00.582823 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:00.588902 16445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.590044 16446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.591660 16448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.592049 15384 server_base.cc:1061] running on GCE node
I20260709 13:06:00.592777 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:00.592958 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:00.593115 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602360593098 us; error 0 us; skew 500 ppm
I20260709 13:06:00.593606 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:00.595687 15384 webserver.cc:533] Webserver started at http://127.15.6.1:42407/ using document root <none> and password file <none>
I20260709 13:06:00.596153 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:00.596334 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:00.596580 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:00.597545 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "359213375db14f3d874c121993f90d76"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.601789 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:06:00.604648 16453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.605280 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:00.605531 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "359213375db14f3d874c121993f90d76"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.605786 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:00.627182 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:00.628365 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:00.629726 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:00.631899 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:00.632083 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.632300 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:00.632458 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.669225 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:42809
I20260709 13:06:00.669315 16515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:42809 every 8 connection(s)
I20260709 13:06:00.673568 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:00.680207 16520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.681499 16521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.683581 15384 server_base.cc:1061] running on GCE node
W20260709 13:06:00.683821 16523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.684839 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:00.685128 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:00.685345 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602360685326 us; error 0 us; skew 500 ppm
I20260709 13:06:00.685923 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:00.686532 16516 heartbeater.cc:344] Connected to a master server at 127.15.6.62:43625
I20260709 13:06:00.686901 16516 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:00.687592 16516 heartbeater.cc:507] Master 127.15.6.62:43625 requested a full tablet report, sending...
I20260709 13:06:00.688148 15384 webserver.cc:533] Webserver started at http://127.15.6.2:44985/ using document root <none> and password file <none>
I20260709 13:06:00.688601 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:00.688774 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:00.688997 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:00.689533 16389 ts_manager.cc:194] Registered new tserver with Master: 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:00.690075 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "035eaa2f12374a81a4df7868a5453d3c"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.691131 16389 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52646
I20260709 13:06:00.694185 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:06:00.697124 16528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.697746 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:06:00.697986 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "035eaa2f12374a81a4df7868a5453d3c"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.698248 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:00.710368 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:00.711488 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:00.712827 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:00.714787 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:00.714979 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.715196 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:00.715377 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.750510 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:34831
I20260709 13:06:00.750607 16590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:34831 every 8 connection(s)
I20260709 13:06:00.754701 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:00.760535 16594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.761791 16595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:00.764420 16597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:00.764957 15384 server_base.cc:1061] running on GCE node
I20260709 13:06:00.765007 16591 heartbeater.cc:344] Connected to a master server at 127.15.6.62:43625
I20260709 13:06:00.765453 16591 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:00.765779 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:00.765990 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:00.766141 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602360766126 us; error 0 us; skew 500 ppm
I20260709 13:06:00.766100 16591 heartbeater.cc:507] Master 127.15.6.62:43625 requested a full tablet report, sending...
I20260709 13:06:00.766772 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:00.768385 16389 ts_manager.cc:194] Registered new tserver with Master: 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:00.769227 15384 webserver.cc:533] Webserver started at http://127.15.6.3:44051/ using document root <none> and password file <none>
I20260709 13:06:00.769817 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:00.770032 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:00.770061 16389 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52648
I20260709 13:06:00.770454 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:00.771880 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "f842280ae2ac4c68b0b7f6c093e27357"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.775955 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:06:00.778797 16602 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.779433 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:00.779706 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "f842280ae2ac4c68b0b7f6c093e27357"
format_stamp: "Formatted at 2026-07-09 13:06:00 on dist-test-slave-pqzm"
I20260709 13:06:00.779983 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:00.787397 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:00.788489 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:00.789749 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:00.791678 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:00.791878 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.792088 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:00.792227 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:00.828039 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:45431
I20260709 13:06:00.828141 16664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:45431 every 8 connection(s)
I20260709 13:06:00.840060 16665 heartbeater.cc:344] Connected to a master server at 127.15.6.62:43625
I20260709 13:06:00.840382 16665 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:00.841032 16665 heartbeater.cc:507] Master 127.15.6.62:43625 requested a full tablet report, sending...
I20260709 13:06:00.842900 16389 ts_manager.cc:194] Registered new tserver with Master: f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:00.843024 15384 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012166191s
I20260709 13:06:00.844612 16389 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52658
I20260709 13:06:00.865644 16389 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52664:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:00.871289 16389 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:01.051360 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 04f67e2620d84985a37dbf9b77909370 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:01.051986 16555 tablet_service.cc:1511] Processing CreateTablet for tablet b9de9d7206ba42568149f95eb24f22ef (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:01.052790 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f67e2620d84985a37dbf9b77909370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.053329 16555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9de9d7206ba42568149f95eb24f22ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.055464 16554 tablet_service.cc:1511] Processing CreateTablet for tablet 318a7033cb194c3f8c635e0e36d5dc53 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:01.056731 16554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318a7033cb194c3f8c635e0e36d5dc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.056457 16481 tablet_service.cc:1511] Processing CreateTablet for tablet 04f67e2620d84985a37dbf9b77909370 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:01.057677 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f67e2620d84985a37dbf9b77909370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.059290 16553 tablet_service.cc:1511] Processing CreateTablet for tablet 441a1d437e7b4eff9f56f88ce7d935e5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:01.060581 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441a1d437e7b4eff9f56f88ce7d935e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.062922 16480 tablet_service.cc:1511] Processing CreateTablet for tablet b9de9d7206ba42568149f95eb24f22ef (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:01.064062 16480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9de9d7206ba42568149f95eb24f22ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.067332 16552 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8d067430b24267b8a20f78d68ac412 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:01.068531 16552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8d067430b24267b8a20f78d68ac412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.071318 16551 tablet_service.cc:1511] Processing CreateTablet for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:01.072646 16551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.075202 16550 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd7d3c7e92b43ee946d2d4505a17c43 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:01.076494 16550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd7d3c7e92b43ee946d2d4505a17c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.079052 16549 tablet_service.cc:1511] Processing CreateTablet for tablet 09733d7b0f3c42c3b742542d81067fe0 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:01.080328 16549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09733d7b0f3c42c3b742542d81067fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.081717 16479 tablet_service.cc:1511] Processing CreateTablet for tablet 318a7033cb194c3f8c635e0e36d5dc53 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:01.082901 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318a7033cb194c3f8c635e0e36d5dc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.090812 16478 tablet_service.cc:1511] Processing CreateTablet for tablet 441a1d437e7b4eff9f56f88ce7d935e5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:01.092108 16478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441a1d437e7b4eff9f56f88ce7d935e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.094926 16477 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8d067430b24267b8a20f78d68ac412 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:01.096138 16477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8d067430b24267b8a20f78d68ac412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.098990 16476 tablet_service.cc:1511] Processing CreateTablet for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:01.100374 16476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.103904 16547 tablet_service.cc:1511] Processing CreateTablet for tablet 08c3cde3ed474891aeea9ff365ee8a9d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:01.105149 16547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c3cde3ed474891aeea9ff365ee8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.104897 16475 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd7d3c7e92b43ee946d2d4505a17c43 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:01.106107 16475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd7d3c7e92b43ee946d2d4505a17c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.109839 16473 tablet_service.cc:1511] Processing CreateTablet for tablet cd6d2553f797441c910fb72d81b1049f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:01.111101 16473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6d2553f797441c910fb72d81b1049f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.112782 16548 tablet_service.cc:1511] Processing CreateTablet for tablet cd6d2553f797441c910fb72d81b1049f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:01.114092 16548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6d2553f797441c910fb72d81b1049f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.116878 16474 tablet_service.cc:1511] Processing CreateTablet for tablet 09733d7b0f3c42c3b742542d81067fe0 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:01.118175 16474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09733d7b0f3c42c3b742542d81067fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.125957 16472 tablet_service.cc:1511] Processing CreateTablet for tablet 08c3cde3ed474891aeea9ff365ee8a9d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:01.127281 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c3cde3ed474891aeea9ff365ee8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.144304 16547 tablet_service.cc:1511] Processing CreateTablet for tablet d45b7d1fd3cc4d48b36627737b07663c (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:01.145614 16547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45b7d1fd3cc4d48b36627737b07663c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.150167 16680 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:01.162662 16630 tablet_service.cc:1511] Processing CreateTablet for tablet 04f67e2620d84985a37dbf9b77909370 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:01.164876 16628 tablet_service.cc:1511] Processing CreateTablet for tablet 318a7033cb194c3f8c635e0e36d5dc53 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:01.165940 16627 tablet_service.cc:1511] Processing CreateTablet for tablet 441a1d437e7b4eff9f56f88ce7d935e5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:01.157735 16480 tablet_service.cc:1511] Processing CreateTablet for tablet d45b7d1fd3cc4d48b36627737b07663c (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:01.168126 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f67e2620d84985a37dbf9b77909370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.169124 16624 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd7d3c7e92b43ee946d2d4505a17c43 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:01.170354 16624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd7d3c7e92b43ee946d2d4505a17c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.170552 16623 tablet_service.cc:1511] Processing CreateTablet for tablet 09733d7b0f3c42c3b742542d81067fe0 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:01.172775 16625 tablet_service.cc:1511] Processing CreateTablet for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:01.164876 16629 tablet_service.cc:1511] Processing CreateTablet for tablet b9de9d7206ba42568149f95eb24f22ef (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:01.172791 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09733d7b0f3c42c3b742542d81067fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.184844 16627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441a1d437e7b4eff9f56f88ce7d935e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.185433 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.180024 16622 tablet_service.cc:1511] Processing CreateTablet for tablet cd6d2553f797441c910fb72d81b1049f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:01.185997 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9de9d7206ba42568149f95eb24f22ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.180986 16621 tablet_service.cc:1511] Processing CreateTablet for tablet 08c3cde3ed474891aeea9ff365ee8a9d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:01.190426 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6d2553f797441c910fb72d81b1049f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.191123 16621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c3cde3ed474891aeea9ff365ee8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.178776 16626 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8d067430b24267b8a20f78d68ac412 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:01.182020 16555 tablet_service.cc:1511] Processing CreateTablet for tablet da035835f764425db56e9649db0a0bcc (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:01.200933 16628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318a7033cb194c3f8c635e0e36d5dc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.202226 16480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45b7d1fd3cc4d48b36627737b07663c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.202339 16626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8d067430b24267b8a20f78d68ac412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.204473 16477 tablet_service.cc:1511] Processing CreateTablet for tablet da035835f764425db56e9649db0a0bcc (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:01.205704 16477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da035835f764425db56e9649db0a0bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.209646 16481 tablet_service.cc:1511] Processing CreateTablet for tablet 1670d7fa8dd74ffb9fc8584e273d75da (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:01.210807 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1670d7fa8dd74ffb9fc8584e273d75da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.205344 16554 tablet_service.cc:1511] Processing CreateTablet for tablet b235e470ebe04d06993b8dd025e5871b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:01.216048 16478 tablet_service.cc:1511] Processing CreateTablet for tablet b235e470ebe04d06993b8dd025e5871b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:01.217183 16478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b235e470ebe04d06993b8dd025e5871b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.218724 16680 tablet_bootstrap.cc:654] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.228296 16681 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:01.229456 16552 tablet_service.cc:1511] Processing CreateTablet for tablet f61b94df305e465c9e3aae1bf4931b69 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:01.229616 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 1670d7fa8dd74ffb9fc8584e273d75da (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:01.230755 16552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61b94df305e465c9e3aae1bf4931b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.233434 16550 tablet_service.cc:1511] Processing CreateTablet for tablet dd80ac0ca5c24b45831f9f1d02066656 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:01.234580 16550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80ac0ca5c24b45831f9f1d02066656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.238960 16472 tablet_service.cc:1511] Processing CreateTablet for tablet dd80ac0ca5c24b45831f9f1d02066656 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:01.240106 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80ac0ca5c24b45831f9f1d02066656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.242517 16549 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac4e93cad76428c81439a9c5471f994 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:01.243558 16555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da035835f764425db56e9649db0a0bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.259915 16682 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:01.261783 16474 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac4e93cad76428c81439a9c5471f994 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:01.262566 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1670d7fa8dd74ffb9fc8584e273d75da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.262948 16474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac4e93cad76428c81439a9c5471f994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.269372 16630 tablet_service.cc:1511] Processing CreateTablet for tablet da035835f764425db56e9649db0a0bcc (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:01.269719 16623 tablet_service.cc:1511] Processing CreateTablet for tablet b235e470ebe04d06993b8dd025e5871b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:01.223757 16473 tablet_service.cc:1511] Processing CreateTablet for tablet f61b94df305e465c9e3aae1bf4931b69 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:01.272055 16628 tablet_service.cc:1511] Processing CreateTablet for tablet d45b7d1fd3cc4d48b36627737b07663c (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:01.277149 16553 tablet_service.cc:1511] Processing CreateTablet for tablet aa6d2ae2d1794655a3e58da8d53b412a (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:01.284556 16547 tablet_service.cc:1511] Processing CreateTablet for tablet f1d7270021514f3c83a70987981f65cf (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:01.286906 16479 tablet_service.cc:1511] Processing CreateTablet for tablet aa6d2ae2d1794655a3e58da8d53b412a (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:01.287189 16548 tablet_service.cc:1511] Processing CreateTablet for tablet faea00d3379945fd9f9d98c82429c8d5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:01.288327 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da035835f764425db56e9649db0a0bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.291711 16680 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:01.292158 16680 ts_tablet_manager.cc:1403] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.142s	user 0.005s	sys 0.009s
I20260709 13:06:01.294656 16476 tablet_service.cc:1511] Processing CreateTablet for tablet f1d7270021514f3c83a70987981f65cf (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:01.294860 16680 raft_consensus.cc:359] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.295543 16680 raft_consensus.cc:385] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.295842 16680 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.296073 16473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61b94df305e465c9e3aae1bf4931b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.296617 16680 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.297199 16681 tablet_bootstrap.cc:654] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.300509 16478 tablet_service.cc:1511] Processing CreateTablet for tablet faea00d3379945fd9f9d98c82429c8d5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:01.301614 16478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea00d3379945fd9f9d98c82429c8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.301406 16551 tablet_service.cc:1511] Processing CreateTablet for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:01.300419 16621 tablet_service.cc:1511] Processing CreateTablet for tablet 1670d7fa8dd74ffb9fc8584e273d75da (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:01.306030 16621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1670d7fa8dd74ffb9fc8584e273d75da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.307705 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b235e470ebe04d06993b8dd025e5871b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.308023 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6d2ae2d1794655a3e58da8d53b412a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.309872 16549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac4e93cad76428c81439a9c5471f994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.310251 16475 tablet_service.cc:1511] Processing CreateTablet for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:01.311591 16475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.312753 16554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b235e470ebe04d06993b8dd025e5871b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.315510 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6d2ae2d1794655a3e58da8d53b412a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.316090 16548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea00d3379945fd9f9d98c82429c8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.317104 16627 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac4e93cad76428c81439a9c5471f994 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:01.318207 16547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d7270021514f3c83a70987981f65cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.320758 16476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d7270021514f3c83a70987981f65cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.321780 16682 tablet_bootstrap.cc:654] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.322216 16472 tablet_service.cc:1511] Processing CreateTablet for tablet 5a35bf299a154270b54e15fd1cbb505c (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:01.323374 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a35bf299a154270b54e15fd1cbb505c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.325416 16625 tablet_service.cc:1511] Processing CreateTablet for tablet aa6d2ae2d1794655a3e58da8d53b412a (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:01.316092 16628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45b7d1fd3cc4d48b36627737b07663c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.326532 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6d2ae2d1794655a3e58da8d53b412a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.328292 16551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.336042 16627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac4e93cad76428c81439a9c5471f994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.357415 16622 tablet_service.cc:1511] Processing CreateTablet for tablet f1d7270021514f3c83a70987981f65cf (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:01.365304 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d7270021514f3c83a70987981f65cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.284552 16626 tablet_service.cc:1511] Processing CreateTablet for tablet f61b94df305e465c9e3aae1bf4931b69 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:01.372582 16626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61b94df305e465c9e3aae1bf4931b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.380787 16622 tablet_service.cc:1511] Processing CreateTablet for tablet faea00d3379945fd9f9d98c82429c8d5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:01.382175 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea00d3379945fd9f9d98c82429c8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.315501 16629 tablet_service.cc:1511] Processing CreateTablet for tablet dd80ac0ca5c24b45831f9f1d02066656 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:01.383781 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80ac0ca5c24b45831f9f1d02066656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.384727 16680 ts_tablet_manager.cc:1434] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.012s
I20260709 13:06:01.385633 16591 heartbeater.cc:499] Master 127.15.6.62:43625 was elected leader, sending a full tablet report...
I20260709 13:06:01.386077 16680 tablet_bootstrap.cc:492] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:01.387183 16551 tablet_service.cc:1511] Processing CreateTablet for tablet ecb26c2b33364a6583c0073862883947 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:01.388334 16551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb26c2b33364a6583c0073862883947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.397030 16680 tablet_bootstrap.cc:654] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.416517 16681 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:01.416973 16681 ts_tablet_manager.cc:1403] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.189s	user 0.007s	sys 0.008s
I20260709 13:06:01.416997 16548 tablet_service.cc:1511] Processing CreateTablet for tablet f9f76c206fdf425385a859d72331f02b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:01.418278 16548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f76c206fdf425385a859d72331f02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.419922 16681 raft_consensus.cc:359] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.420639 16681 raft_consensus.cc:385] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.420909 16681 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.421680 16681 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.431375 16627 tablet_service.cc:1511] Processing CreateTablet for tablet 5a35bf299a154270b54e15fd1cbb505c (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:01.432564 16627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a35bf299a154270b54e15fd1cbb505c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.443567 16555 tablet_service.cc:1511] Processing CreateTablet for tablet 5a35bf299a154270b54e15fd1cbb505c (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:01.444229 16481 tablet_service.cc:1511] Processing CreateTablet for tablet ecb26c2b33364a6583c0073862883947 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:01.444743 16555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a35bf299a154270b54e15fd1cbb505c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.447640 16479 tablet_service.cc:1511] Processing CreateTablet for tablet a22c30518dd74380871bcf169099e049 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:01.449025 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22c30518dd74380871bcf169099e049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.451493 16550 tablet_service.cc:1511] Processing CreateTablet for tablet a22c30518dd74380871bcf169099e049 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:01.458808 16550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22c30518dd74380871bcf169099e049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.447005 16477 tablet_service.cc:1511] Processing CreateTablet for tablet f9f76c206fdf425385a859d72331f02b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:01.455624 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb26c2b33364a6583c0073862883947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.457638 16475 tablet_service.cc:1511] Processing CreateTablet for tablet f66755c5c9714ae1858e6df5473a5cd6 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:01.455693 16478 tablet_service.cc:1511] Processing CreateTablet for tablet d64e83e5333143e393eb71aac8666e63 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:01.469992 16476 tablet_service.cc:1511] Processing CreateTablet for tablet 18244033cce043c69c8f4584b91ddc0d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:01.470925 16480 tablet_service.cc:1511] Processing CreateTablet for tablet 4deba3ef5feb443b8e28599a079603bd (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:01.483006 16629 tablet_service.cc:1511] Processing CreateTablet for tablet f9f76c206fdf425385a859d72331f02b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:01.484184 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f76c206fdf425385a859d72331f02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.463973 16556 tablet_service.cc:1511] Processing CreateTablet for tablet d64e83e5333143e393eb71aac8666e63 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:01.474009 16475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66755c5c9714ae1858e6df5473a5cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.488294 16480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4deba3ef5feb443b8e28599a079603bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.492064 16476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18244033cce043c69c8f4584b91ddc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.390530 16624 tablet_service.cc:1511] Processing CreateTablet for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:01.496351 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e83e5333143e393eb71aac8666e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.496659 16624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.500056 16478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e83e5333143e393eb71aac8666e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.501298 16621 tablet_service.cc:1511] Processing CreateTablet for tablet d64e83e5333143e393eb71aac8666e63 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:01.503017 16625 tablet_service.cc:1511] Processing CreateTablet for tablet a22c30518dd74380871bcf169099e049 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:01.504192 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22c30518dd74380871bcf169099e049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.470019 16628 tablet_service.cc:1511] Processing CreateTablet for tablet ecb26c2b33364a6583c0073862883947 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:01.506840 16628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb26c2b33364a6583c0073862883947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.509639 16474 tablet_service.cc:1511] Processing CreateTablet for tablet e1b4ff396aa14325948460c8a0fcd925 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:01.511071 16623 tablet_service.cc:1511] Processing CreateTablet for tablet 4deba3ef5feb443b8e28599a079603bd (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:06:01.511997 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:01.513445 16477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f76c206fdf425385a859d72331f02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.514497 16630 tablet_service.cc:1511] Processing CreateTablet for tablet f66755c5c9714ae1858e6df5473a5cd6 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:01.531510 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66755c5c9714ae1858e6df5473a5cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.514504 16553 tablet_service.cc:1511] Processing CreateTablet for tablet f66755c5c9714ae1858e6df5473a5cd6 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:01.516387 16681 ts_tablet_manager.cc:1434] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.011s
I20260709 13:06:01.517727 16552 tablet_service.cc:1511] Processing CreateTablet for tablet 18244033cce043c69c8f4584b91ddc0d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:01.522182 16549 tablet_service.cc:1511] Processing CreateTablet for tablet 4deba3ef5feb443b8e28599a079603bd (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:01.522435 16481 tablet_service.cc:1511] Processing CreateTablet for tablet ca9e6e3a4a404a9893a40afed3d0179f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:01.523896 16473 tablet_service.cc:1511] Processing CreateTablet for tablet e9a943513f89492ba24cbf67180d01f3 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:01.534314 16516 heartbeater.cc:499] Master 127.15.6.62:43625 was elected leader, sending a full tablet report...
I20260709 13:06:01.530107 16548 tablet_service.cc:1511] Processing CreateTablet for tablet e1b4ff396aa14325948460c8a0fcd925 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:01.534842 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9e6e3a4a404a9893a40afed3d0179f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.536504 16473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a943513f89492ba24cbf67180d01f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.539510 16474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b4ff396aa14325948460c8a0fcd925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.540316 16681 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:01.542511 16627 tablet_service.cc:1511] Processing CreateTablet for tablet 18244033cce043c69c8f4584b91ddc0d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:01.543661 16627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18244033cce043c69c8f4584b91ddc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.545140 16682 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:01.545560 16682 ts_tablet_manager.cc:1403] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.286s	user 0.024s	sys 0.043s
I20260709 13:06:01.548574 16547 tablet_service.cc:1511] Processing CreateTablet for tablet e9a943513f89492ba24cbf67180d01f3 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:01.558282 16625 tablet_service.cc:1511] Processing CreateTablet for tablet e1b4ff396aa14325948460c8a0fcd925 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:01.560194 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b4ff396aa14325948460c8a0fcd925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.560720 16682 raft_consensus.cc:359] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.561431 16682 raft_consensus.cc:385] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.561709 16682 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.562386 16682 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.582142 16621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e83e5333143e393eb71aac8666e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.594296 16680 tablet_bootstrap.cc:492] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:01.594784 16680 ts_tablet_manager.cc:1403] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.019s
I20260709 13:06:01.594652 16626 tablet_service.cc:1511] Processing CreateTablet for tablet e9a943513f89492ba24cbf67180d01f3 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:01.596721 16548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b4ff396aa14325948460c8a0fcd925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.598774 16472 tablet_service.cc:1511] Processing CreateTablet for tablet 16de3b472e2a4b62908fb29412b52f14 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:01.599954 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16de3b472e2a4b62908fb29412b52f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.600284 16552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18244033cce043c69c8f4584b91ddc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.606178 16475 tablet_service.cc:1511] Processing CreateTablet for tablet ddfb4b0791d74c589434dee63459ca4f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:01.606678 16549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4deba3ef5feb443b8e28599a079603bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.607476 16475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfb4b0791d74c589434dee63459ca4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.610029 16547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a943513f89492ba24cbf67180d01f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.610224 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4deba3ef5feb443b8e28599a079603bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.610754 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66755c5c9714ae1858e6df5473a5cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.613265 16626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a943513f89492ba24cbf67180d01f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.614786 16680 raft_consensus.cc:359] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.615464 16680 raft_consensus.cc:385] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.616549 16665 heartbeater.cc:499] Master 127.15.6.62:43625 was elected leader, sending a full tablet report...
I20260709 13:06:01.617655 16479 tablet_service.cc:1511] Processing CreateTablet for tablet e5369c1ed0fb429bab44a33761ca4553 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:01.618960 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5369c1ed0fb429bab44a33761ca4553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.615744 16680 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.623252 16682 ts_tablet_manager.cc:1434] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.013s
I20260709 13:06:01.624250 16682 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:01.627705 16551 tablet_service.cc:1511] Processing CreateTablet for tablet ddfb4b0791d74c589434dee63459ca4f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:01.628403 16555 tablet_service.cc:1511] Processing CreateTablet for tablet 16de3b472e2a4b62908fb29412b52f14 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:01.632697 16554 tablet_service.cc:1511] Processing CreateTablet for tablet ca9e6e3a4a404a9893a40afed3d0179f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:01.641907 16688 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.642477 16688 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.649473 16680 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.651021 16681 tablet_bootstrap.cc:654] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.654361 16688 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:01.628964 16551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfb4b0791d74c589434dee63459ca4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.650069 16556 tablet_service.cc:1511] Processing CreateTablet for tablet e5369c1ed0fb429bab44a33761ca4553 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:01.678179 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5369c1ed0fb429bab44a33761ca4553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.679006 16554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9e6e3a4a404a9893a40afed3d0179f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.684223 16555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16de3b472e2a4b62908fb29412b52f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.714098 16480 tablet_service.cc:1511] Processing CreateTablet for tablet 4df4eab2c270411ebedb43bc97966c7f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:01.715445 16480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df4eab2c270411ebedb43bc97966c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.719367 16684 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.719875 16684 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.722245 16684 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:01.723502 16682 tablet_bootstrap.cc:654] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.728945 16628 tablet_service.cc:1511] Processing CreateTablet for tablet ca9e6e3a4a404a9893a40afed3d0179f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:01.755362 16628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9e6e3a4a404a9893a40afed3d0179f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.756362 16680 ts_tablet_manager.cc:1434] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.002s
I20260709 13:06:01.756898 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:01.768877 16455 leader_election.cc:343] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.776796 16473 tablet_service.cc:1511] Processing CreateTablet for tablet a8f74647bc1e4de09af86d4c90a3dc13 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:01.777992 16473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f74647bc1e4de09af86d4c90a3dc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.781416 16476 tablet_service.cc:1511] Processing CreateTablet for tablet 71cad9c33f0b4530881909502ebdc720 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:01.782539 16476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cad9c33f0b4530881909502ebdc720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.793151 16554 tablet_service.cc:1511] Processing CreateTablet for tablet 4df4eab2c270411ebedb43bc97966c7f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:01.794414 16554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df4eab2c270411ebedb43bc97966c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.795291 16689 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.796025 16680 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:01.797637 16624 tablet_service.cc:1511] Processing CreateTablet for tablet e5369c1ed0fb429bab44a33761ca4553 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:01.798779 16624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5369c1ed0fb429bab44a33761ca4553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.800837 16681 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:01.801299 16681 ts_tablet_manager.cc:1403] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.261s	user 0.006s	sys 0.011s
I20260709 13:06:01.806900 16680 tablet_bootstrap.cc:654] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.795717 16689 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.807323 16622 tablet_service.cc:1511] Processing CreateTablet for tablet ddfb4b0791d74c589434dee63459ca4f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:01.813668 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfb4b0791d74c589434dee63459ca4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.814868 16684 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.808121 16630 tablet_service.cc:1511] Processing CreateTablet for tablet 4df4eab2c270411ebedb43bc97966c7f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:01.809930 16479 tablet_service.cc:1511] Processing CreateTablet for tablet 8a89d28915e9486ba50f8fdafb99a037 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:01.811451 16681 raft_consensus.cc:359] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.812124 16627 tablet_service.cc:1511] Processing CreateTablet for tablet 16de3b472e2a4b62908fb29412b52f14 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:01.815341 16684 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.814898 16689 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:01.820345 16681 raft_consensus.cc:385] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.843513 16553 tablet_service.cc:1511] Processing CreateTablet for tablet 71cad9c33f0b4530881909502ebdc720 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:01.843704 16552 tablet_service.cc:1511] Processing CreateTablet for tablet 8a89d28915e9486ba50f8fdafb99a037 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:01.845005 16550 tablet_service.cc:1511] Processing CreateTablet for tablet d34e55d2ce67443aaecb395469a9c7ce (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:01.845259 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:01.857450 16681 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.857941 16566 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:01.848263 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a89d28915e9486ba50f8fdafb99a037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.858278 16681 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.846082 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:01.852715 16548 tablet_service.cc:1511] Processing CreateTablet for tablet a8f74647bc1e4de09af86d4c90a3dc13 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:01.850430 16474 tablet_service.cc:1511] Processing CreateTablet for tablet d34e55d2ce67443aaecb395469a9c7ce (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:01.858143 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cad9c33f0b4530881909502ebdc720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.857059 16684 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:01.870519 16491 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:01.871533 16550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34e55d2ce67443aaecb395469a9c7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.880864 16681 ts_tablet_manager.cc:1434] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:06:01.882942 16552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a89d28915e9486ba50f8fdafb99a037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.888751 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:01.889231 16474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34e55d2ce67443aaecb395469a9c7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.892037 16681 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:01.893697 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:01.896082 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df4eab2c270411ebedb43bc97966c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.899444 16681 tablet_bootstrap.cc:654] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.899937 16688 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.900089 16627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16de3b472e2a4b62908fb29412b52f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.900313 16688 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.900637 16688 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.903141 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:01.903925 16684 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.904253 16684 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.904548 16684 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.905216 16626 tablet_service.cc:1511] Processing CreateTablet for tablet 71cad9c33f0b4530881909502ebdc720 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:01.906358 16626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cad9c33f0b4530881909502ebdc720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.907094 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:01.908350 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:01.909037 16625 tablet_service.cc:1511] Processing CreateTablet for tablet 8a89d28915e9486ba50f8fdafb99a037 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:01.910125 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a89d28915e9486ba50f8fdafb99a037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.911999 16548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f74647bc1e4de09af86d4c90a3dc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.903925 16623 tablet_service.cc:1511] Processing CreateTablet for tablet a8f74647bc1e4de09af86d4c90a3dc13 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:01.913750 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f74647bc1e4de09af86d4c90a3dc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.915608 16629 tablet_service.cc:1511] Processing CreateTablet for tablet d34e55d2ce67443aaecb395469a9c7ce (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:01.916752 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34e55d2ce67443aaecb395469a9c7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.915503 16475 tablet_service.cc:1511] Processing CreateTablet for tablet cc4151437571420aa297eb389f8c35af (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:01.920748 16475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4151437571420aa297eb389f8c35af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:01.924830 16530 leader_election.cc:343] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:01.928021 16530 leader_election.cc:343] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:01.928831 16530 leader_election.cc:343] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.929194 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:01.933197 16684 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.935012 16684 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:01.935483 16684 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:01.924661 16555 tablet_service.cc:1511] Processing CreateTablet for tablet cc4151437571420aa297eb389f8c35af (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:01.939167 16555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4151437571420aa297eb389f8c35af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.944775 16628 tablet_service.cc:1511] Processing CreateTablet for tablet cc4151437571420aa297eb389f8c35af (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:01.945935 16628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4151437571420aa297eb389f8c35af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.951190 16473 tablet_service.cc:1511] Processing CreateTablet for tablet 836ce75918dd4690b2a75522b473f405 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:01.953074 16682 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:01.957096 16551 tablet_service.cc:1511] Processing CreateTablet for tablet 836ce75918dd4690b2a75522b473f405 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:01.962838 16551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836ce75918dd4690b2a75522b473f405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.957312 16688 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.964100 16682 ts_tablet_manager.cc:1403] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.340s	user 0.039s	sys 0.022s
I20260709 13:06:01.966180 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:01.967016 16565 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:01.958154 16680 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:01.960175 16473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836ce75918dd4690b2a75522b473f405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.961846 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:01.980625 16688 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:01.981150 16688 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.984664 16688 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.984992 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:01.986300 16455 leader_election.cc:343] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.986572 16688 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:01.987421 16605 leader_election.cc:343] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.978979 16680 ts_tablet_manager.cc:1403] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.010s
I20260709 13:06:01.987715 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:01.988998 16455 leader_election.cc:343] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.990993 16680 raft_consensus.cc:359] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:01.991684 16680 raft_consensus.cc:385] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:02.001339 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72534.4us
I20260709 13:06:02.003512 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:02.004251 16491 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:02.007275 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:02.009598 16624 tablet_service.cc:1511] Processing CreateTablet for tablet 836ce75918dd4690b2a75522b473f405 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:02.010965 16624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836ce75918dd4690b2a75522b473f405. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:02.019912 16530 leader_election.cc:343] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.019742 16621 tablet_service.cc:1511] Processing CreateTablet for tablet 755c5be0c60f44e5a3df52484c5c934f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:02.020334 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.021000 16621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755c5be0c60f44e5a3df52484c5c934f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.023844 16554 tablet_service.cc:1511] Processing CreateTablet for tablet 3b22e951e8c745fd96de0226683aff04 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:02.024115 16700 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.025015 16554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b22e951e8c745fd96de0226683aff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.997937 16680 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.028139 16680 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.030225 16680 ts_tablet_manager.cc:1434] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.000s
I20260709 13:06:02.031106 16680 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.034307 16622 tablet_service.cc:1511] Processing CreateTablet for tablet 3b22e951e8c745fd96de0226683aff04 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:02.035429 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:02.036896 16604 leader_election.cc:343] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.037322 16604 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:02.038023 16689 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.035446 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b22e951e8c745fd96de0226683aff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.048596 16682 raft_consensus.cc:359] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.049315 16682 raft_consensus.cc:385] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.049628 16682 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.049678 16548 tablet_service.cc:1511] Processing CreateTablet for tablet a8c27c31776b4e60afb061384a2ea62e (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:02.050550 16682 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.056779 16682 ts_tablet_manager.cc:1434] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.092s	user 0.003s	sys 0.004s
I20260709 13:06:02.059226 16623 tablet_service.cc:1511] Processing CreateTablet for tablet a8c27c31776b4e60afb061384a2ea62e (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:02.060338 16550 tablet_service.cc:1511] Processing CreateTablet for tablet 755c5be0c60f44e5a3df52484c5c934f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:02.063160 16552 tablet_service.cc:1511] Processing CreateTablet for tablet d4a969bf0b354736bf91615b8648cf36 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:02.068194 16621 tablet_service.cc:1511] Processing CreateTablet for tablet d4a969bf0b354736bf91615b8648cf36 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:02.069500 16555 tablet_service.cc:1511] Processing CreateTablet for tablet 26d0f0e748bb4817a08afec4338c216a (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:02.072571 16548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c27c31776b4e60afb061384a2ea62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.094165 16627 tablet_service.cc:1511] Processing CreateTablet for tablet a6d40aa6b369461bb9f13d568e8450e7 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:02.095309 16627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d40aa6b369461bb9f13d568e8450e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.096649 16622 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3eed6f88504d69aad570d8cc480623 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:02.097787 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3eed6f88504d69aad570d8cc480623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.098060 16553 tablet_service.cc:1511] Processing CreateTablet for tablet f7f595b7864d413a8f05d3b5e1f50aec (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:02.076596 16629 tablet_service.cc:1511] Processing CreateTablet for tablet 26d0f0e748bb4817a08afec4338c216a (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:02.099167 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f595b7864d413a8f05d3b5e1f50aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.099929 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d0f0e748bb4817a08afec4338c216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.104178 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c27c31776b4e60afb061384a2ea62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.108029 16550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755c5be0c60f44e5a3df52484c5c934f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.109401 16625 tablet_service.cc:1511] Processing CreateTablet for tablet f7f595b7864d413a8f05d3b5e1f50aec (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:02.110737 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f595b7864d413a8f05d3b5e1f50aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.116389 16555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d0f0e748bb4817a08afec4338c216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.121975 16552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a969bf0b354736bf91615b8648cf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.127302 16700 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.127755 16700 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.129720 16700 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.130920 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.131145 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:02.132263 16530 leader_election.cc:343] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.132860 16530 leader_election.cc:343] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.133244 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.133919 16700 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.077780 16681 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.079098 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.080744 16474 tablet_service.cc:1511] Processing CreateTablet for tablet 755c5be0c60f44e5a3df52484c5c934f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:02.137284 16474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755c5be0c60f44e5a3df52484c5c934f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.137795 16680 tablet_bootstrap.cc:654] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.081054 16479 tablet_service.cc:1511] Processing CreateTablet for tablet 3b22e951e8c745fd96de0226683aff04 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:02.082998 16480 tablet_service.cc:1511] Processing CreateTablet for tablet a8c27c31776b4e60afb061384a2ea62e (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:02.084280 16682 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.084720 16478 tablet_service.cc:1511] Processing CreateTablet for tablet d4a969bf0b354736bf91615b8648cf36 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:02.085824 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.140501 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b22e951e8c745fd96de0226683aff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.140846 16627 tablet_service.cc:1511] Processing CreateTablet for tablet c489b078811a4d66b4a4c4cacb1dbf2d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:02.141270 16702 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:06:02.140765 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55027.5us
I20260709 13:06:02.142114 16627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c489b078811a4d66b4a4c4cacb1dbf2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:02.144232 16456 leader_election.cc:343] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.144626 16456 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.145524 16551 tablet_service.cc:1511] Processing CreateTablet for tablet c489b078811a4d66b4a4c4cacb1dbf2d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:02.146688 16551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c489b078811a4d66b4a4c4cacb1dbf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.090703 16549 tablet_service.cc:1511] Processing CreateTablet for tablet a6d40aa6b369461bb9f13d568e8450e7 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:02.092952 16547 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3eed6f88504d69aad570d8cc480623 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:02.148447 16549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d40aa6b369461bb9f13d568e8450e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.149554 16481 tablet_service.cc:1511] Processing CreateTablet for tablet c489b078811a4d66b4a4c4cacb1dbf2d (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:02.154714 16621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a969bf0b354736bf91615b8648cf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.147756 16475 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3eed6f88504d69aad570d8cc480623 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:02.146347 16476 tablet_service.cc:1511] Processing CreateTablet for tablet a6d40aa6b369461bb9f13d568e8450e7 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:02.144250 16478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a969bf0b354736bf91615b8648cf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.156436 16476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d40aa6b369461bb9f13d568e8450e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.153332 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 5f89989988c641f59bbc5b03e885656b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:02.157953 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f89989988c641f59bbc5b03e885656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.150102 16554 tablet_service.cc:1511] Processing CreateTablet for tablet 1eda6987d51b45e0a0672ec78b798b0f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:02.160012 16702 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.160480 16554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eda6987d51b45e0a0672ec78b798b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.160898 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c489b078811a4d66b4a4c4cacb1dbf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.162612 16480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c27c31776b4e60afb061384a2ea62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.148682 16477 tablet_service.cc:1511] Processing CreateTablet for tablet f7f595b7864d413a8f05d3b5e1f50aec (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:02.163760 16475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3eed6f88504d69aad570d8cc480623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.166734 16622 tablet_service.cc:1511] Processing CreateTablet for tablet 5f89989988c641f59bbc5b03e885656b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:02.167934 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f89989988c641f59bbc5b03e885656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.167065 16477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f595b7864d413a8f05d3b5e1f50aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.168352 16547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3eed6f88504d69aad570d8cc480623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.177260 16472 tablet_service.cc:1511] Processing CreateTablet for tablet 1eda6987d51b45e0a0672ec78b798b0f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:02.178421 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eda6987d51b45e0a0672ec78b798b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.200218 16623 tablet_service.cc:1511] Processing CreateTablet for tablet 1eda6987d51b45e0a0672ec78b798b0f (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:02.204463 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eda6987d51b45e0a0672ec78b798b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.145526 16682 tablet_bootstrap.cc:654] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.216102 16681 ts_tablet_manager.cc:1403] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.327s	user 0.043s	sys 0.026s
I20260709 13:06:02.219130 16681 raft_consensus.cc:359] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.222589 16625 tablet_service.cc:1511] Processing CreateTablet for tablet 82af48cecc58434e959547ec318fa4c5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:02.223814 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82af48cecc58434e959547ec318fa4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.087646 16473 tablet_service.cc:1511] Processing CreateTablet for tablet 26d0f0e748bb4817a08afec4338c216a (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:02.231513 16473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d0f0e748bb4817a08afec4338c216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.231931 16472 tablet_service.cc:1511] Processing CreateTablet for tablet 5f89989988c641f59bbc5b03e885656b (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:02.233153 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f89989988c641f59bbc5b03e885656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.222630 16553 tablet_service.cc:1511] Processing CreateTablet for tablet 82af48cecc58434e959547ec318fa4c5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:02.238513 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82af48cecc58434e959547ec318fa4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.249157 16681 raft_consensus.cc:385] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.249523 16681 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.262734 16481 tablet_service.cc:1511] Processing CreateTablet for tablet 82af48cecc58434e959547ec318fa4c5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:02.270231 16476 tablet_service.cc:1511] Processing CreateTablet for tablet cd0cddf61354438cac7dda825626e2c5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:06:02.293503 16374 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45500.3us
I20260709 13:06:02.297546 16682 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.297994 16682 ts_tablet_manager.cc:1403] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.214s	user 0.007s	sys 0.005s
W20260709 13:06:02.304076 16375 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 45649.4us
I20260709 13:06:02.304158 16682 raft_consensus.cc:359] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.304845 16682 raft_consensus.cc:385] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.305133 16682 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.306721 16477 tablet_service.cc:1511] Processing CreateTablet for tablet 08a8884f986b4b43beecab72a521a3eb (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:02.282392 16681 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.307885 16682 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.308606 16622 tablet_service.cc:1511] Processing CreateTablet for tablet cd0cddf61354438cac7dda825626e2c5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:02.309664 16681 ts_tablet_manager.cc:1434] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.001s
I20260709 13:06:02.309723 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0cddf61354438cac7dda825626e2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.312366 16682 ts_tablet_manager.cc:1434] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:06:02.313799 16682 tablet_bootstrap.cc:492] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.321208 16682 tablet_bootstrap.cc:654] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.324934 16549 tablet_service.cc:1511] Processing CreateTablet for tablet cd0cddf61354438cac7dda825626e2c5 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:02.327911 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82af48cecc58434e959547ec318fa4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.328537 16476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0cddf61354438cac7dda825626e2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.330014 16477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a8884f986b4b43beecab72a521a3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.335227 16680 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.335577 16680 ts_tablet_manager.cc:1403] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.305s	user 0.070s	sys 0.084s
I20260709 13:06:02.338421 16680 raft_consensus.cc:359] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.339109 16680 raft_consensus.cc:385] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.339395 16680 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.340216 16680 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.340863 16681 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.342839 16680 ts_tablet_manager.cc:1434] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:02.343704 16549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0cddf61354438cac7dda825626e2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.346572 16681 tablet_bootstrap.cc:654] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.349180 16680 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.355989 16700 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.356684 16700 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.358026 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 08a8884f986b4b43beecab72a521a3eb (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:02.358480 16700 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.359175 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a8884f986b4b43beecab72a521a3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.367058 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.367664 16639 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:02.368881 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.368826 16622 tablet_service.cc:1511] Processing CreateTablet for tablet 08a8884f986b4b43beecab72a521a3eb (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:02.369387 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.369956 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a8884f986b4b43beecab72a521a3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.369844 16472 tablet_service.cc:1511] Processing CreateTablet for tablet a2d7c9def9a84db7a3a3e5199a328236 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:06:02.370240 16530 leader_election.cc:343] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.370958 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d7c9def9a84db7a3a3e5199a328236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.371042 16700 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.371472 16700 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.368752 16551 tablet_service.cc:1511] Processing CreateTablet for tablet a2d7c9def9a84db7a3a3e5199a328236 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:02.371807 16700 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.374961 16551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d7c9def9a84db7a3a3e5199a328236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.378340 16700 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.380859 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:02.384559 16530 leader_election.cc:343] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.384315 16629 tablet_service.cc:1511] Processing CreateTablet for tablet a2d7c9def9a84db7a3a3e5199a328236 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:02.385691 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d7c9def9a84db7a3a3e5199a328236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.386396 16680 tablet_bootstrap.cc:654] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.384322 16479 tablet_service.cc:1511] Processing CreateTablet for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:02.392859 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.389873 16553 tablet_service.cc:1511] Processing CreateTablet for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:02.397378 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:02.399042 16639 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.406652 16639 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:02.407837 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:02.411815 16682 tablet_bootstrap.cc:492] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.411972 16684 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.413600 16622 tablet_service.cc:1511] Processing CreateTablet for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:02.415167 16622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.416672 16682 ts_tablet_manager.cc:1403] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.015s
I20260709 13:06:02.417196 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.398504 16700 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.421442 16472 tablet_service.cc:1511] Processing CreateTablet for tablet b1ada08378e34050bfc80a9f6893b014 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:02.421584 16625 tablet_service.cc:1511] Processing CreateTablet for tablet b1ada08378e34050bfc80a9f6893b014 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:02.422598 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ada08378e34050bfc80a9f6893b014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.422715 16625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ada08378e34050bfc80a9f6893b014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.419436 16682 raft_consensus.cc:359] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.427670 16549 tablet_service.cc:1511] Processing CreateTablet for tablet b1ada08378e34050bfc80a9f6893b014 (DEFAULT_TABLE table=test-workload [id=4dcd57a6d2864650a857de4e00c52b15]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:02.435132 16684 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:02.434862 16682 raft_consensus.cc:385] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.436673 16682 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.436208 16684 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.437515 16682 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.443477 16682 ts_tablet_manager.cc:1434] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:06:02.447482 16682 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.454727 16682 tablet_bootstrap.cc:654] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.458250 16681 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.458705 16681 ts_tablet_manager.cc:1403] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.118s	user 0.003s	sys 0.008s
I20260709 13:06:02.459394 16549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ada08378e34050bfc80a9f6893b014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.462297 16681 raft_consensus.cc:359] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.463004 16681 raft_consensus.cc:385] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.463330 16681 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.464099 16681 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.465914 16680 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.466338 16680 ts_tablet_manager.cc:1403] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.021s
I20260709 13:06:02.466995 16681 ts_tablet_manager.cc:1434] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:06:02.468228 16681 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.468950 16680 raft_consensus.cc:359] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.469604 16680 raft_consensus.cc:385] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.469870 16680 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.470533 16680 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.472265 16702 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.472690 16702 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.462952 16386 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.474702 16702 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.475342 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.475929 16566 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:02.476143 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.477092 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:02.477828 16455 leader_election.cc:343] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.478668 16702 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.479035 16702 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.479336 16702 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.479740 16681 tablet_bootstrap.cc:654] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.482923 16680 ts_tablet_manager.cc:1434] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:02.483875 16680 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.484141 16682 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.484287 16681 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.484671 16682 ts_tablet_manager.cc:1403] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.004s
I20260709 13:06:02.484673 16681 ts_tablet_manager.cc:1403] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:06:02.485633 16702 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.487914 16681 raft_consensus.cc:359] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.487860 16682 raft_consensus.cc:359] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.488215 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:02.488914 16682 raft_consensus.cc:385] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.488926 16566 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.489441 16682 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.490252 16682 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.494889 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:02.495312 16566 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:02.495446 16639 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.489315 16681 raft_consensus.cc:385] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.496120 16681 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.497234 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:02.499058 16682 ts_tablet_manager.cc:1434] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:06:02.500595 16682 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.502091 16639 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:02.504076 16681 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.506305 16702 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.506861 16702 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.507267 16702 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:02.508052 16702 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.495090 16680 tablet_bootstrap.cc:654] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.513403 16682 tablet_bootstrap.cc:654] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.524168 16680 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.524654 16680 ts_tablet_manager.cc:1403] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.002s
I20260709 13:06:02.528169 16713 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.528364 16689 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.528612 16713 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.528779 16689 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.530555 16689 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:02.527501 16680 raft_consensus.cc:359] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.533159 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.533563 16680 raft_consensus.cc:385] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.533869 16680 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
W20260709 13:06:02.534595 16604 leader_election.cc:343] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.534689 16680 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.535558 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.536094 16681 ts_tablet_manager.cc:1434] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:06:02.536995 16681 tablet_bootstrap.cc:492] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Bootstrap starting.
W20260709 13:06:02.537499 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:02.537113 16680 ts_tablet_manager.cc:1434] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:02.538169 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.538842 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:02.536963 16456 leader_election.cc:343] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.540270 16605 leader_election.cc:343] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.540452 16680 tablet_bootstrap.cc:492] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.540593 16713 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.540694 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:02.541767 16689 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:02.542829 16455 leader_election.cc:343] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.543308 16455 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.544298 16713 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.546463 16681 tablet_bootstrap.cc:654] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.546995 16682 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.547533 16682 ts_tablet_manager.cc:1403] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.021s
I20260709 13:06:02.550315 16682 raft_consensus.cc:359] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.551015 16682 raft_consensus.cc:385] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.551301 16682 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.546432 16680 tablet_bootstrap.cc:654] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.552110 16682 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.551831 16388 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.561208 16682 ts_tablet_manager.cc:1434] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:06:02.562891 16681 tablet_bootstrap.cc:492] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.563344 16681 ts_tablet_manager.cc:1403] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.002s
I20260709 13:06:02.563627 16682 tablet_bootstrap.cc:492] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.566147 16681 raft_consensus.cc:359] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.566875 16681 raft_consensus.cc:385] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.567157 16681 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.567850 16681 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.569900 16682 tablet_bootstrap.cc:654] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.569995 16681 ts_tablet_manager.cc:1434] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:06:02.570777 16680 tablet_bootstrap.cc:492] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.570955 16681 tablet_bootstrap.cc:492] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.571220 16680 ts_tablet_manager.cc:1403] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:06:02.573873 16680 raft_consensus.cc:359] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.574518 16680 raft_consensus.cc:385] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.574792 16680 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.575531 16680 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.577098 16681 tablet_bootstrap.cc:654] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.577811 16680 ts_tablet_manager.cc:1434] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:02.578724 16680 tablet_bootstrap.cc:492] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.581817 16682 tablet_bootstrap.cc:492] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.582275 16682 ts_tablet_manager.cc:1403] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:06:02.583441 16680 tablet_bootstrap.cc:654] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.585083 16682 raft_consensus.cc:359] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.585755 16682 raft_consensus.cc:385] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.586046 16682 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.586762 16682 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.588752 16682 ts_tablet_manager.cc:1434] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:02.592114 16682 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.593500 16681 tablet_bootstrap.cc:492] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.593937 16681 ts_tablet_manager.cc:1403] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.005s
I20260709 13:06:02.595865 16713 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.596304 16713 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.596632 16684 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.597043 16684 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.598240 16713 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.598805 16684 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.600375 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.600935 16565 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:02.601114 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.601600 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:02.602382 16530 leader_election.cc:343] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.603099 16680 tablet_bootstrap.cc:492] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.603485 16680 ts_tablet_manager.cc:1403] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.009s
I20260709 13:06:02.603971 16681 raft_consensus.cc:359] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.604628 16681 raft_consensus.cc:385] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.604883 16681 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.605652 16681 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.605852 16680 raft_consensus.cc:359] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.606415 16680 raft_consensus.cc:385] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.601562 16682 tablet_bootstrap.cc:654] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.606665 16689 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.607161 16689 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.608161 16681 ts_tablet_manager.cc:1434] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:06:02.608239 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:02.609054 16689 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:02.610071 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.610558 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.610697 16565 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:02.611191 16639 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:02.612192 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.612803 16491 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
W20260709 13:06:02.613464 16530 leader_election.cc:343] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.613871 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.613989 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.609069 16713 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.614784 16713 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.614934 16684 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.615144 16713 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.615646 16689 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.606667 16680 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.616066 16689 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.616570 16681 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.616636 16689 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.623034 16681 tablet_bootstrap.cc:654] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.623760 16680 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.625470 16713 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.627902 16682 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.627883 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:02.628415 16682 ts_tablet_manager.cc:1403] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.005s
I20260709 13:06:02.628484 16565 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.628641 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:02.629208 16639 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.630924 16682 raft_consensus.cc:359] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.631618 16682 raft_consensus.cc:385] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.631896 16682 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.632516 16682 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.633245 16689 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.635187 16689 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:02.635703 16713 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.635354 16639 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:02.636135 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:02.636703 16491 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.636819 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.633044 16680 ts_tablet_manager.cc:1434] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:06:02.638190 16680 tablet_bootstrap.cc:492] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.640852 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:02.641390 16566 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.643250 16680 tablet_bootstrap.cc:654] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.650269 16713 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.650828 16713 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:02.652093 16565 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:02.653239 16566 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:02.651589 16491 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:02.654539 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.651718 16713 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.655884 16689 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.656461 16689 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:02.657308 16689 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.667129 16682 ts_tablet_manager.cc:1434] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.038s	user 0.015s	sys 0.020s
I20260709 13:06:02.666630 16386 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.667968 16681 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.667996 16682 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.668514 16681 ts_tablet_manager.cc:1403] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.003s
I20260709 13:06:02.669824 16684 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.670241 16684 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.670993 16681 raft_consensus.cc:359] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.671640 16681 raft_consensus.cc:385] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.671900 16681 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.672948 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.673512 16491 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:02.673663 16682 tablet_bootstrap.cc:654] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.674765 16680 tablet_bootstrap.cc:492] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.675184 16680 ts_tablet_manager.cc:1403] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.037s	user 0.003s	sys 0.022s
I20260709 13:06:02.675150 16684 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.677631 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:02.677680 16680 raft_consensus.cc:359] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.679641 16681 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.681624 16386 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.682668 16680 raft_consensus.cc:385] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.683211 16684 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.683550 16684 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.683657 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.683907 16684 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.684273 16639 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:02.685951 16681 ts_tablet_manager.cc:1434] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:06:02.686918 16681 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.690412 16684 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.692328 16681 tablet_bootstrap.cc:654] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.692804 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:02.693329 16491 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.682957 16680 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.699011 16680 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.701233 16680 ts_tablet_manager.cc:1434] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 13:06:02.702180 16680 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.704411 16681 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.704944 16708 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.705439 16708 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.707576 16708 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.707823 16680 tablet_bootstrap.cc:654] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.704938 16681 ts_tablet_manager.cc:1403] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 13:06:02.711756 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.710868 16681 raft_consensus.cc:359] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.712466 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.712949 16681 raft_consensus.cc:385] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.713137 16639 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:02.713299 16681 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.712463 16490 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:02.714193 16681 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.721792 16491 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:02.723508 16681 ts_tablet_manager.cc:1434] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:06:02.727113 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:02.727901 16708 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.728245 16708 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.728560 16708 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.731225 16681 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.736145 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:02.736783 16700 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.735450 16708 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.738073 16700 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:02.738660 16708 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.738977 16700 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.739953 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:02.740125 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:02.740479 16490 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.740597 16639 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.747016 16639 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:02.748219 16681 tablet_bootstrap.cc:654] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.748306 16680 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.748840 16680 ts_tablet_manager.cc:1403] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.022s
I20260709 13:06:02.751098 16680 raft_consensus.cc:359] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.747016 16490 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:02.751986 16680 raft_consensus.cc:385] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.752279 16680 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.752794 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.753259 16680 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.753602 16700 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.754076 16700 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:02.754804 16700 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.755738 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:02.756269 16639 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.759706 16681 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.760237 16681 ts_tablet_manager.cc:1403] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 13:06:02.760593 16680 ts_tablet_manager.cc:1434] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:02.761394 16680 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.762910 16639 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:02.751019 16386 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.754828 16684 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.766368 16681 raft_consensus.cc:359] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.766904 16681 raft_consensus.cc:385] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.767108 16681 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.767694 16681 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.768553 16682 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.768981 16682 ts_tablet_manager.cc:1403] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.101s	user 0.047s	sys 0.046s
I20260709 13:06:02.770059 16680 tablet_bootstrap.cc:654] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.771457 16682 raft_consensus.cc:359] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.772115 16682 raft_consensus.cc:385] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.772399 16682 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.773170 16682 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.774905 16682 ts_tablet_manager.cc:1434] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:02.776072 16682 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.781056 16682 tablet_bootstrap.cc:654] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.781867 16389 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.786101 16682 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.786528 16682 ts_tablet_manager.cc:1403] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:06:02.788801 16682 raft_consensus.cc:359] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.789328 16681 ts_tablet_manager.cc:1434] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:06:02.789423 16682 raft_consensus.cc:385] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.789809 16682 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.790501 16682 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.792322 16682 ts_tablet_manager.cc:1434] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:06:02.793133 16682 tablet_bootstrap.cc:492] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.796327 16681 tablet_bootstrap.cc:492] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.800076 16682 tablet_bootstrap.cc:654] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.801678 16681 tablet_bootstrap.cc:654] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.807195 16680 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.807528 16680 ts_tablet_manager.cc:1403] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.015s
I20260709 13:06:02.809617 16680 raft_consensus.cc:359] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.809986 16681 tablet_bootstrap.cc:492] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.810156 16680 raft_consensus.cc:385] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.810418 16681 ts_tablet_manager.cc:1403] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:06:02.810539 16680 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.811038 16682 tablet_bootstrap.cc:492] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.811142 16680 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.811444 16682 ts_tablet_manager.cc:1403] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.010s
I20260709 13:06:02.813107 16680 ts_tablet_manager.cc:1434] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:06:02.812790 16681 raft_consensus.cc:359] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.813472 16681 raft_consensus.cc:385] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.813704 16684 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.813722 16681 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.813979 16680 tablet_bootstrap.cc:492] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.814069 16682 raft_consensus.cc:359] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.814705 16682 raft_consensus.cc:385] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.814469 16684 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.815111 16682 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.815706 16682 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.816629 16684 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.814733 16681 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.818250 16681 ts_tablet_manager.cc:1434] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:06:02.819831 16680 tablet_bootstrap.cc:654] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.819880 16682 ts_tablet_manager.cc:1434] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:06:02.820792 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.821321 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.822048 16682 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
W20260709 13:06:02.823221 16530 leader_election.cc:343] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.823861 16530 leader_election.cc:343] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.824226 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.825224 16684 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.828215 16682 tablet_bootstrap.cc:654] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.830646 16700 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.831020 16680 tablet_bootstrap.cc:492] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.831553 16680 ts_tablet_manager.cc:1403] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:06:02.833993 16680 raft_consensus.cc:359] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.834676 16680 raft_consensus.cc:385] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.831077 16700 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.836391 16700 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.836897 16680 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.837009 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.837626 16491 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:02.837532 16680 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.838860 16682 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.839519 16680 ts_tablet_manager.cc:1434] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 13:06:02.839474 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.839547 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:02.840238 16639 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:02.840440 16700 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.840775 16700 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.840926 16681 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.841109 16700 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.841676 16682 ts_tablet_manager.cc:1403] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 13:06:02.844499 16682 raft_consensus.cc:359] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.845078 16682 raft_consensus.cc:385] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.845306 16682 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.846297 16682 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.847426 16700 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.849341 16700 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.850620 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:02.850951 16682 ts_tablet_manager.cc:1434] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:06:02.851143 16491 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.851750 16682 tablet_bootstrap.cc:492] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.852250 16689 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.852977 16730 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.852711 16689 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.853410 16730 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.854687 16689 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:02.855283 16730 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:02.856734 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.857337 16566 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:02.857560 16682 tablet_bootstrap.cc:654] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.858282 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.858682 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:02.859239 16639 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.859313 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.857403 16491 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
W20260709 13:06:02.860256 16605 leader_election.cc:343] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.860797 16730 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.861140 16730 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.861440 16730 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.864388 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.864748 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.864946 16491 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:02.865741 16639 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
W20260709 13:06:02.866837 16604 leader_election.cc:343] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.867242 16604 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:02.852402 16681 tablet_bootstrap.cc:654] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.867945 16689 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.868399 16700 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.867605 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.870255 16684 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.868216 16680 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.870723 16684 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:02.871522 16684 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.867645 16730 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.877609 16730 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:02.877529 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:02.878130 16491 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.878201 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:02.878738 16565 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.883378 16386 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.884397 16491 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:02.869982 16700 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.885502 16604 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:02.884802 16565 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:02.887403 16730 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.888334 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.888520 16730 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:02.889282 16730 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.891394 16689 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.891470 16684 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:02.891921 16689 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:02.893416 16530 leader_election.cc:343] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.894260 16700 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.895516 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.896775 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:02.897701 16689 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:02.897887 16604 leader_election.cc:343] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:02.899035 16530 leader_election.cc:343] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.899457 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.900758 16700 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.902148 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:02.903421 16605 leader_election.cc:343] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.903936 16605 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:02.904958 16689 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:02.905829 16680 tablet_bootstrap.cc:654] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.911051 16682 tablet_bootstrap.cc:492] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.911441 16682 ts_tablet_manager.cc:1403] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.021s
I20260709 13:06:02.912125 16386 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.914171 16682 raft_consensus.cc:359] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.914814 16682 raft_consensus.cc:385] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.915259 16682 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.916007 16682 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.917896 16682 ts_tablet_manager.cc:1434] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:06:02.918715 16682 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.924041 16682 tablet_bootstrap.cc:654] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.928177 16681 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.928613 16681 ts_tablet_manager.cc:1403] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.005s
I20260709 13:06:02.931013 16681 raft_consensus.cc:359] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.931629 16681 raft_consensus.cc:385] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.932616 16680 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.933070 16680 ts_tablet_manager.cc:1403] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.012s
I20260709 13:06:02.937261 16491 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.937492 16682 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.937876 16682 ts_tablet_manager.cc:1403] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 13:06:02.940178 16682 raft_consensus.cc:359] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.940768 16682 raft_consensus.cc:385] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.940481 16680 raft_consensus.cc:359] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.941051 16682 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.941322 16680 raft_consensus.cc:385] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.941668 16680 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.941684 16682 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.942409 16680 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.944057 16682 ts_tablet_manager.cc:1434] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:02.944521 16680 ts_tablet_manager.cc:1434] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:02.945211 16682 tablet_bootstrap.cc:492] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:02.945766 16680 tablet_bootstrap.cc:492] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.947011 16713 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.947471 16713 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.950311 16684 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:02.950866 16682 tablet_bootstrap.cc:654] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.951382 16680 tablet_bootstrap.cc:654] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.953152 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:02.955945 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:02.957484 16455 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:02.958304 16713 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:02.959307 16681 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.960714 16681 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.970439 16681 ts_tablet_manager.cc:1434] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 13:06:02.976490 16681 tablet_bootstrap.cc:492] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.976945 16680 tablet_bootstrap.cc:492] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:02.977351 16680 ts_tablet_manager.cc:1403] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.016s
I20260709 13:06:02.978989 16680 raft_consensus.cc:359] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.979398 16680 raft_consensus.cc:385] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.979596 16680 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.980115 16680 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.980571 16714 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.985067 16681 tablet_bootstrap.cc:654] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.986068 16680 ts_tablet_manager.cc:1434] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:06:02.986867 16680 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:02.989511 16682 tablet_bootstrap.cc:492] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:02.989899 16682 ts_tablet_manager.cc:1403] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.032s
I20260709 13:06:02.990734 16681 tablet_bootstrap.cc:492] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:02.991113 16681 ts_tablet_manager.cc:1403] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:06:02.992071 16680 tablet_bootstrap.cc:654] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.992220 16682 raft_consensus.cc:359] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.992825 16682 raft_consensus.cc:385] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.993072 16682 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.993340 16681 raft_consensus.cc:359] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.993934 16681 raft_consensus.cc:385] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.993644 16682 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.994172 16681 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.994897 16681 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:02.995772 16682 ts_tablet_manager.cc:1434] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:06:02.996894 16681 ts_tablet_manager.cc:1434] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:06:02.997895 16681 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:02.998557 16684 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.998791 16682 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:03.003839 16684 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.005826 16684 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.006384 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.006973 16490 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.008505 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.009810 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.010350 16639 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.010574 16680 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.010993 16680 ts_tablet_manager.cc:1403] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:06:03.011482 16684 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.011855 16684 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.012178 16684 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.012265 16682 tablet_bootstrap.cc:654] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.013594 16680 raft_consensus.cc:359] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.014210 16680 raft_consensus.cc:385] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.014421 16681 tablet_bootstrap.cc:654] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.014560 16680 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.015555 16680 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.017174 16680 ts_tablet_manager.cc:1434] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:03.017971 16680 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.018455 16684 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.022992 16680 tablet_bootstrap.cc:654] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.023947 16714 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.025553 16684 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.030843 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.031404 16490 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.036468 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.036973 16640 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.038400 16490 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.043395 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.043641 16640 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.044174 16684 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.044786 16684 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:03.045539 16684 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.049202 16681 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.049664 16681 ts_tablet_manager.cc:1403] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.024s
I20260709 13:06:03.051576 16682 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.055477 16682 ts_tablet_manager.cc:1403] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.003s
I20260709 13:06:03.054697 16680 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.056051 16680 ts_tablet_manager.cc:1403] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.008s
I20260709 13:06:03.053310 16681 raft_consensus.cc:359] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.057906 16681 raft_consensus.cc:385] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.058231 16681 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.058382 16682 raft_consensus.cc:359] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.059010 16681 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.059008 16682 raft_consensus.cc:385] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.059974 16386 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.060441 16680 raft_consensus.cc:359] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.061093 16680 raft_consensus.cc:385] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.061849 16681 ts_tablet_manager.cc:1434] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 13:06:03.061342 16680 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.062573 16680 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.064457 16680 ts_tablet_manager.cc:1434] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:03.065212 16680 tablet_bootstrap.cc:492] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.059866 16682 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.066267 16682 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.066643 16713 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.068287 16682 ts_tablet_manager.cc:1434] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:03.069087 16682 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:03.070297 16680 tablet_bootstrap.cc:654] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.072423 16681 tablet_bootstrap.cc:492] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.072330 16713 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:03.106766 16750 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.107306 16750 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.109558 16750 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.109604 16684 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.110176 16684 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.111217 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.112030 16490 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:03.121235 16750 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.123872 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.124601 16564 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 1: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:03.124890 16680 tablet_bootstrap.cc:492] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.125291 16680 ts_tablet_manager.cc:1403] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.010s
I20260709 13:06:03.123490 16730 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.126312 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.128830 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.129047 16730 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:03.130100 16530 leader_election.cc:343] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.129993 16680 raft_consensus.cc:359] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.130728 16680 raft_consensus.cc:385] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.130908 16730 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.131222 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:03.131891 16680 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.132565 16680 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.133050 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.133625 16564 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:03.134267 16680 ts_tablet_manager.cc:1434] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.003s
I20260709 13:06:03.134955 16680 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.135648 16730 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.138187 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.139573 16714 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.140273 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.140882 16490 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
W20260709 13:06:03.141325 16530 leader_election.cc:343] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.141743 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:03.141850 16730 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.142570 16730 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.142869 16730 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.143167 16730 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.144009 16700 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.127808 16684 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.147841 16684 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.149276 16681 tablet_bootstrap.cc:654] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.153822 16714 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.154350 16714 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.156988 16680 tablet_bootstrap.cc:654] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.157490 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.157034 16714 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.158515 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:03.158849 16456 leader_election.cc:343] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:03.159883 16455 leader_election.cc:343] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.160321 16455 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:03.160543 16730 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.161523 16714 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.163151 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.163728 16491 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.164952 16682 tablet_bootstrap.cc:654] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.172371 16750 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.177416 16491 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:03.178467 16604 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.180294 16730 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.180454 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.180876 16681 tablet_bootstrap.cc:492] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.180984 16565 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.180796 16730 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.184422 16730 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:03.185196 16730 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.187191 16565 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:03.187659 16681 ts_tablet_manager.cc:1403] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.115s	user 0.008s	sys 0.017s
I20260709 13:06:03.190091 16681 raft_consensus.cc:359] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.190726 16681 raft_consensus.cc:385] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.190991 16681 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.192829 16682 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.193576 16682 ts_tablet_manager.cc:1403] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.002s
I20260709 13:06:03.194945 16680 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.195393 16680 ts_tablet_manager.cc:1403] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.003s
I20260709 13:06:03.196099 16682 raft_consensus.cc:359] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.196839 16682 raft_consensus.cc:385] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.197369 16682 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.196058 16681 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.197952 16682 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.200572 16681 ts_tablet_manager.cc:1434] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:03.199625 16680 raft_consensus.cc:359] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.201383 16681 tablet_bootstrap.cc:492] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.201741 16684 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.201949 16682 ts_tablet_manager.cc:1434] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:03.203328 16682 tablet_bootstrap.cc:492] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:03.201412 16680 raft_consensus.cc:385] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.204388 16680 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.205109 16680 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.207418 16680 ts_tablet_manager.cc:1434] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:06:03.213894 16714 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.214357 16714 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.217180 16680 tablet_bootstrap.cc:492] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.216930 16684 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.218639 16714 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.219019 16730 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.218416 16684 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.218420 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.221848 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.222697 16639 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.223587 16565 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.224610 16684 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.219427 16730 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.225777 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.226336 16491 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.226788 16730 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.227888 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.227909 16456 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:03.229480 16605 leader_election.cc:343] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.229700 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.230441 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.230656 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.230995 16639 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.231208 16684 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.231601 16684 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.232837 16684 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.232969 16387 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.235160 16714 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.236164 16714 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.236475 16714 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:03.239460 16604 leader_election.cc:343] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.240057 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:03.239859 16708 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.242030 16730 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.239518 16684 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.246235 16684 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.248216 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.249549 16640 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.251469 16714 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.254106 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.254897 16565 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:03.255395 16640 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.256873 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.257555 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.258316 16491 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:03.259142 16708 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.259594 16708 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:03.263971 16708 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.268643 16714 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.269968 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.270730 16639 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:03.271718 16455 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:03.275743 16684 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.275246 16714 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.283525 16680 tablet_bootstrap.cc:654] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.285216 16682 tablet_bootstrap.cc:654] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.289618 16681 tablet_bootstrap.cc:654] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.296397 16681 tablet_bootstrap.cc:492] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.296777 16681 ts_tablet_manager.cc:1403] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.004s
I20260709 13:06:03.299114 16681 raft_consensus.cc:359] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.299721 16681 raft_consensus.cc:385] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.300107 16681 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.301285 16682 tablet_bootstrap.cc:492] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.300400 16389 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.301826 16680 tablet_bootstrap.cc:492] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.301790 16682 ts_tablet_manager.cc:1403] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.005s
I20260709 13:06:03.300800 16681 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.302314 16680 ts_tablet_manager.cc:1403] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.002s
I20260709 13:06:03.303714 16681 ts_tablet_manager.cc:1434] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:03.304595 16680 raft_consensus.cc:359] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.305195 16680 raft_consensus.cc:385] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.305446 16680 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.306180 16682 raft_consensus.cc:359] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.306052 16680 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.306628 16682 raft_consensus.cc:385] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.307427 16682 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.308048 16680 ts_tablet_manager.cc:1434] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:06:03.308467 16681 tablet_bootstrap.cc:492] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.308137 16682 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.308862 16680 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.310089 16682 ts_tablet_manager.cc:1434] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:06:03.311055 16682 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:03.315980 16681 tablet_bootstrap.cc:654] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.323015 16682 tablet_bootstrap.cc:654] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.326227 16680 tablet_bootstrap.cc:654] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.329881 16681 tablet_bootstrap.cc:492] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.330299 16681 ts_tablet_manager.cc:1403] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:06:03.330634 16682 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.330557 16708 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.331019 16682 ts_tablet_manager.cc:1403] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.008s
I20260709 13:06:03.331048 16708 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.332587 16681 raft_consensus.cc:359] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.333033 16680 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.333060 16708 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.333218 16681 raft_consensus.cc:385] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.333653 16681 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.333804 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.334208 16681 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.334985 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:03.335196 16530 leader_election.cc:343] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.335209 16682 raft_consensus.cc:359] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.335971 16682 raft_consensus.cc:385] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.336243 16682 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.333799 16680 ts_tablet_manager.cc:1403] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.003s
W20260709 13:06:03.336530 16530 leader_election.cc:343] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.336969 16530 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:03.336946 16682 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.339016 16681 ts_tablet_manager.cc:1434] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:06:03.338829 16680 raft_consensus.cc:359] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.339417 16680 raft_consensus.cc:385] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.339651 16680 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.339834 16681 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.340346 16680 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.341185 16684 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.342337 16682 ts_tablet_manager.cc:1434] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:03.343138 16682 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:03.346478 16680 ts_tablet_manager.cc:1434] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:06:03.347260 16680 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.348366 16682 tablet_bootstrap.cc:654] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.348767 16681 tablet_bootstrap.cc:654] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.352504 16680 tablet_bootstrap.cc:654] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.363440 16680 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.363924 16680 ts_tablet_manager.cc:1403] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:06:03.366547 16680 raft_consensus.cc:359] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.367218 16680 raft_consensus.cc:385] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.367472 16680 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.368228 16680 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.371836 16681 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.372233 16681 ts_tablet_manager.cc:1403] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.012s
I20260709 13:06:03.373087 16682 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.373215 16680 ts_tablet_manager.cc:1434] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:03.373487 16682 ts_tablet_manager.cc:1403] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.011s
I20260709 13:06:03.374002 16680 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.374500 16681 raft_consensus.cc:359] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.375110 16681 raft_consensus.cc:385] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.375350 16681 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.375829 16682 raft_consensus.cc:359] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.376456 16682 raft_consensus.cc:385] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.376101 16681 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.376747 16682 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.377501 16682 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.379514 16680 tablet_bootstrap.cc:654] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.383014 16681 ts_tablet_manager.cc:1434] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:06:03.386027 16682 ts_tablet_manager.cc:1434] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:06:03.386281 16730 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.386845 16682 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:03.386686 16730 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.386842 16708 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.388509 16681 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.390363 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.390956 16565 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:03.392023 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.392264 16730 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.392655 16682 tablet_bootstrap.cc:654] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.392072 16605 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.392660 16491 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:03.394413 16681 tablet_bootstrap.cc:654] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.397099 16776 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.393417 16730 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.398334 16730 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.398640 16730 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.406638 16681 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.407126 16681 ts_tablet_manager.cc:1403] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:06:03.409853 16681 raft_consensus.cc:359] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.410907 16681 raft_consensus.cc:385] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.411173 16681 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.411440 16730 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.412303 16682 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.411891 16681 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.412736 16682 ts_tablet_manager.cc:1403] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.008s
I20260709 13:06:03.414022 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.414569 16490 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.415697 16682 raft_consensus.cc:359] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.416309 16682 raft_consensus.cc:385] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.416610 16682 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.416389 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.417523 16565 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.418246 16708 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.418462 16681 ts_tablet_manager.cc:1434] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:03.423707 16565 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:03.424669 16605 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.424989 16681 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.425454 16689 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.425916 16682 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.418722 16708 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.416709 16730 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.425881 16689 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:03.440300 16713 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.440732 16713 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.441336 16689 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.442548 16713 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.442870 16708 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.444175 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.444810 16565 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.445089 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.446295 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:03.446872 16455 leader_election.cc:343] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.447862 16713 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.448212 16713 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.448513 16713 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.429108 16490 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:03.452522 16684 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.456167 16775 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:03.461743 16682 ts_tablet_manager.cc:1434] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
I20260709 13:06:03.463037 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.464339 16682 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
W20260709 13:06:03.465257 16530 leader_election.cc:343] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.471100 16714 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.482730 16680 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.483208 16680 ts_tablet_manager.cc:1403] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.002s
I20260709 13:06:03.467135 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.477576 16714 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.534606 16801 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.535089 16801 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.537825 16681 tablet_bootstrap.cc:654] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.537147 16387 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:03.542686 16530 leader_election.cc:343] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.543157 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:03.544826 16700 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.531867 16713 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.546334 16700 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.549757 16682 tablet_bootstrap.cc:654] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.551573 16713 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.551996 16714 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:03.546886 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:03.553500 16689 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.560817 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.552225 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.552155 16801 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.561754 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.562633 16564 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.562951 16563 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.563841 16456 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.565231 16689 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.566879 16689 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.567075 16700 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.568164 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.568447 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.568913 16456 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.569463 16566 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:03.569690 16605 leader_election.cc:343] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.570107 16714 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.570595 16714 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:03.573792 16604 leader_election.cc:343] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.570971 16714 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.574193 16604 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:03.574928 16689 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.576263 16689 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.569614 16801 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.580183 16801 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.580576 16801 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.585950 16714 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.584717 16700 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.588632 16684 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.587755 16714 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.588658 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.589541 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.589901 16563 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.588820 16700 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.593135 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.589083 16684 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.595163 16637 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.597271 16681 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.597679 16681 ts_tablet_manager.cc:1403] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.173s	user 0.011s	sys 0.007s
I20260709 13:06:03.598371 16680 raft_consensus.cc:359] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.600072 16680 raft_consensus.cc:385] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.600330 16680 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.602227 16681 raft_consensus.cc:359] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.602885 16681 raft_consensus.cc:385] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.600800 16680 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.604171 16681 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.606058 16737 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.607120 16737 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.607738 16566 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:03.609225 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.609794 16490 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.610236 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.609251 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.649467 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.689704 16681 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.625315 16680 ts_tablet_manager.cc:1434] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.142s	user 0.012s	sys 0.000s
I20260709 13:06:03.692108 16680 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:03.655370 16563 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:03.612510 16455 leader_election.cc:343] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.692974 16682 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.693394 16682 ts_tablet_manager.cc:1403] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.231s	user 0.018s	sys 0.010s
W20260709 13:06:03.693313 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 87126.1us
I20260709 13:06:03.692416 16776 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.658627 16802 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.639416 16684 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.692420 16491 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.641330 16737 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.697896 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.697104 16776 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.695070 16775 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.701297 16681 ts_tablet_manager.cc:1434] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.001s
I20260709 13:06:03.702134 16681 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.703539 16802 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:03.704687 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.705227 16456 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.704622 16776 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.713567 16730 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.698369 16700 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.706163 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.713915 16714 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.714190 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.714330 16638 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.714396 16714 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:03.706499 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.707976 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.699172 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.708467 16775 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:03.710381 16455 leader_election.cc:343] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.710686 16682 raft_consensus.cc:359] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.712037 16737 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.716235 16714 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.717764 16639 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.717659 16802 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.716828 16700 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.720515 16682 raft_consensus.cc:385] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.729089 16682 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.729842 16700 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.730103 16775 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.730243 16700 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:03.731496 16604 leader_election.cc:343] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:03.731679 16530 leader_election.cc:343] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.732669 16681 tablet_bootstrap.cc:654] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.733752 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.712649 16801 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.723742 16737 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.739046 16680 tablet_bootstrap.cc:654] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:03.740031 16605 leader_election.cc:343] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.741076 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:03.741422 16455 leader_election.cc:343] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:03.741989 16737 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.754163 16682 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.743665 16776 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.743660 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.758067 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.759315 16637 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.748656 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.749948 16801 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.759269 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.764534 16565 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:03.758215 16708 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.762914 16638 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.769961 16682 ts_tablet_manager.cc:1434] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.001s
I20260709 13:06:03.770903 16682 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:03.766150 16708 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.774436 16708 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.774998 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.765179 16491 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:03.774850 16737 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.775574 16563 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.775007 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.779228 16775 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.779592 16775 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.779948 16775 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.789691 16700 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.791319 16637 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:03.791487 16700 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.792425 16737 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.792519 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.793303 16801 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.795198 16801 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:03.796047 16801 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.797005 16389 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.797683 16775 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.798739 16389 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.801301 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.801854 16491 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.802313 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.802924 16565 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.804420 16563 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:03.806036 16775 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:03.824296 16802 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.854677 16802 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.856266 16681 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.856712 16681 ts_tablet_manager.cc:1403] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.004s
I20260709 13:06:03.858805 16714 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.858899 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.856704 16802 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.859265 16714 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.860736 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.861150 16714 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.861315 16637 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:03.859483 16563 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:03.869503 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:03.869694 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.870087 16566 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.879136 16456 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.879575 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.888573 16637 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:03.879068 16714 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.889601 16714 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.889253 16802 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.890321 16802 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.889938 16714 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.891264 16802 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.897570 16714 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.828128 16491 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:03.900475 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.900991 16566 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.901130 16604 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.901993 16689 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.902426 16689 raft_consensus.cc:697] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:03.903209 16689 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.904697 16565 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
W20260709 13:06:03.905139 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 143256us
I20260709 13:06:03.916067 16389 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.917711 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:03.908689 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.918339 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.919319 16489 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.921626 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.922217 16636 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.923327 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.923866 16639 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.924082 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:03.924629 16638 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:03.925331 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:03.918591 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.926187 16490 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.926132 16386 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.931499 16639 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.932709 16684 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.933562 16637 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.933746 16684 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.933933 16809 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.937497 16809 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.941962 16636 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.909472 16681 raft_consensus.cc:359] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.944029 16681 raft_consensus.cc:385] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.944301 16681 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.909058 16714 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.945034 16681 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.945079 16489 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.946239 16684 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.912267 16680 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:03.906853 16566 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:03.947031 16637 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:03.949241 16490 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.916941 16689 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.948637 16681 ts_tablet_manager.cc:1434] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.092s	user 0.004s	sys 0.019s
I20260709 13:06:03.949860 16530 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.951983 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.953930 16681 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:03.948714 16680 ts_tablet_manager.cc:1403] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.257s	user 0.008s	sys 0.008s
I20260709 13:06:03.954195 16815 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.954813 16815 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:03.948918 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:03.956405 16815 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.957238 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.958009 16737 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.958451 16737 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:03.959169 16737 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.960904 16684 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.961696 16714 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.953024 16809 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.962387 16809 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.962750 16809 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.962756 16714 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:03.964694 16776 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.964675 16714 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.911705 16682 tablet_bootstrap.cc:654] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.969147 16681 tablet_bootstrap.cc:654] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:03.942610 16802 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.974650 16684 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.975023 16802 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:03.975196 16488 raft_consensus.cc:2393] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:03.956601 16680 raft_consensus.cc:359] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.975625 16680 raft_consensus.cc:385] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.975260 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:03.977524 16809 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.978593 16565 raft_consensus.cc:2393] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:03.978587 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.979933 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:03.980124 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:03.980487 16636 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.980589 16488 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.980630 16637 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.986810 16682 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:03.987206 16682 ts_tablet_manager.cc:1403] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.216s	user 0.011s	sys 0.001s
I20260709 13:06:03.987674 16637 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:03.989648 16682 raft_consensus.cc:359] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.989905 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:03.990262 16682 raft_consensus.cc:385] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:03.990574 16682 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.990752 16713 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.991180 16713 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:03.991758 16488 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:03.992002 16713 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.993640 16682 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.994341 16681 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:03.994719 16681 ts_tablet_manager.cc:1403] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:06:03.975925 16680 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.996553 16682 ts_tablet_manager.cc:1434] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:06:03.995992 16680 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:03.997388 16682 tablet_bootstrap.cc:492] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.000872 16681 raft_consensus.cc:359] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.001468 16681 raft_consensus.cc:385] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.001715 16681 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.002385 16681 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.003545 16682 tablet_bootstrap.cc:654] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.003823 16775 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.004237 16775 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.006098 16775 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.006729 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.007439 16488 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:04.008656 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:04.009472 16775 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.009815 16775 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.010146 16775 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.004238 16681 ts_tablet_manager.cc:1434] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:04.014279 16682 tablet_bootstrap.cc:492] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.014686 16682 ts_tablet_manager.cc:1403] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:06:04.015600 16681 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.017019 16682 raft_consensus.cc:359] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.017776 16682 raft_consensus.cc:385] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.017998 16682 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.017164 16775 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.019618 16775 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.020284 16682 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.021960 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:04.022193 16682 ts_tablet_manager.cc:1434] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:06:04.022488 16488 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.023512 16682 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.025353 16681 tablet_bootstrap.cc:654] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.028132 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:04.028584 16488 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:04.028692 16563 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.029079 16682 tablet_bootstrap.cc:654] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.029114 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.033200 16680 ts_tablet_manager.cc:1434] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.000s
I20260709 13:06:04.034101 16680 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:04.035465 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:04.036629 16737 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.039243 16737 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:04.039697 16563 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:04.040081 16737 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.041136 16809 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.044996 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:04.045195 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:04.046957 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:04.046795 16389 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 2, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.047674 16637 raft_consensus.cc:2393] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:04.050539 16530 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:04.050658 16389 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.051255 16682 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.051255 16815 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.051859 16689 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.052220 16682 ts_tablet_manager.cc:1403] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 13:06:04.052491 16689 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:04.053287 16689 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.054164 16681 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.054600 16681 ts_tablet_manager.cc:1403] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.008s
I20260709 13:06:04.054768 16682 raft_consensus.cc:359] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.055364 16682 raft_consensus.cc:385] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.055621 16682 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.056313 16682 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.057219 16681 raft_consensus.cc:359] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.057849 16681 raft_consensus.cc:385] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.058190 16681 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.058458 16682 ts_tablet_manager.cc:1434] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:04.059259 16682 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.058883 16681 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.061067 16681 ts_tablet_manager.cc:1434] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:04.061934 16681 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.065091 16682 tablet_bootstrap.cc:654] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.066119 16386 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.070479 16386 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.079727 16681 tablet_bootstrap.cc:654] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.084501 16682 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.084921 16682 ts_tablet_manager.cc:1403] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:06:04.087666 16682 raft_consensus.cc:359] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.088266 16682 raft_consensus.cc:385] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.088450 16681 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.088532 16682 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.089089 16681 ts_tablet_manager.cc:1403] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.005s
I20260709 13:06:04.089339 16682 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.091482 16682 ts_tablet_manager.cc:1434] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:04.091579 16681 raft_consensus.cc:359] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.092316 16682 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.092360 16681 raft_consensus.cc:385] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.092801 16681 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.093962 16681 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.096127 16681 ts_tablet_manager.cc:1434] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:04.097332 16681 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.098016 16682 tablet_bootstrap.cc:654] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.103000 16681 tablet_bootstrap.cc:654] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.109279 16682 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.109920 16682 ts_tablet_manager.cc:1403] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:06:04.112366 16682 raft_consensus.cc:359] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.112982 16682 raft_consensus.cc:385] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.113236 16682 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.114018 16682 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.114370 16681 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.114933 16681 ts_tablet_manager.cc:1403] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:06:04.116158 16682 ts_tablet_manager.cc:1434] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:04.116981 16682 tablet_bootstrap.cc:492] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.117687 16681 raft_consensus.cc:359] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.118431 16681 raft_consensus.cc:385] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.119040 16681 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.119745 16681 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.121915 16681 ts_tablet_manager.cc:1434] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:04.122732 16681 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.122768 16682 tablet_bootstrap.cc:654] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.126223 16713 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.126696 16713 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.128867 16713 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.130306 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.131198 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.131553 16681 tablet_bootstrap.cc:654] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:04.131675 16456 leader_election.cc:343] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.131860 16639 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:04.133229 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:04.132933 16387 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.134332 16713 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.134711 16713 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.135046 16713 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.142355 16713 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.051542 16636 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:04.150164 16680 tablet_bootstrap.cc:654] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.152012 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:04.153225 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:04.154511 16636 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:04.155138 16456 leader_election.cc:343] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.153640 16713 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.153808 16681 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.153654 16682 tablet_bootstrap.cc:492] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.156116 16681 ts_tablet_manager.cc:1403] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.006s
I20260709 13:06:04.156153 16682 ts_tablet_manager.cc:1403] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.004s
I20260709 13:06:04.158854 16682 raft_consensus.cc:359] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.159515 16682 raft_consensus.cc:385] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.162889 16682 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.163556 16682 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.164748 16689 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.165431 16682 ts_tablet_manager.cc:1434] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:06:04.165180 16636 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:04.166281 16682 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.166481 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:04.166525 16386 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.167682 16713 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.169459 16713 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:04.161422 16681 raft_consensus.cc:359] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.170230 16681 raft_consensus.cc:385] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.170537 16681 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.170303 16713 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.171254 16681 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.171866 16682 tablet_bootstrap.cc:654] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.165166 16689 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.173170 16681 ts_tablet_manager.cc:1434] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:06:04.174187 16689 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.176118 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.177992 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:04.180370 16605 leader_election.cc:343] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.174031 16681 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Bootstrap starting.
W20260709 13:06:04.182124 16604 leader_election.cc:343] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.182610 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:04.185416 16802 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.186124 16680 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:04.185554 16689 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.191980 16680 ts_tablet_manager.cc:1403] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.158s	user 0.014s	sys 0.003s
I20260709 13:06:04.193940 16681 tablet_bootstrap.cc:654] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.194389 16680 raft_consensus.cc:359] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.195014 16680 raft_consensus.cc:385] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.195308 16680 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.195082 16386 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.199321 16682 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.199766 16682 ts_tablet_manager.cc:1403] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.005s
I20260709 13:06:04.201398 16680 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.202327 16682 raft_consensus.cc:359] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.202970 16682 raft_consensus.cc:385] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.203223 16682 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.204885 16680 ts_tablet_manager.cc:1434] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:06:04.205770 16680 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:04.203852 16682 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.209196 16775 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.209646 16775 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.212762 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.211572 16775 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.214845 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.218534 16682 ts_tablet_manager.cc:1434] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.005s
I20260709 13:06:04.218627 16636 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:04.218869 16604 leader_election.cc:343] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:04.219739 16605 leader_election.cc:343] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.220171 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:04.222018 16689 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.222306 16681 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.222703 16681 ts_tablet_manager.cc:1403] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.020s
I20260709 13:06:04.220391 16682 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.225080 16713 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.225821 16681 raft_consensus.cc:359] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.226441 16681 raft_consensus.cc:385] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.226693 16681 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.226789 16815 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.227375 16815 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.227497 16681 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.229393 16815 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.229921 16682 tablet_bootstrap.cc:654] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.229960 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.232751 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.233431 16639 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:04.234000 16801 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.235052 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:04.236016 16815 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.238669 16680 tablet_bootstrap.cc:654] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.243418 16815 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.244776 16681 ts_tablet_manager.cc:1434] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:06:04.245604 16681 tablet_bootstrap.cc:492] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.254320 16681 tablet_bootstrap.cc:654] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.255846 16801 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.256063 16714 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.257855 16714 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.260790 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:04.262399 16456 leader_election.cc:343] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.263084 16714 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.268523 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.269091 16639 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:04.269553 16682 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.269974 16682 ts_tablet_manager.cc:1403] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.008s
I20260709 13:06:04.270570 16455 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:04.271440 16714 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.271777 16714 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.272105 16714 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.272387 16682 raft_consensus.cc:359] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.272991 16682 raft_consensus.cc:385] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.273259 16682 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.273810 16682 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.290138 16682 ts_tablet_manager.cc:1434] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:04.290951 16682 tablet_bootstrap.cc:492] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.298825 16636 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.299003 16714 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.307369 16802 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.307497 16713 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.308084 16713 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.309238 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:04.310667 16456 leader_election.cc:343] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.310590 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:04.311321 16639 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.313174 16681 tablet_bootstrap.cc:492] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.313717 16681 ts_tablet_manager.cc:1403] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.003s
I20260709 13:06:04.315380 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.316458 16682 tablet_bootstrap.cc:654] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.318395 16689 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.318822 16689 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:04.319615 16456 leader_election.cc:343] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.320741 16689 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.320519 16681 raft_consensus.cc:359] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.321152 16681 raft_consensus.cc:385] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.321395 16681 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.321951 16681 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.323132 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.324307 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.328859 16681 ts_tablet_manager.cc:1434] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:06:04.329795 16681 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.306998 16714 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.322820 16802 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:04.330824 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:04.332026 16605 leader_election.cc:343] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.332325 16489 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:04.313325 16713 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.334673 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:04.333551 16636 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:04.336843 16680 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:04.337896 16689 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.338275 16689 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.338526 16681 tablet_bootstrap.cc:654] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.338596 16689 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.341044 16639 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:04.346312 16775 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.346798 16775 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.374964 16689 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.375880 16776 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.376391 16776 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.378479 16776 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.380470 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.381201 16488 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:04.382570 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:04.384069 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:04.385464 16605 leader_election.cc:343] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.409236 16680 ts_tablet_manager.cc:1403] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.204s	user 0.025s	sys 0.052s
I20260709 13:06:04.419771 16775 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.419107 16563 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:04.390508 16776 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.428032 16730 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.431406 16730 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.433295 16730 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.433815 16776 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.434173 16776 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.434732 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.439458 16737 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.440361 16713 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.445768 16635 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:04.445559 16680 raft_consensus.cc:359] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.446221 16680 raft_consensus.cc:385] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:04.446286 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 60861.2us
I20260709 13:06:04.446542 16680 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.447388 16680 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.447942 16682 tablet_bootstrap.cc:492] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.448359 16682 ts_tablet_manager.cc:1403] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.004s
I20260709 13:06:04.448791 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.449165 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.450790 16682 raft_consensus.cc:359] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.452143 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.452423 16682 raft_consensus.cc:385] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.452685 16682 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.453284 16682 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.455281 16682 ts_tablet_manager.cc:1434] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:06:04.455551 16605 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:04.393077 16815 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:06:04.427759 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:04.458283 16455 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:04.458961 16802 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.459295 16802 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.459620 16802 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.460484 16682 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.464535 16714 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.464645 16680 ts_tablet_manager.cc:1434] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.043s	user 0.013s	sys 0.013s
I20260709 13:06:04.465035 16714 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:04.466135 16680 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:04.465842 16714 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.467878 16682 tablet_bootstrap.cc:654] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.467947 16801 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.473281 16681 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.473685 16681 ts_tablet_manager.cc:1403] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.144s	user 0.044s	sys 0.039s
I20260709 13:06:04.474071 16802 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.476105 16681 raft_consensus.cc:359] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.476531 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:04.476727 16681 raft_consensus.cc:385] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.477007 16681 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
W20260709 13:06:04.477833 16456 leader_election.cc:343] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.477614 16681 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.477639 16680 tablet_bootstrap.cc:654] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.482482 16713 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.482965 16713 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.485430 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.486020 16565 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:04.487188 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:04.487931 16801 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.488344 16801 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.488703 16801 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.488377 16680 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
W20260709 13:06:04.489367 16604 leader_election.cc:343] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.489843 16680 ts_tablet_manager.cc:1403] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:06:04.492305 16681 ts_tablet_manager.cc:1434] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.006s
I20260709 13:06:04.492260 16680 raft_consensus.cc:359] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.493227 16680 raft_consensus.cc:385] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.493324 16681 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.495127 16801 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.493526 16680 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.496894 16680 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.497270 16801 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.498931 16680 ts_tablet_manager.cc:1434] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:06:04.501173 16689 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.503099 16680 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:04.505522 16775 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.506417 16681 tablet_bootstrap.cc:654] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.514637 16802 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.515667 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:04.516435 16488 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:04.517891 16713 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.519614 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:04.520157 16563 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.521579 16864 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.522066 16864 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.526821 16563 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:04.511650 16680 tablet_bootstrap.cc:654] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.529986 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:04.531165 16862 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.537691 16862 raft_consensus.cc:697] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:04.538746 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.538559 16862 consensus_queue.cc:237] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.540812 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:04.541378 16635 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.543272 16737 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.549196 16635 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:04.550616 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 95140.7us
W20260709 13:06:04.551295 16605 leader_election.cc:343] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.551714 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:04.555905 16730 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.572942 16862 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.573596 16857 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.577988 16714 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.596125 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.596714 16635 raft_consensus.cc:2376] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1. Re-sending same reply.
I20260709 13:06:04.591562 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:04.605062 16639 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:04.619976 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:04.616580 16864 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.647080 16862 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.660322 16680 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:04.660802 16680 ts_tablet_manager.cc:1403] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.158s	user 0.023s	sys 0.013s
I20260709 13:06:04.669389 16680 raft_consensus.cc:359] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.670022 16680 raft_consensus.cc:385] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.671260 16680 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.671872 16680 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.673779 16680 ts_tablet_manager.cc:1434] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:06:04.674640 16680 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:04.651705 16776 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.687423 16776 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.687577 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:04.688517 16488 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.690966 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:04.696408 16809 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.584157 16714 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.699144 16862 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.709029 16815 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.711742 16809 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:04.713613 16680 tablet_bootstrap.cc:654] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.715102 16682 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.715592 16682 ts_tablet_manager.cc:1403] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.260s	user 0.031s	sys 0.081s
I20260709 13:06:04.715142 16488 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:04.718016 16682 raft_consensus.cc:359] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.718461 16682 raft_consensus.cc:385] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.718652 16682 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.719134 16682 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.721077 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:04.727173 16682 ts_tablet_manager.cc:1434] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:04.727715 16776 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.728107 16682 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.730312 16801 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.730762 16776 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:04.732044 16776 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.734705 16681 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.735574 16714 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.735852 16682 tablet_bootstrap.cc:654] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.736239 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.736794 16681 ts_tablet_manager.cc:1403] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.244s	user 0.054s	sys 0.043s
W20260709 13:06:04.737658 16456 leader_election.cc:343] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.741218 16681 raft_consensus.cc:359] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.741880 16681 raft_consensus.cc:385] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.742179 16681 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.742823 16681 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.745391 16681 ts_tablet_manager.cc:1434] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:06:04.746322 16681 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.754261 16815 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.754714 16815 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.756632 16815 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.764802 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.770740 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.768708 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.762820 16815 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.775468 16640 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:04.785177 16860 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.785507 16809 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.786327 16809 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.775158 16815 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.786075 16860 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.790011 16860 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.784593 16714 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:06:04.791299 16455 leader_election.cc:343] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.791639 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.797907 16864 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.798642 16682 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:04.798854 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:04.799234 16682 ts_tablet_manager.cc:1403] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.008s
I20260709 13:06:04.801172 16813 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.802693 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.791724 16455 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:04.804677 16714 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:04.806989 16456 leader_election.cc:343] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:04.808106 16530 leader_election.cc:343] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.811632 16682 raft_consensus.cc:359] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.812304 16682 raft_consensus.cc:385] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.812561 16682 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.813159 16682 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:04.815418 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 264140us
I20260709 13:06:04.817238 16682 ts_tablet_manager.cc:1434] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:06:04.818044 16682 tablet_bootstrap.cc:492] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:04.818665 16864 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.819095 16864 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.819604 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:04.821820 16864 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.822623 16680 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:04.823107 16815 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.823439 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.823764 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.823119 16681 tablet_bootstrap.cc:654] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.824330 16637 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:04.832621 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:06:04.826006 16604 leader_election.cc:343] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.826166 16813 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.826725 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.823041 16680 ts_tablet_manager.cc:1403] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.149s	user 0.006s	sys 0.015s
I20260709 13:06:04.824746 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.840801 16680 raft_consensus.cc:359] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.841238 16680 raft_consensus.cc:385] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.841430 16680 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.841883 16680 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.843178 16680 ts_tablet_manager.cc:1434] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:06:04.837268 16860 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.844012 16860 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.844338 16860 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.845160 16680 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:04.848644 16809 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.864952 16809 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.849247 16636 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:04.865420 16809 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.867391 16809 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.845002 16488 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:04.901146 16681 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:04.902210 16681 ts_tablet_manager.cc:1403] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.156s	user 0.005s	sys 0.011s
I20260709 13:06:04.884289 16388 catalog_manager.cc:5697] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.904186 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:04.895605 16860 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.903476 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.904979 16635 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:04.905611 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:04.906665 16636 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:04.908636 16864 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.909662 16864 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.906494 16809 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.910498 16809 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.909911 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.910825 16809 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.911861 16864 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.912583 16565 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:04.906347 16388 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.913563 16681 raft_consensus.cc:359] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.912508 16860 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.918183 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.918113 16809 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.920485 16809 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.914054 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:04.921463 16605 leader_election.cc:343] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.907948 16682 tablet_bootstrap.cc:654] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.914753 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:04.920384 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:04.922425 16635 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.922550 16489 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:04.922818 16737 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.923161 16737 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.923550 16737 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.914212 16681 raft_consensus.cc:385] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.924439 16681 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.925076 16681 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.925491 16860 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:04.925966 16490 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:04.921866 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:04.932974 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:04.934218 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:04.934876 16813 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.936295 16604 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:04.937444 16776 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:04.937776 16776 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.938112 16776 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.939060 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:04.939625 16636 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.940733 16813 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:04.942044 16530 leader_election.cc:343] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:04.947225 16864 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:04.950726 16776 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.951843 16636 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:04.954568 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:04.955245 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:04.956529 16813 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.957562 16813 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:04.957973 16776 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:04.943408 16635 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:04.959458 16680 tablet_bootstrap.cc:654] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.958372 16813 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.961683 16681 ts_tablet_manager.cc:1434] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.059s	user 0.002s	sys 0.003s
I20260709 13:06:04.962617 16681 tablet_bootstrap.cc:492] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:04.963855 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:04.964395 16490 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.938287 16737 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.967151 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:04.970306 16860 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.971848 16860 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:04.972288 16737 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:04.976619 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:04.977209 16489 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.981272 16864 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.984763 16490 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:04.985930 16604 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:04.986405 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:04.986747 16864 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.987620 16864 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:04.973196 16776 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:06:04.989148 16864 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.972574 16860 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:04.987319 16489 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:05.009903 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:05.013229 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:05.014333 16682 tablet_bootstrap.cc:492] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.014770 16682 ts_tablet_manager.cc:1403] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.011s
I20260709 13:06:05.011607 16809 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.031538 16682 raft_consensus.cc:359] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.032114 16682 raft_consensus.cc:385] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.032310 16682 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.032773 16682 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.034158 16682 ts_tablet_manager.cc:1434] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:06:05.034793 16682 tablet_bootstrap.cc:492] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:05.015556 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:05.015828 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.015604 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:05.043208 16639 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.051148 16681 tablet_bootstrap.cc:654] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.052412 16386 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.037791 16809 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:05.040004 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:05.045075 16864 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:05.042955 16605 leader_election.cc:343] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.059499 16809 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.096019 16682 tablet_bootstrap.cc:654] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.068819 16639 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:05.114283 16860 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:05.117923 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 75018.6us
W20260709 13:06:05.121662 16605 leader_election.cc:343] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.122081 16605 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:05.122781 16870 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:05.127480 16456 leader_election.cc:343] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.128427 16680 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:05.128882 16680 ts_tablet_manager.cc:1403] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.285s	user 0.012s	sys 0.005s
W20260709 13:06:05.129117 16605 leader_election.cc:343] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.131243 16680 raft_consensus.cc:359] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.131878 16680 raft_consensus.cc:385] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.132133 16680 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.132766 16680 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.134673 16680 ts_tablet_manager.cc:1434] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:06:05.135548 16680 tablet_bootstrap.cc:492] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:05.141639 16681 tablet_bootstrap.cc:492] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:05.142081 16681 ts_tablet_manager.cc:1403] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.014s
I20260709 13:06:05.144475 16681 raft_consensus.cc:359] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.144601 16860 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.145119 16681 raft_consensus.cc:385] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.145411 16681 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.145998 16681 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.147495 16682 tablet_bootstrap.cc:492] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.148088 16680 tablet_bootstrap.cc:654] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.148149 16682 ts_tablet_manager.cc:1403] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.005s
I20260709 13:06:05.148793 16681 ts_tablet_manager.cc:1434] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:05.166286 16682 raft_consensus.cc:359] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.167012 16682 raft_consensus.cc:385] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.167150 16681 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:05.167268 16682 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.152992 16776 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
W20260709 13:06:05.152812 16605 leader_election.cc:343] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.180083 16389 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.185573 16860 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.186023 16860 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.188612 16860 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.189661 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:05.190243 16637 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:05.192065 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.193459 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:05.190375 16681 tablet_bootstrap.cc:654] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.194221 16862 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.194556 16862 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.194893 16862 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.202656 16862 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.203608 16682 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.205722 16860 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.206221 16682 ts_tablet_manager.cc:1434] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:06:05.207070 16682 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
W20260709 13:06:05.212132 16456 leader_election.cc:343] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.221470 16386 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.233762 16681 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:05.234252 16681 ts_tablet_manager.cc:1403] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.067s	user 0.006s	sys 0.007s
I20260709 13:06:05.236994 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:05.240221 16605 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.241155 16680 tablet_bootstrap.cc:492] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:05.241592 16680 ts_tablet_manager.cc:1403] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.012s
I20260709 13:06:05.249328 16388 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.249264 16862 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.251096 16681 raft_consensus.cc:359] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.251753 16681 raft_consensus.cc:385] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.252033 16681 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.253088 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:05.253708 16681 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:05.248898 16456 leader_election.cc:343] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.253631 16637 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.265265 16681 ts_tablet_manager.cc:1434] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:06:05.266304 16681 tablet_bootstrap.cc:492] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:05.267995 16682 tablet_bootstrap.cc:654] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.273814 16637 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:05.274901 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:05.276223 16801 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.286499 16680 raft_consensus.cc:359] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.287207 16680 raft_consensus.cc:385] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.287460 16680 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.287818 16389 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.293779 16681 tablet_bootstrap.cc:654] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.299729 16680 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.301335 16680 ts_tablet_manager.cc:1434] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:06:05.302196 16680 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:05.321640 16680 tablet_bootstrap.cc:654] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.335322 16801 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:05.336268 16801 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.339996 16682 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.340430 16682 ts_tablet_manager.cc:1403] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.134s	user 0.037s	sys 0.021s
I20260709 13:06:05.341838 16681 tablet_bootstrap.cc:492] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:05.342310 16681 ts_tablet_manager.cc:1403] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.003s
I20260709 13:06:05.342748 16682 raft_consensus.cc:359] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.343379 16682 raft_consensus.cc:385] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.343626 16682 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.344250 16682 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.345927 16680 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:05.346365 16680 ts_tablet_manager.cc:1403] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:06:05.348750 16680 raft_consensus.cc:359] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.349387 16680 raft_consensus.cc:385] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.349568 16682 ts_tablet_manager.cc:1434] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:05.349639 16680 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.350487 16682 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:05.350417 16680 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.353233 16681 raft_consensus.cc:359] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.353863 16681 raft_consensus.cc:385] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.354120 16681 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.354722 16681 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.356773 16682 tablet_bootstrap.cc:654] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.356884 16681 ts_tablet_manager.cc:1434] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:06:05.357865 16681 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:05.360759 16680 ts_tablet_manager.cc:1434] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:06:05.361682 16680 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:05.370215 16680 tablet_bootstrap.cc:654] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.375869 16682 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.375903 16681 tablet_bootstrap.cc:654] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.376384 16682 ts_tablet_manager.cc:1403] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 13:06:05.377136 16387 catalog_manager.cc:5697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.378970 16682 raft_consensus.cc:359] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.379607 16682 raft_consensus.cc:385] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.379884 16682 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.380656 16682 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.382292 16680 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:05.382685 16680 ts_tablet_manager.cc:1403] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:06:05.385002 16680 raft_consensus.cc:359] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.385568 16680 raft_consensus.cc:385] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.385818 16680 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.386687 16682 ts_tablet_manager.cc:1434] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:06:05.386539 16680 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.387542 16682 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:05.388463 16680 ts_tablet_manager.cc:1434] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:05.389173 16864 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.389626 16864 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.390367 16681 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:05.390738 16681 ts_tablet_manager.cc:1403] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:06:05.391534 16864 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:05.392968 16682 tablet_bootstrap.cc:654] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.393162 16681 raft_consensus.cc:359] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.393770 16681 raft_consensus.cc:385] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.394024 16681 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.394661 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.394799 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:05.395991 16680 tablet_bootstrap.cc:492] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
W20260709 13:06:05.396373 16605 leader_election.cc:343] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:05.397430 16604 leader_election.cc:343] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.397887 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:05.400966 16680 tablet_bootstrap.cc:654] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.401142 16864 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.403575 16681 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.405431 16681 ts_tablet_manager.cc:1434] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:06:05.406441 16681 tablet_bootstrap.cc:492] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:05.411883 16681 tablet_bootstrap.cc:654] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.439361 16857 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.448997 16561 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.457141 16776 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.469360 16809 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.469872 16809 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.472893 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:05.474738 16809 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.476195 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:05.476984 16637 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:05.478083 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:05.478955 16809 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.479395 16682 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.479861 16682 ts_tablet_manager.cc:1403] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.032s
I20260709 13:06:05.481221 16680 tablet_bootstrap.cc:492] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:05.481760 16680 ts_tablet_manager.cc:1403] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.086s	user 0.025s	sys 0.020s
I20260709 13:06:05.482236 16682 raft_consensus.cc:359] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.482856 16682 raft_consensus.cc:385] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.483114 16682 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.484236 16680 raft_consensus.cc:359] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.484865 16680 raft_consensus.cc:385] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.485136 16680 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.485178 16809 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.486132 16681 tablet_bootstrap.cc:492] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:05.485810 16680 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.486517 16681 ts_tablet_manager.cc:1403] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.044s
I20260709 13:06:05.484252 16682 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.487735 16680 ts_tablet_manager.cc:1434] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:05.488611 16682 ts_tablet_manager.cc:1434] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:06:05.489451 16682 tablet_bootstrap.cc:492] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:05.488636 16680 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:05.492558 16681 raft_consensus.cc:359] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.493151 16681 raft_consensus.cc:385] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.493386 16681 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.494019 16681 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.495157 16682 tablet_bootstrap.cc:654] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.495893 16681 ts_tablet_manager.cc:1434] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:05.496735 16681 tablet_bootstrap.cc:492] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:05.510218 16680 tablet_bootstrap.cc:654] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.508716 16907 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.517251 16907 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.518209 16489 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.519200 16907 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.519668 16907 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:05.523620 16681 tablet_bootstrap.cc:654] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.526746 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.525718 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:05.527722 16637 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:05.528141 16682 tablet_bootstrap.cc:492] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.528577 16801 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.528857 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:05.529022 16801 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:05.530354 16456 leader_election.cc:343] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.530942 16801 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.531424 16801 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.542804 16682 ts_tablet_manager.cc:1403] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.015s
I20260709 13:06:05.531761 16862 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:06:05.541898 16809 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:05.537865 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.532176 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:05.549602 16637 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
W20260709 13:06:05.550163 16456 leader_election.cc:343] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.552541 16455 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:05.531759 16801 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.560153 16801 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.561268 16907 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.561666 16907 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.561978 16907 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.571123 16907 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.565155 16682 raft_consensus.cc:359] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.572062 16870 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.579249 16870 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.581233 16870 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:05.581144 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:05.582324 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.574059 16680 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:05.574335 16708 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.583237 16708 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:05.583516 16456 leader_election.cc:343] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.585083 16708 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.574939 16681 tablet_bootstrap.cc:492] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:05.586223 16681 ts_tablet_manager.cc:1403] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.012s
I20260709 13:06:05.586599 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:05.587101 16637 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.587829 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:05.588274 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:05.588846 16490 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:05.589382 16680 ts_tablet_manager.cc:1403] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.003s
W20260709 13:06:05.589699 16605 leader_election.cc:343] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.577211 16809 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.590378 16604 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:05.575642 16801 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.591367 16870 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.591712 16870 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.588608 16681 raft_consensus.cc:359] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.592063 16870 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.592260 16681 raft_consensus.cc:385] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.592545 16681 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.593135 16681 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.593582 16637 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:05.594349 16907 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.595115 16681 ts_tablet_manager.cc:1434] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.003s
I20260709 13:06:05.578855 16682 raft_consensus.cc:385] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.595202 16455 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:05.595464 16682 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.596160 16682 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.598065 16682 ts_tablet_manager.cc:1434] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260709 13:06:05.598886 16682 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:05.600813 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:05.602036 16456 leader_election.cc:343] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.606982 16682 tablet_bootstrap.cc:654] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.609131 16801 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.609898 16680 raft_consensus.cc:359] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.616240 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:05.621868 16870 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.642190 16870 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:05.642398 16530 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:05.628213 16681 tablet_bootstrap.cc:492] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:05.643168 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:05.644367 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:05.644479 16605 leader_election.cc:343] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.644918 16490 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.596199 16907 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.628460 16865 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.647850 16865 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.648952 16681 tablet_bootstrap.cc:654] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.649740 16865 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:05.647853 16907 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:05.651783 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:05.652281 16907 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.652974 16809 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.655660 16680 raft_consensus.cc:385] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.660921 16680 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
W20260709 13:06:05.655893 16604 leader_election.cc:343] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.639484 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:05.662685 16637 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.662276 16680 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.656392 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:05.665957 16605 leader_election.cc:343] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.666361 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:05.668731 16864 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.670986 16490 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:05.672093 16604 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:05.673118 16864 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.673554 16864 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:05.674499 16680 ts_tablet_manager.cc:1434] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.001s
I20260709 13:06:05.676401 16680 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:05.680598 16637 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:05.683818 16681 tablet_bootstrap.cc:492] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:05.674450 16864 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.686336 16681 ts_tablet_manager.cc:1403] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.002s
I20260709 13:06:05.687497 16386 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.698140 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:05.698843 16862 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.699335 16862 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:05.700094 16862 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.706727 16813 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.709539 16809 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:05.729524 16907 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.729988 16907 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.736935 16560 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.745831 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.756637 16566 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:05.757768 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:05.758594 16860 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.758939 16860 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.759253 16860 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.759447 16907 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:05.789755 16680 tablet_bootstrap.cc:654] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.797391 16682 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.797787 16682 ts_tablet_manager.cc:1403] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.199s	user 0.008s	sys 0.019s
I20260709 13:06:05.799606 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:05.800365 16635 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:05.807556 16682 raft_consensus.cc:359] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.808143 16682 raft_consensus.cc:385] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.808600 16682 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.809190 16682 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.811450 16682 ts_tablet_manager.cc:1434] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:06:05.812307 16682 tablet_bootstrap.cc:492] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:05.808041 16860 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.820178 16566 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.821465 16681 raft_consensus.cc:359] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.822111 16681 raft_consensus.cc:385] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.822346 16681 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.824898 16864 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.824973 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:05.825541 16563 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.825433 16386 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.826500 16865 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.826926 16865 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.825423 16864 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.828832 16865 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:05.829725 16864 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:05.831866 16563 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:05.831928 16862 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.833003 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:05.833819 16681 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.840752 16681 ts_tablet_manager.cc:1434] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.154s	user 0.004s	sys 0.001s
I20260709 13:06:05.836560 16862 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.842897 16681 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:05.844480 16860 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:05.846280 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53652us
I20260709 13:06:05.846467 16862 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:05.849272 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.850549 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:05.845414 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:05.852278 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.852527 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:05.852973 16639 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:05.853602 16604 leader_election.cc:343] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:05.854269 16604 leader_election.cc:343] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:05.854628 16605 leader_election.cc:343] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.855038 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:05.866967 16862 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.867611 16907 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.868094 16907 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.868476 16864 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.888603 16387 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.889398 16639 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:05.911072 16682 tablet_bootstrap.cc:654] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:05.931376 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:05.942956 16907 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:05.909848 16605 leader_election.cc:343] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.955372 16605 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:05.967562 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 63697.5us
I20260709 13:06:05.968091 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:05.969748 16455 leader_election.cc:343] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.970010 16776 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.974988 16680 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:05.975466 16680 ts_tablet_manager.cc:1403] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.299s	user 0.012s	sys 0.012s
I20260709 13:06:05.982605 16681 tablet_bootstrap.cc:654] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.986313 16801 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.991066 16682 tablet_bootstrap.cc:492] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:05.991425 16682 ts_tablet_manager.cc:1403] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.179s	user 0.005s	sys 0.019s
I20260709 13:06:05.991339 16680 raft_consensus.cc:359] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.992079 16680 raft_consensus.cc:385] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.992336 16680 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.993165 16680 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:05.995301 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:05.996294 16680 ts_tablet_manager.cc:1434] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
W20260709 13:06:05.996609 16456 leader_election.cc:343] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:05.997040 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:05.998102 16907 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:05.997215 16680 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:06.004438 16387 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.018877 16681 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:06.019302 16681 ts_tablet_manager.cc:1403] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.177s	user 0.003s	sys 0.019s
I20260709 13:06:06.021654 16681 raft_consensus.cc:359] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.022619 16681 raft_consensus.cc:385] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.022821 16681 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.023307 16681 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.026255 16682 raft_consensus.cc:359] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.027386 16681 ts_tablet_manager.cc:1434] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:06.026888 16682 raft_consensus.cc:385] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.032495 16681 tablet_bootstrap.cc:492] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:06.032487 16682 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.033211 16682 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.035287 16682 ts_tablet_manager.cc:1434] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.000s
I20260709 13:06:06.031498 16680 tablet_bootstrap.cc:654] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.038731 16682 tablet_bootstrap.cc:492] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.043187 16682 tablet_bootstrap.cc:654] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.044709 16681 tablet_bootstrap.cc:654] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.049227 16682 tablet_bootstrap.cc:492] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:06.049661 16682 ts_tablet_manager.cc:1403] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:06:06.052310 16682 raft_consensus.cc:359] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.052992 16682 raft_consensus.cc:385] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.053261 16682 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.053869 16682 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.055320 16682 ts_tablet_manager.cc:1434] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:06:06.056173 16682 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.056704 16907 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.057161 16907 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.058931 16809 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.059357 16809 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.059703 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:06.061192 16809 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.061751 16682 tablet_bootstrap.cc:654] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.062660 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:06.063189 16456 leader_election.cc:343] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.062660 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.064385 16490 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:06.065352 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:06.066200 16809 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.069236 16907 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.070676 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:06.071238 16637 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:06.073799 16455 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:06.076000 16801 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.076385 16801 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.076719 16801 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.083634 16809 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.084215 16801 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.086244 16801 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.087116 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:06.087627 16639 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.087536 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:06.088856 16456 leader_election.cc:343] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.093423 16639 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:06.094343 16455 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:06.095297 16714 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.095736 16714 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:06.096503 16714 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.106534 16680 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:06.107019 16680 ts_tablet_manager.cc:1403] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 13:06:06.107831 16387 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.108912 16809 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.109400 16809 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.111923 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.112648 16809 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.113292 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:06.113786 16456 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.113811 16639 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:06.109405 16680 raft_consensus.cc:359] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.115052 16680 raft_consensus.cc:385] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.115343 16680 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.115193 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:06.116031 16809 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.116355 16809 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.116693 16809 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.116442 16680 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.118881 16680 ts_tablet_manager.cc:1434] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:06.120443 16680 tablet_bootstrap.cc:492] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
W20260709 13:06:06.121376 16530 leader_election.cc:343] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.126253 16680 tablet_bootstrap.cc:654] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.128933 16682 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:06.129379 16682 ts_tablet_manager.cc:1403] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.028s
I20260709 13:06:06.129386 16681 tablet_bootstrap.cc:492] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:06.130023 16681 ts_tablet_manager.cc:1403] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.043s
I20260709 13:06:06.132282 16682 raft_consensus.cc:359] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.132592 16681 raft_consensus.cc:359] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.133002 16682 raft_consensus.cc:385] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.133239 16681 raft_consensus.cc:385] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.133387 16682 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.133602 16681 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.134383 16681 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.134321 16682 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.135892 16681 ts_tablet_manager.cc:1434] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:06:06.136668 16681 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:06.141470 16682 ts_tablet_manager.cc:1434] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:06.142378 16682 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.144887 16864 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.145339 16864 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.147343 16864 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.148377 16682 tablet_bootstrap.cc:654] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.148248 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:06.149561 16605 leader_election.cc:343] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.153214 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.153787 16490 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:06.155459 16864 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.158761 16681 tablet_bootstrap.cc:654] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.160672 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:06.161731 16864 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.162113 16864 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.162437 16864 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.171579 16680 tablet_bootstrap.cc:492] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:06.172076 16680 ts_tablet_manager.cc:1403] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.000s
I20260709 13:06:06.175174 16680 raft_consensus.cc:359] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.179569 16864 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.182641 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:06.182734 16809 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.183300 16489 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.186185 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:06.186702 16639 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.188725 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:06.190069 16530 leader_election.cc:343] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.192835 16489 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:06.194031 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:06.194795 16776 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.195279 16776 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:06.196064 16776 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.202750 16864 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.203274 16680 raft_consensus.cc:385] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.203578 16680 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.204011 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:06.205066 16680 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:06.206168 16456 consensus_peers.cc:597] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.206523 16680 ts_tablet_manager.cc:1434] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:06:06.206769 16389 catalog_manager.cc:5697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:06.207866 16605 leader_election.cc:343] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.227304 16809 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.192996 16639 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:06.228858 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:06.229983 16809 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.234966 16680 tablet_bootstrap.cc:492] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:06.242357 16809 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:06.243178 16809 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.247043 16864 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.248734 16682 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:06.249208 16682 ts_tablet_manager.cc:1403] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.107s	user 0.041s	sys 0.050s
I20260709 13:06:06.250794 16680 tablet_bootstrap.cc:654] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.249260 16681 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:06.251359 16681 ts_tablet_manager.cc:1403] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.115s	user 0.041s	sys 0.026s
I20260709 13:06:06.253921 16681 raft_consensus.cc:359] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.255709 16681 raft_consensus.cc:385] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.256072 16681 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.256722 16681 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.258698 16681 ts_tablet_manager.cc:1434] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:06.255115 16682 raft_consensus.cc:359] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.259086 16682 raft_consensus.cc:385] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.259378 16682 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.260072 16682 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.261965 16682 ts_tablet_manager.cc:1434] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.001s
I20260709 13:06:06.261386 16389 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.262852 16681 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:06.268257 16681 tablet_bootstrap.cc:654] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.278699 16682 tablet_bootstrap.cc:492] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.282793 16714 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.299567 16680 tablet_bootstrap.cc:492] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:06.300005 16680 ts_tablet_manager.cc:1403] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.005s
I20260709 13:06:06.301340 16682 tablet_bootstrap.cc:654] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.302287 16680 raft_consensus.cc:359] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.302886 16680 raft_consensus.cc:385] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.303141 16680 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.303927 16680 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.305279 16682 tablet_bootstrap.cc:492] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:06.305663 16682 ts_tablet_manager.cc:1403] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:06:06.308624 16682 raft_consensus.cc:359] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.310863 16682 raft_consensus.cc:385] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.311122 16682 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.311684 16682 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.312232 16681 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:06.312630 16681 ts_tablet_manager.cc:1403] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.012s
I20260709 13:06:06.314884 16681 raft_consensus.cc:359] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.315460 16681 raft_consensus.cc:385] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.315703 16681 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.315953 16682 ts_tablet_manager.cc:1434] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:06.316514 16680 ts_tablet_manager.cc:1434] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:06:06.316274 16681 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.316802 16682 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.318702 16681 ts_tablet_manager.cc:1434] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:06.319576 16680 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:06.322299 16682 tablet_bootstrap.cc:654] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.323730 16681 tablet_bootstrap.cc:492] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:06.327239 16809 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.327862 16801 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.327658 16809 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.328281 16801 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.325066 16680 tablet_bootstrap.cc:654] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.334408 16801 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.334383 16809 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.337283 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:06.337805 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:06.336742 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.335604 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:06.339563 16637 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
W20260709 13:06:06.340278 16456 leader_election.cc:343] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.341266 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:06.342083 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:06.342890 16809 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.342883 16862 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.343502 16862 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.343447 16801 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.344012 16862 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.345413 16681 tablet_bootstrap.cc:654] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.350625 16862 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.351434 16682 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:06.351862 16682 ts_tablet_manager.cc:1403] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.002s
I20260709 13:06:06.353394 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:06.353417 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:06.354076 16639 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.354370 16862 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.354421 16682 raft_consensus.cc:359] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.355095 16682 raft_consensus.cc:385] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.355356 16682 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.355971 16682 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:06.356624 16456 leader_election.cc:343] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.358148 16682 ts_tablet_manager.cc:1434] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:06.358852 16681 tablet_bootstrap.cc:492] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:06.359056 16682 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.359371 16681 ts_tablet_manager.cc:1403] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.008s
I20260709 13:06:06.362457 16681 raft_consensus.cc:359] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.363125 16681 raft_consensus.cc:385] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.363420 16681 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.364277 16681 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.364751 16682 tablet_bootstrap.cc:654] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.369649 16681 ts_tablet_manager.cc:1434] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:06:06.370059 16680 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:06.370461 16680 ts_tablet_manager.cc:1403] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:06:06.370563 16681 tablet_bootstrap.cc:492] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:06.372790 16680 raft_consensus.cc:359] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.373413 16680 raft_consensus.cc:385] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.373668 16680 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.376308 16681 tablet_bootstrap.cc:654] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.380765 16862 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.382694 16639 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:06.374233 16680 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.383623 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:06.384768 16680 ts_tablet_manager.cc:1434] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:06.385747 16907 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.386214 16907 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:06.386950 16907 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.389742 16680 tablet_bootstrap.cc:492] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:06.399147 16680 tablet_bootstrap.cc:654] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.414846 16864 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.415369 16864 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.470461 16680 tablet_bootstrap.cc:492] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:06.470933 16680 ts_tablet_manager.cc:1403] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.018s
I20260709 13:06:06.473302 16680 raft_consensus.cc:359] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.473924 16680 raft_consensus.cc:385] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.474180 16680 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.474753 16680 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.485849 16862 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.486320 16862 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.487866 16682 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:06.488255 16862 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.488356 16682 ts_tablet_manager.cc:1403] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.023s
I20260709 13:06:06.491099 16682 raft_consensus.cc:359] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.493361 16681 tablet_bootstrap.cc:492] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:06.493922 16681 ts_tablet_manager.cc:1403] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.124s	user 0.039s	sys 0.027s
I20260709 13:06:06.496309 16681 raft_consensus.cc:359] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.496670 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.496945 16681 raft_consensus.cc:385] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.497311 16681 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.497262 16490 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:06.498214 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:06.498844 16635 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:06.497728 16682 raft_consensus.cc:385] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.499564 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:06.498317 16864 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.502723 16682 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.504189 16682 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.499995 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:06.505419 16714 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.505751 16714 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.506062 16714 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.498987 16604 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:06.503211 16681 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.521211 16682 ts_tablet_manager.cc:1434] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:06:06.524034 16809 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.508809 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:06.525944 16681 ts_tablet_manager.cc:1434] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:06:06.525405 16714 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.524497 16809 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:06.527475 16456 leader_election.cc:343] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.528347 16862 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.528723 16809 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.530052 16714 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.531755 16681 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:06.532662 16865 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:06.533026 16865 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.533352 16865 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.535712 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:06.536553 16639 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:06.537009 16389 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:06.539532 16605 leader_election.cc:343] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.544024 16935 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.544438 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.544476 16935 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.546344 16682 tablet_bootstrap.cc:492] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.546594 16935 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.550207 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:06.551350 16680 ts_tablet_manager.cc:1434] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.080s	user 0.020s	sys 0.014s
I20260709 13:06:06.553705 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:06.555773 16639 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:06.550940 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:06.557467 16635 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.557607 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:06.553650 16935 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.561273 16680 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
W20260709 13:06:06.562489 16456 leader_election.cc:343] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.563393 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.564582 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:06.565464 16809 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.566440 16865 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.567528 16635 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:06.568574 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:06.569494 16865 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.553757 16864 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.570211 16864 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.570641 16809 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.571776 16907 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.572072 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:06.572299 16907 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:06.573113 16907 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:06.574386 16605 leader_election.cc:343] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.576974 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:06.577760 16561 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:06.578305 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:06.578683 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:06.578855 16490 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.579487 16870 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.579864 16870 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.581033 16870 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.579630 16935 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.581672 16801 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.584403 16801 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.587347 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:06.580821 16864 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.588033 16635 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:06.588265 16801 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.592163 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.600569 16489 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:06.592594 16681 tablet_bootstrap.cc:654] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.596765 16860 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.596810 16870 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.594578 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:06.599726 16682 tablet_bootstrap.cc:654] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.603042 16970 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.605962 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:06.606227 16870 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.612527 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:06.613102 16560 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.621755 16907 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.640558 16680 tablet_bootstrap.cc:654] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.642493 16386 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.638628 16490 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:06.655501 16566 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.668668 16563 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.670084 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:06.670687 16488 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.688392 16564 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.718653 16714 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:06.721426 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 71263.3us
I20260709 13:06:06.728171 16604 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:06.741219 16776 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.741689 16776 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:06.719153 16714 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.742467 16776 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.747496 16974 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.748052 16974 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.750020 16974 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.751112 16714 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:06.757046 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.761130 16907 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.761260 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:06.762331 16455 leader_election.cc:343] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.763532 16865 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.763995 16865 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.761210 16488 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:06.765929 16865 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.766093 16864 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:06.767623 16604 leader_election.cc:343] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.768560 16560 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:06.778127 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:06.778843 16680 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:06.778715 16864 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.779306 16680 ts_tablet_manager.cc:1403] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.007s
I20260709 13:06:06.779381 16864 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:06.777562 16682 tablet_bootstrap.cc:492] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:06.780709 16682 ts_tablet_manager.cc:1403] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.238s	user 0.019s	sys 0.001s
I20260709 13:06:06.780325 16864 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.782462 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:06.783641 16680 raft_consensus.cc:359] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.784262 16680 raft_consensus.cc:385] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.784525 16680 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.785130 16680 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.787078 16680 ts_tablet_manager.cc:1434] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:06.786872 16682 raft_consensus.cc:359] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.787495 16682 raft_consensus.cc:385] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.787748 16682 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
W20260709 13:06:06.785176 16604 leader_election.cc:343] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.788794 16682 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.790266 16682 ts_tablet_manager.cc:1434] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:06:06.790469 16907 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.791126 16682 tablet_bootstrap.cc:492] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:06.787931 16680 tablet_bootstrap.cc:492] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:06.809197 16386 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.842759 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:06.830461 16865 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:06:06.849216 16967 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.849658 16967 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.884544 16865 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.885093 16865 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.884668 16967 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:06.907011 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54482.6us
I20260709 13:06:06.925164 16681 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:06.925653 16681 ts_tablet_manager.cc:1403] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.394s	user 0.035s	sys 0.023s
W20260709 13:06:06.913942 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 68785.8us
I20260709 13:06:06.932839 16865 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:06.922165 16862 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.937271 16862 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:06.939247 16862 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:06.948944 16456 leader_election.cc:343] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.949329 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:06.951081 16680 tablet_bootstrap.cc:654] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.951331 16801 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:06.980924 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:07.028090 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44185.4us
W20260709 13:06:07.030761 16605 leader_election.cc:343] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.032176 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:07.035146 16982 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:07.037339 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:07.039695 16973 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.055s	user 0.003s	sys 0.006s
I20260709 13:06:07.043344 16809 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.035066 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.041965 16681 raft_consensus.cc:359] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.051779 16681 raft_consensus.cc:385] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.052084 16681 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.057873 16681 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.072747 16681 ts_tablet_manager.cc:1434] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.147s	user 0.006s	sys 0.000s
I20260709 13:06:07.059985 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.063741 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.059116 16708 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:06:07.086683 16604 leader_election.cc:343] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.087080 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:07.087371 16801 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.088047 16491 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:07.074268 16935 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:07.089824 16935 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:07.090878 16605 leader_election.cc:343] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.094043 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.091307 16605 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:07.094861 16984 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:07.095726 16974 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.092360 16865 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:07.105248 16985 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:06:07.108071 16681 tablet_bootstrap.cc:492] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.114957 16968 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:07.115430 16968 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.117663 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.121635 16682 tablet_bootstrap.cc:654] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:07.113934 16455 leader_election.cc:343] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:07.123688 16456 leader_election.cc:343] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.127146 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:07.129552 16605 leader_election.cc:343] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.131362 16862 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.129647 16987 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.144850 16935 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.145816 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.148404 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:07.150288 16386 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 2, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:07.162673 16456 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.164322 16680 tablet_bootstrap.cc:492] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:07.164819 16680 ts_tablet_manager.cc:1403] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.377s	user 0.013s	sys 0.004s
I20260709 13:06:07.146577 16605 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:07.171159 16974 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.172788 16987 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.174419 16680 raft_consensus.cc:359] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.175050 16680 raft_consensus.cc:385] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.175279 16680 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.176106 16968 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.176564 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.180460 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.177429 16680 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.184849 16986 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.188226 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.191603 16680 ts_tablet_manager.cc:1434] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:06:07.193029 16680 tablet_bootstrap.cc:492] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:07.189575 16986 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.196096 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:07.202340 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:07.205123 16991 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.206626 16870 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.204648 16987 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.207062 16870 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.199994 16986 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.209435 16870 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.211061 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.212078 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.213874 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:07.215953 16456 leader_election.cc:343] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.216961 16986 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:07.216976 16604 leader_election.cc:343] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.217991 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:07.218696 16605 leader_election.cc:343] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.219017 16640 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:07.219508 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:07.220407 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.220646 16870 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.224563 16681 tablet_bootstrap.cc:654] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.221570 16986 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.228266 16986 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.228590 16986 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.231001 16485 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:07.231314 16559 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:07.232872 16974 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:07.242440 16974 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:07.250247 16682 tablet_bootstrap.cc:492] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:07.250701 16682 ts_tablet_manager.cc:1403] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.460s	user 0.010s	sys 0.025s
I20260709 13:06:07.259001 16680 tablet_bootstrap.cc:654] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.268553 16986 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.282963 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.283110 16986 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.283507 16640 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.284531 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:07.299304 16456 leader_election.cc:343] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.301234 16682 raft_consensus.cc:359] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.301594 16974 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.301895 16682 raft_consensus.cc:385] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.302176 16682 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.302762 16682 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.304694 16682 ts_tablet_manager.cc:1434] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.054s	user 0.025s	sys 0.011s
I20260709 13:06:07.305506 16682 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
W20260709 13:06:07.267671 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:07.312949 16680 tablet_bootstrap.cc:492] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:07.313382 16680 ts_tablet_manager.cc:1403] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.002s
I20260709 13:06:07.317190 16681 tablet_bootstrap.cc:492] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.317615 16681 ts_tablet_manager.cc:1403] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.210s	user 0.016s	sys 0.011s
I20260709 13:06:07.319933 16681 raft_consensus.cc:359] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.320626 16682 tablet_bootstrap.cc:654] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.320688 16681 raft_consensus.cc:385] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.321799 16680 raft_consensus.cc:359] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.322407 16680 raft_consensus.cc:385] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.322647 16680 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.321069 16681 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.323120 16640 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.324577 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.325510 16986 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.325961 16986 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:07.326699 16986 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.327663 16682 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:07.328089 16682 ts_tablet_manager.cc:1403] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.006s
I20260709 13:06:07.330299 16682 raft_consensus.cc:359] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.330894 16682 raft_consensus.cc:385] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.331139 16682 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.323752 16681 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.331884 16682 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.332830 16680 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.339578 16680 ts_tablet_manager.cc:1434] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:06:07.340415 16680 tablet_bootstrap.cc:492] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:07.340488 16991 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.341166 16991 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.333760 16682 ts_tablet_manager.cc:1434] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:07.335903 16681 ts_tablet_manager.cc:1434] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:07.342976 16682 tablet_bootstrap.cc:492] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:07.344282 16681 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.344381 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:07.345669 16530 leader_election.cc:343] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.348959 16682 tablet_bootstrap.cc:654] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.350579 16991 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.352531 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.353184 16640 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 0.
I20260709 13:06:07.354367 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:07.355057 16681 tablet_bootstrap.cc:654] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.355345 16991 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.355746 16991 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.356105 16991 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.355971 16974 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:07.358633 16680 tablet_bootstrap.cc:654] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.367089 16681 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.367491 16681 ts_tablet_manager.cc:1403] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:06:07.369952 16681 raft_consensus.cc:359] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.370563 16681 raft_consensus.cc:385] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.370807 16681 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.371562 16991 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.373517 16682 tablet_bootstrap.cc:492] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:07.373947 16682 ts_tablet_manager.cc:1403] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.013s
I20260709 13:06:07.374251 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:07.375345 16530 leader_election.cc:343] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.376318 16682 raft_consensus.cc:359] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.376919 16682 raft_consensus.cc:385] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.377177 16682 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.377077 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.377727 16640 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.378260 16681 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.380540 16681 ts_tablet_manager.cc:1434] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:06:07.381368 16681 tablet_bootstrap.cc:492] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.384315 16680 tablet_bootstrap.cc:492] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:07.384732 16680 ts_tablet_manager.cc:1403] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.002s
I20260709 13:06:07.386509 16681 tablet_bootstrap.cc:654] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.386994 16680 raft_consensus.cc:359] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.387650 16991 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.377842 16682 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:07.389213 17009 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:07.389976 16640 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:07.390822 16682 ts_tablet_manager.cc:1434] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:06:07.391067 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:07.392062 16682 tablet_bootstrap.cc:492] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:07.392064 16991 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.393743 16991 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:07.395298 16991 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.387616 16680 raft_consensus.cc:385] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.397486 16680 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.398125 16680 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.399570 16682 tablet_bootstrap.cc:654] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.399982 16680 ts_tablet_manager.cc:1434] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:07.400761 16680 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:07.399385 16389 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.401774 16974 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.406180 16974 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.408108 16680 tablet_bootstrap.cc:654] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.408334 16974 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.412305 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.415078 16681 tablet_bootstrap.cc:492] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.415481 16681 ts_tablet_manager.cc:1403] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.007s
W20260709 13:06:07.415886 16605 leader_election.cc:343] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.416906 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.421249 16486 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:07.422479 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.423545 16864 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.423900 16864 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.424207 16864 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.417796 16681 raft_consensus.cc:359] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.424821 16681 raft_consensus.cc:385] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.425136 16681 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.429414 16681 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.431592 16681 ts_tablet_manager.cc:1434] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:06:07.432893 16864 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.435271 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:07.435775 16486 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.437489 16681 tablet_bootstrap.cc:492] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.443450 16681 tablet_bootstrap.cc:654] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.448058 16682 tablet_bootstrap.cc:492] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:07.448447 16682 ts_tablet_manager.cc:1403] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.010s
I20260709 13:06:07.449968 16486 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:07.450758 16682 raft_consensus.cc:359] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.451061 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:07.451395 16682 raft_consensus.cc:385] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.451656 16682 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.452633 16870 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.452431 16682 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.453084 16870 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:07.453852 16870 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.455240 16682 ts_tablet_manager.cc:1434] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:07.456131 16682 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:07.458315 16681 tablet_bootstrap.cc:492] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.458854 16681 ts_tablet_manager.cc:1403] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 13:06:07.461802 16682 tablet_bootstrap.cc:654] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.462188 16681 raft_consensus.cc:359] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.462945 16681 raft_consensus.cc:385] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.463258 16681 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.464071 16681 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.468254 16681 ts_tablet_manager.cc:1434] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:07.469472 16681 tablet_bootstrap.cc:492] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.473142 16389 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.475826 16681 tablet_bootstrap.cc:654] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.476737 16682 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:07.477161 16682 ts_tablet_manager.cc:1403] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:06:07.479612 16682 raft_consensus.cc:359] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.480230 16682 raft_consensus.cc:385] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.480479 16682 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.481063 16682 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.483124 16682 ts_tablet_manager.cc:1434] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:07.483897 16682 tablet_bootstrap.cc:492] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:07.488015 16681 tablet_bootstrap.cc:492] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.491055 16681 ts_tablet_manager.cc:1403] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:06:07.491622 16682 tablet_bootstrap.cc:654] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.493692 16681 raft_consensus.cc:359] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.494427 16681 raft_consensus.cc:385] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.494997 16681 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.495649 16681 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.497313 16681 ts_tablet_manager.cc:1434] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:07.497393 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:07.498735 16605 leader_election.cc:343] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.498843 16864 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.499991 16681 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.513988 16681 tablet_bootstrap.cc:654] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.533567 16681 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.534106 16681 ts_tablet_manager.cc:1403] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 13:06:07.536614 16681 raft_consensus.cc:359] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.537339 16681 raft_consensus.cc:385] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.537650 16681 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.538408 16681 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.541908 16681 ts_tablet_manager.cc:1434] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:07.542884 16681 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.551724 16388 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.556461 16986 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.556910 16986 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.559103 16986 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.560673 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.560698 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.561653 16640 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:07.562346 16681 tablet_bootstrap.cc:654] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.562831 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:07.566045 16456 leader_election.cc:343] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.567090 16986 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.567399 16986 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.567651 16986 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.575368 16995 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.575814 16995 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.578431 16680 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:07.578998 16680 ts_tablet_manager.cc:1403] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.178s	user 0.068s	sys 0.055s
I20260709 13:06:07.579716 16992 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.577704 16986 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.580178 16992 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.580788 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:07.582360 16455 leader_election.cc:343] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.584228 16682 tablet_bootstrap.cc:492] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:07.584726 16682 ts_tablet_manager.cc:1403] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.101s	user 0.043s	sys 0.029s
I20260709 13:06:07.585834 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.586428 16640 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.584141 16986 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.587647 16682 raft_consensus.cc:359] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.588301 16682 raft_consensus.cc:385] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.588518 16682 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.589262 16682 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.589265 16992 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.588511 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.592530 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.592964 16559 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:07.591344 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.593915 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:07.594910 16986 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.595240 16986 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.595533 16986 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.599843 16682 ts_tablet_manager.cc:1434] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:06:07.599964 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:07.600688 16682 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:07.600615 16991 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.593802 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:07.581425 16995 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.606115 16680 raft_consensus.cc:359] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.606786 16680 raft_consensus.cc:385] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.607079 16680 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.607667 16680 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.608562 16558 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.609608 16680 ts_tablet_manager.cc:1434] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:06:07.610265 16680 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:07.616032 16640 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.616065 16986 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.618227 16986 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.618841 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:07.619182 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:07.619426 16559 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.621270 16558 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.621941 16681 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.622356 16681 ts_tablet_manager.cc:1403] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.003s
I20260709 13:06:07.622779 16986 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.623238 16986 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:07.624140 16986 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.625089 16680 tablet_bootstrap.cc:654] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.624759 16681 raft_consensus.cc:359] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.626026 16681 raft_consensus.cc:385] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.626283 16681 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.627528 16681 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.628039 16682 tablet_bootstrap.cc:654] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.632645 16559 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.633642 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:07.634261 16996 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.634733 16996 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:07.635825 16681 ts_tablet_manager.cc:1434] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:06:07.636914 16681 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.639477 16862 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.639971 16862 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.641845 16862 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.642421 16681 tablet_bootstrap.cc:654] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.642733 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.643616 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:07.644049 16456 leader_election.cc:343] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.644196 16634 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:07.645355 16455 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.646636 16801 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.647002 16801 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.647305 16801 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.652395 16870 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.652868 16870 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.655304 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.635464 16996 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.658210 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.658924 16559 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:07.660388 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:07.661501 16776 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.669082 16776 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.671418 16682 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:07.671859 16682 ts_tablet_manager.cc:1403] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.019s
I20260709 13:06:07.672005 16801 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.673784 16681 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.673736 16864 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.674304 16681 ts_tablet_manager.cc:1403] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.017s
I20260709 13:06:07.674299 16864 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.676270 16864 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.676054 16388 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.678879 16681 raft_consensus.cc:359] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.679489 16681 raft_consensus.cc:385] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.679728 16681 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.680315 16681 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.680828 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.681401 16486 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:07.682272 16681 ts_tablet_manager.cc:1434] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:06:07.682508 16604 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:07.683089 16681 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.684437 16864 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.684784 16864 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.685124 16864 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.685503 16561 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.688117 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.689042 16681 tablet_bootstrap.cc:654] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.658108 16870 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:07.693678 16605 leader_election.cc:343] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.695564 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:07.696943 16456 leader_election.cc:343] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.701308 16681 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.701674 16681 ts_tablet_manager.cc:1403] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 13:06:07.703931 16681 raft_consensus.cc:359] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.704506 16681 raft_consensus.cc:385] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.704730 16681 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.705415 16681 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.707578 16681 ts_tablet_manager.cc:1434] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:07.708386 16681 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.711678 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.712189 16637 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.714023 16681 tablet_bootstrap.cc:654] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.718127 16637 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.718729 16801 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.719508 16455 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.684451 16682 raft_consensus.cc:359] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.720661 16682 raft_consensus.cc:385] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.720928 16682 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.722729 16864 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.723942 16995 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.724411 16995 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:07.725054 16681 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.725649 16681 ts_tablet_manager.cc:1403] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:06:07.725529 16862 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.725153 16995 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.726119 16862 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.728336 16862 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.728204 16681 raft_consensus.cc:359] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.728852 16681 raft_consensus.cc:385] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.729135 16681 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.729650 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.729844 16681 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.730659 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.731916 16681 ts_tablet_manager.cc:1434] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 13:06:07.731901 16456 leader_election.cc:343] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.733274 16862 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.733613 16862 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.734788 16681 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.735580 16862 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.736387 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.736961 16635 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:07.719430 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.738027 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.738519 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:07.738991 16456 leader_election.cc:343] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.737193 16776 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.744020 16862 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.744418 16862 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.744735 16862 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.744843 16388 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.751902 16986 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.753592 16986 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.752751 16682 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.754452 16634 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:07.752444 16776 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.759735 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:07.761032 16456 leader_election.cc:343] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.763487 16776 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.767956 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.768990 16986 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.769384 16681 tablet_bootstrap.cc:654] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.769549 16986 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.756613 16862 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.774266 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.774495 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.774885 16486 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:07.776672 16682 ts_tablet_manager.cc:1434] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.001s
W20260709 13:06:07.776712 16455 leader_election.cc:343] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.777235 16455 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:07.777766 16682 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:07.778527 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:07.769943 16986 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.781203 16996 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:07.782007 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.794474 16640 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.795002 16862 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.782187 16986 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.795430 16605 leader_election.cc:343] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.782162 16776 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.797892 16776 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.798224 16776 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.802073 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.802642 16637 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.812216 16990 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.812657 16990 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.814492 16990 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.814919 16990 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.811139 16637 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.815325 16990 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.815084 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:07.830062 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:07.830420 16990 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.830615 16485 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.832631 16776 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.837885 16776 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.827948 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.840471 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:07.842773 16682 tablet_bootstrap.cc:654] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:07.842294 16456 leader_election.cc:343] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.844734 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.845733 16986 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:07.847930 16456 leader_election.cc:343] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.851089 16870 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.851315 16864 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.851538 16870 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.853302 16870 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:07.857692 16986 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.856755 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:07.858511 16486 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:07.847693 16605 leader_election.cc:343] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.861559 16680 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:07.861982 16680 ts_tablet_manager.cc:1403] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.252s	user 0.049s	sys 0.096s
I20260709 13:06:07.859611 16386 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.865561 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:07.866190 16489 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:07.867619 16485 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:07.867883 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:07.867623 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:07.869082 16680 raft_consensus.cc:359] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.869750 16680 raft_consensus.cc:385] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.869997 16680 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.874414 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:07.875285 16604 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:07.880538 16605 leader_election.cc:343] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:07.881464 16605 leader_election.cc:343] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.887035 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.887669 16995 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.888115 16995 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:07.888553 16485 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.888863 16995 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.876055 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:07.891351 16456 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.893216 16680 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:07.894025 16456 leader_election.cc:343] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.899168 16680 ts_tablet_manager.cc:1434] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:06:07.886952 17034 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.902194 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.905100 16634 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:07.905037 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.904753 17034 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.905637 16640 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.905864 17034 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.892963 16870 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.912498 16870 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:07.908665 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:07.912829 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:07.911718 16681 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:07.913335 16637 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:07.913290 16870 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.914243 16681 ts_tablet_manager.cc:1403] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.017s
I20260709 13:06:07.913650 17034 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.916530 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.920186 16862 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:07.925850 16681 raft_consensus.cc:359] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.926546 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:07.927059 16489 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.926488 16681 raft_consensus.cc:385] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.928215 16681 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.928704 16486 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:07.928812 16681 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.930430 16640 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.930735 16681 ts_tablet_manager.cc:1434] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:06:07.925772 16862 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.931311 16862 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.931617 16681 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Bootstrap starting.
I20260709 13:06:07.932535 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.933437 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:07.935658 16489 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:07.935963 16986 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:07.937099 16680 tablet_bootstrap.cc:492] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:07.938395 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:07.942962 16776 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.943427 16776 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:07.944161 16776 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.944758 16862 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.945007 16386 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.949208 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:07.949712 16637 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:07.955686 16637 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:07.956688 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:07.951452 16995 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.946866 17037 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:07.958477 16862 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:07.960947 16986 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.002406 17034 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:08.009140 16986 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:08.010010 16986 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:07.992440 16995 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:08.019335 16995 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.034029 16992 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.054598 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:08.051278 17037 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:08.062805 16456 leader_election.cc:343] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.068194 16682 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:08.068650 16682 ts_tablet_manager.cc:1403] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.291s	user 0.020s	sys 0.014s
I20260709 13:06:08.073122 17037 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.074072 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:08.075086 16681 tablet_bootstrap.cc:654] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.049021 16776 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:06:08.071942 16996 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.087395 16386 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:08.089366 16605 leader_election.cc:343] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.096031 16968 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:06:08.105902 16605 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.116031 16682 raft_consensus.cc:359] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.116619 16682 raft_consensus.cc:385] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.116871 16682 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.117465 16682 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.118669 16680 tablet_bootstrap.cc:654] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.119352 16682 ts_tablet_manager.cc:1434] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.000s
I20260709 13:06:08.120959 16682 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:08.133162 16681 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:08.133515 16681 ts_tablet_manager.cc:1403] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.202s	user 0.009s	sys 0.014s
I20260709 13:06:08.181636 16389 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.188275 16389 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.237603 16681 raft_consensus.cc:359] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.239349 16681 raft_consensus.cc:385] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.239722 16681 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.245208 17045 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.245996 17045 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.255245 16862 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.255944 16682 tablet_bootstrap.cc:654] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.265988 16680 tablet_bootstrap.cc:492] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:08.266667 16680 ts_tablet_manager.cc:1403] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.330s	user 0.011s	sys 0.013s
I20260709 13:06:08.240396 16681 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.278038 16680 raft_consensus.cc:359] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.289770 16680 raft_consensus.cc:385] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.290055 16680 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.299638 16680 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.310882 16907 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.312036 16680 ts_tablet_manager.cc:1434] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:06:08.312368 17041 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.312875 17041 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.319180 16680 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:08.324214 17045 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:08.329892 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:08.334545 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:08.335453 16490 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:08.338477 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:08.340492 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51597.1us
I20260709 13:06:08.342494 16489 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:08.345300 16681 ts_tablet_manager.cc:1434] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.212s	user 0.005s	sys 0.005s
I20260709 13:06:08.315701 17041 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:08.362715 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:08.364037 16530 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:08.368872 16968 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.373515 16386 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.375568 16386 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.379695 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:08.398000 16605 leader_election.cc:343] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.402771 17036 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.403132 17036 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.403460 17036 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.385653 16968 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.392679 16681 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
W20260709 13:06:08.402767 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53817.5us
I20260709 13:06:08.420130 16986 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:08.415309 16995 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:06:08.423247 17037 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.431267 17061 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:06:08.454561 16680 tablet_bootstrap.cc:654] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:08.454923 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 112622us
W20260709 13:06:08.490782 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:08.463618 17036 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.523507 17036 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:08.529541 16682 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:08.530200 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:08.530812 16490 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.536399 16870 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:08.549937 16490 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:08.551892 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:08.552631 16870 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.553076 16870 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:08.553987 16870 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.584173 16990 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.584671 16990 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.587397 16990 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:08.594136 16682 ts_tablet_manager.cc:1403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.474s	user 0.022s	sys 0.035s
I20260709 13:06:08.610052 17036 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.610558 17036 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.612525 17036 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:08.613416 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:08.613665 16456 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.601022 17061 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:06:08.617436 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:08.617786 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:08.618070 16491 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:08.618369 16634 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 0.
I20260709 13:06:08.621824 16681 tablet_bootstrap.cc:654] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.622040 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:08.633893 17045 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.637830 16776 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.640861 16682 raft_consensus.cc:359] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.641304 16682 raft_consensus.cc:385] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.641507 16682 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.642066 16682 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:08.645179 16605 leader_election.cc:343] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:08.654583 16456 leader_election.cc:343] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:08.655222 16456 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.655733 16456 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.657874 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 49622.1us
I20260709 13:06:08.659971 16455 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:06:08.660918 16605 consensus_peers.cc:597] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.673475 17035 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:08.676198 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:08.677320 16680 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:08.669483 16862 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.678092 16862 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.678421 16862 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.680384 16682 ts_tablet_manager.cc:1434] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.000s
I20260709 13:06:08.681538 16682 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:08.716130 17053 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.716666 17053 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.782661 16681 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:08.798463 16681 ts_tablet_manager.cc:1403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.406s	user 0.017s	sys 0.004s
W20260709 13:06:08.798910 16605 leader_election.cc:343] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.800330 17053 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:08.800813 16680 ts_tablet_manager.cc:1403] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.485s	user 0.044s	sys 0.027s
I20260709 13:06:08.800843 16862 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.806393 16604 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:08.807395 16870 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.807730 16870 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.808060 16870 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.811192 16862 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:08.816046 16681 raft_consensus.cc:359] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.818957 16681 raft_consensus.cc:385] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.819212 16681 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.819768 16681 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.821731 16681 ts_tablet_manager.cc:1434] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.003s
I20260709 13:06:08.822036 16682 tablet_bootstrap.cc:654] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.822690 16681 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Bootstrap starting.
W20260709 13:06:08.824841 16605 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.832578 16563 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.833784 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:08.834856 16870 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.836764 16870 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:08.837414 16638 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:08.842664 16680 raft_consensus.cc:359] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.845340 16680 raft_consensus.cc:385] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.845651 16680 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.845410 16388 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.848625 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:08.859742 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:08.849624 16680 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:08.864611 16456 leader_election.cc:343] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.864930 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:08.868839 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:08.870106 16801 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.870678 16801 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.872545 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:08.874622 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:08.875128 16490 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:08.879900 16605 leader_election.cc:343] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.879525 16776 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.881235 17055 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:06:08.883708 16776 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.885582 16776 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:08.900905 16681 tablet_bootstrap.cc:654] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.915998 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:08.916625 16680 ts_tablet_manager.cc:1434] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.115s	user 0.003s	sys 0.003s
W20260709 13:06:08.934583 16605 leader_election.cc:343] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.932729 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:08.937906 16489 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:08.934481 16604 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:08.950848 16680 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:08.951928 16864 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.954795 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:08.955334 16682 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:08.955672 16682 ts_tablet_manager.cc:1403] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.274s	user 0.014s	sys 0.007s
I20260709 13:06:08.963603 17036 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.963125 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:08.964053 17036 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.969431 16680 tablet_bootstrap.cc:654] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.964303 17041 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.975063 16682 raft_consensus.cc:359] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.975687 16682 raft_consensus.cc:385] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.975955 16682 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.976591 16682 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.965119 17036 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.978844 16682 ts_tablet_manager.cc:1434] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:06:08.979620 16682 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Bootstrap starting.
I20260709 13:06:08.990445 17036 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:08.993803 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:08.994292 16490 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.995003 16682 tablet_bootstrap.cc:654] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.003243 17036 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:09.004156 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:09.005369 16605 leader_election.cc:343] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.006852 16490 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:09.109342 16681 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: No bootstrap required, opened a new log
I20260709 13:06:09.120175 16681 ts_tablet_manager.cc:1403] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Time spent bootstrapping tablet: real 0.298s	user 0.014s	sys 0.005s
I20260709 13:06:09.371858 17090 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.372704 17090 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.385399 16682 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: No bootstrap required, opened a new log
I20260709 13:06:09.385979 16682 ts_tablet_manager.cc:1403] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Time spent bootstrapping tablet: real 0.407s	user 0.022s	sys 0.022s
I20260709 13:06:09.387055 17090 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:09.390743 16991 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.391185 16991 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.393772 16991 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:09.397871 16682 raft_consensus.cc:359] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.398633 16682 raft_consensus.cc:385] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.399036 16682 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.561480 16682 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.563293 16682 ts_tablet_manager.cc:1434] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Time spent starting tablet: real 0.177s	user 0.007s	sys 0.000s
I20260709 13:06:09.575614 16776 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.576079 16776 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.577898 16776 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:09.590391 16680 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.592903 16680 ts_tablet_manager.cc:1403] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.645s	user 0.086s	sys 0.084s
I20260709 13:06:09.595669 16680 raft_consensus.cc:359] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.597553 16681 raft_consensus.cc:359] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.605939 16681 raft_consensus.cc:385] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.606956 16681 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.605866 16680 raft_consensus.cc:385] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.608043 16680 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.611289 16681 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.612354 16680 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.622733 16680 ts_tablet_manager.cc:1434] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:06:09.632155 16681 ts_tablet_manager.cc:1434] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Time spent starting tablet: real 0.511s	user 0.007s	sys 0.001s
W20260709 13:06:09.632531 16681 ts_tablet_manager.cc:1467] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Tablet startup took 511ms
W20260709 13:06:09.632903 16681 ts_tablet_manager.cc:1469] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Trace:
0709 13:06:02.420269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.420597 (+   328us) service_pool.cc:224] Handling call
0709 13:06:02.422197 (+  1600us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:02.422282 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:02.462249 (+ 39967us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:02.467741 (+  5492us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:02.468089 (+   348us) inbound_call.cc:177] Queueing success response
0709 13:06:08.822315 (+6354226us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:09.120761 (+298446us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:09.343070 (+222309us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:09.343531 (+   461us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":251782,"raft.queue_time_us":6783,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5651,"tablet-open.queue_time_us":6354260}
I20260709 13:06:09.635282 16680 tablet_bootstrap.cc:492] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:09.643451 16680 tablet_bootstrap.cc:654] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.663892 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:09.665591 17036 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.666038 17036 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:09.666783 17036 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.664120 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:09.676477 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:09.681530 17091 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.691499 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:09.692307 16489 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:09.697515 16564 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.703289 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:09.703979 16491 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:09.709983 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:09.710616 16491 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 0.
I20260709 13:06:09.720659 16389 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.727648 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:09.728408 17036 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.728793 17036 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.729122 17036 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.739590 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:09.740294 17091 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:09.740664 17091 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.740978 17091 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.751454 17036 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.756222 17091 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.759624 17036 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:09.761783 16680 tablet_bootstrap.cc:492] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.765549 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:09.767733 16489 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.770447 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:09.770800 17091 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:09.771024 16485 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.772713 16680 ts_tablet_manager.cc:1403] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.138s	user 0.045s	sys 0.052s
I20260709 13:06:09.776938 16489 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:09.777693 16485 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:09.778751 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:09.779850 17036 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.779908 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:09.780684 17090 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:09.781139 17090 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:09.781888 17090 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.780475 17036 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:09.784731 17036 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.790025 16680 raft_consensus.cc:359] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.790644 16680 raft_consensus.cc:385] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.790911 16680 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.787181 16530 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:09.791443 16680 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.793639 17086 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.794859 16680 ts_tablet_manager.cc:1434] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.002s
I20260709 13:06:09.796211 16680 tablet_bootstrap.cc:492] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:09.800858 17086 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.812639 16680 tablet_bootstrap.cc:654] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.841523 16563 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:09.849548 16680 tablet_bootstrap.cc:492] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.850036 16680 ts_tablet_manager.cc:1403] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.054s	user 0.003s	sys 0.014s
I20260709 13:06:09.852572 16680 raft_consensus.cc:359] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.853184 16680 raft_consensus.cc:385] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.853130 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:09.853577 16680 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.854163 16680 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.857568 16680 ts_tablet_manager.cc:1434] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:09.858435 16680 tablet_bootstrap.cc:492] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:09.863518 16680 tablet_bootstrap.cc:654] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.874320 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:09.877506 16388 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.880944 16388 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 0 to 1, leader changed from <none> to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.886511 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:09.887012 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:09.895153 16680 tablet_bootstrap.cc:492] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.895586 16680 ts_tablet_manager.cc:1403] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.015s
I20260709 13:06:09.898061 16680 raft_consensus.cc:359] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.898648 16680 raft_consensus.cc:385] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.898882 16680 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.899580 16680 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.901747 16680 ts_tablet_manager.cc:1434] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:06:09.904601 16605 leader_election.cc:343] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.907603 17037 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:09.915447 16605 leader_election.cc:343] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:09.916450 16605 leader_election.cc:343] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.902577 16680 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
W20260709 13:06:09.920780 16605 leader_election.cc:343] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:09.921872 16680 tablet_bootstrap.cc:654] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.931291 16680 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.931660 16680 ts_tablet_manager.cc:1403] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.008s
I20260709 13:06:09.934119 16680 raft_consensus.cc:359] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.934733 16680 raft_consensus.cc:385] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.934976 16680 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.935560 16680 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.937490 16680 ts_tablet_manager.cc:1434] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:09.938292 16680 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:09.942353 16680 tablet_bootstrap.cc:654] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.943732 16991 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.944123 16991 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.945958 16991 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:09.948491 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:09.949231 16680 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.949671 16680 ts_tablet_manager.cc:1403] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:06:09.949605 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:09.951002 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:09.951511 16991 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:09.952404 16680 raft_consensus.cc:359] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.952824 16680 raft_consensus.cc:385] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.953011 16680 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.953473 16680 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.954856 16680 ts_tablet_manager.cc:1434] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:09.955605 16680 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:09.959267 16680 tablet_bootstrap.cc:654] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.962579 16680 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.962903 16680 ts_tablet_manager.cc:1403] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:09.964510 16680 raft_consensus.cc:359] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.964912 16680 raft_consensus.cc:385] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.965070 16680 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.965449 16680 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.966815 16680 ts_tablet_manager.cc:1434] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:06:09.967566 16680 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:09.971190 16680 tablet_bootstrap.cc:654] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.974737 16680 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.975100 16680 ts_tablet_manager.cc:1403] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:09.977918 16680 raft_consensus.cc:359] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.978520 16680 raft_consensus.cc:385] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.978765 16680 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.979310 16680 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.981060 16680 ts_tablet_manager.cc:1434] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:09.982049 16680 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:09.986799 16680 tablet_bootstrap.cc:654] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:09.990718 16680 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:09.991077 16680 ts_tablet_manager.cc:1403] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:09.993328 16680 raft_consensus.cc:359] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.993786 16680 raft_consensus.cc:385] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:09.993968 16680 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:09.994508 16680 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:09.996012 16680 ts_tablet_manager.cc:1434] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:09.996701 16680 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:10.000525 16680 tablet_bootstrap.cc:654] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.006142 16680 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:10.006506 16680 ts_tablet_manager.cc:1403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:06:10.008747 16680 raft_consensus.cc:359] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.009341 16680 raft_consensus.cc:385] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.009575 16680 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.010123 16680 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.012028 16680 ts_tablet_manager.cc:1434] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:06:10.012809 16680 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Bootstrap starting.
I20260709 13:06:10.017135 16680 tablet_bootstrap.cc:654] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:10.019649 16563 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.038280 16680 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: No bootstrap required, opened a new log
I20260709 13:06:10.038714 16680 ts_tablet_manager.cc:1403] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 13:06:10.041149 16680 raft_consensus.cc:359] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.041729 16680 raft_consensus.cc:385] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:10.041980 16680 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Initialized, Role: FOLLOWER
I20260709 13:06:10.042622 16680 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.044570 16680 ts_tablet_manager.cc:1434] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:10.050594 16563 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.067494 16563 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.077919 17053 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.078374 17053 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.080626 17053 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:10.081558 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:10.081733 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:10.082320 16635 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:10.082369 16485 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:10.083451 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:10.084251 17053 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.089859 17053 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.105549 16562 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.144908 17053 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.145367 17053 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.146862 17053 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:10.146932 16592 tablet.cc:2406] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:10.147430 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:10.147673 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:10.148229 16485 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:10.149075 16530 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:10.149591 17053 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.155853 17053 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.158399 16776 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.164551 17053 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.164999 17053 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.166929 17053 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:10.167968 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:10.168252 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:10.169656 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:10.170751 17053 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.173163 16776 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.188637 17053 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.188988 17053 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.190436 17053 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:10.190775 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:10.191397 16489 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:10.191817 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:10.193172 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:10.193790 17053 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.198285 17053 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.209612 16562 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.260514 17053 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.261065 17053 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.263039 17053 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:10.267335 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:10.267359 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:10.268230 16489 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 1: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:10.271096 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:10.271620 16991 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:10.276417 16991 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:10.312057 16776 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.320284 17037 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.357990 17037 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:10.367255 17037 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:10.402482 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08001952c0 after lost signal to thread 15387
W20260709 13:06:10.403244 16420 debug-util.cc:398] Leaking SignalData structure 0x7b080003b600 after lost signal to thread 16423
W20260709 13:06:10.404114 16420 debug-util.cc:398] Leaking SignalData structure 0x7b080029aa00 after lost signal to thread 16515
W20260709 13:06:10.404770 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08002332e0 after lost signal to thread 16590
W20260709 13:06:10.405405 16420 debug-util.cc:398] Leaking SignalData structure 0x7b0800271920 after lost signal to thread 16664
W20260709 13:06:10.713148 16437 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:10.853183 17061 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.853678 17061 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.855574 17061 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:10.856588 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:10.857172 16635 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:10.858217 16455 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:10.858425 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:10.858934 17061 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:10.859300 17061 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.859644 17061 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.858927 16565 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:10.865622 17061 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.867429 17061 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:10.868312 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:10.869642 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:10.869709 16638 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.870240 16565 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.877300 16638 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:10.878182 16455 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:10.878597 16565 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:10.878849 17061 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:10.879307 17061 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:10.881316 17061 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:10.905280 16386 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 0 to 2, leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.324167 16562 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:11.325291 17136 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.341769 16634 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:11.349009 17136 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:11.352371 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:11.395337 17141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:11.398466 17142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:11.398484 17145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:11.399842 15384 server_base.cc:1061] running on GCE node
I20260709 13:06:11.402208 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:11.402419 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:11.402588 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602371402571 us; error 0 us; skew 500 ppm
I20260709 13:06:11.403147 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:11.406077 15384 webserver.cc:533] Webserver started at http://127.15.6.4:46393/ using document root <none> and password file <none>
I20260709 13:06:11.406585 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:11.406785 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:11.407177 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:11.408838 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-3-root/instance:
uuid: "16b5b367990f4b5c862484bdec0b9226"
format_stamp: "Formatted at 2026-07-09 13:06:11 on dist-test-slave-pqzm"
I20260709 13:06:11.414808 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:06:11.418919 17150 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:11.423851 15384 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.000s
I20260709 13:06:11.424201 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-3-root
uuid: "16b5b367990f4b5c862484bdec0b9226"
format_stamp: "Formatted at 2026-07-09 13:06:11 on dist-test-slave-pqzm"
I20260709 13:06:11.424757 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:11.441279 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:11.442924 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:11.444859 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:11.469157 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:11.469429 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:11.469743 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:11.469926 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:11.562458 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.4:44223
I20260709 13:06:11.562600 17212 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.4:44223 every 8 connection(s)
I20260709 13:06:11.566447 15384 auto_leader_rebalancer-test.cc:384] add a tserver: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:11.590780 17213 heartbeater.cc:344] Connected to a master server at 127.15.6.62:43625
I20260709 13:06:11.591171 17213 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:11.591899 17213 heartbeater.cc:507] Master 127.15.6.62:43625 requested a full tablet report, sending...
I20260709 13:06:11.593760 16386 ts_manager.cc:194] Registered new tserver with Master: 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:11.595011 16386 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59724
I20260709 13:06:11.799638 16489 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:11.805832 16634 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.808602 17136 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.817669 16563 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.819591 17136 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:11.826249 17092 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.827708 16634 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:11.848723 16563 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:11.858299 16386 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:11.861613 16454 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f3eed6f88504d69aad570d8cc480623. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.873783 16634 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:11.881108 16485 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.886831 17135 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.891785 16563 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.898381 17135 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.915819 17228 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:11.934587 16485 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:11.950188 16563 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:11.974516 16389 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:06:12.118960 16603 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f66755c5c9714ae1858e6df5473a5cd6. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:12.136968 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 106662us
I20260709 13:06:12.141255 16561 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.212312 16485 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.212417 16635 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.215387 17235 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.216197 17125 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:12.238449 16529 consensus_peers.cc:597] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d64e83e5333143e393eb71aac8666e63. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.243928 17241 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:12.246659 16489 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:12.260025 16636 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:12.265034 16485 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.264798 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:12.288842 16454 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd0cddf61354438cac7dda825626e2c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.289467 17249 ts_tablet_manager.cc:933] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:12.290836 16635 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.291010 16563 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.292901 17136 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.298285 17136 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.304009 17249 tablet_copy_client.cc:323] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:12.319739 17242 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:12.326494 16561 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:12.346601 16389 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:12.348738 17251 ts_tablet_manager.cc:933] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:12.353300 17251 tablet_copy_client.cc:323] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:12.354892 16636 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:12.387898 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet f66755c5c9714ae1858e6df5473a5cd6 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:12.388444 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet f66755c5c9714ae1858e6df5473a5cd6 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-f66755c5c9714ae1858e6df5473a5cd6
I20260709 13:06:12.394101 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet 6f3eed6f88504d69aad570d8cc480623 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:12.394652 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet 6f3eed6f88504d69aad570d8cc480623 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-6f3eed6f88504d69aad570d8cc480623
I20260709 13:06:12.396239 16650 tablet_copy_source_session.cc:215] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.401620 16501 tablet_copy_source_session.cc:215] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.405226 17251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66755c5c9714ae1858e6df5473a5cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.405817 17249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3eed6f88504d69aad570d8cc480623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.436224 17251 tablet_copy_client.cc:806] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.436821 17251 tablet_copy_client.cc:670] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.440841 17251 tablet_copy_client.cc:538] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.454073 17251 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:12.484755 17249 tablet_copy_client.cc:806] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.489029 17249 tablet_copy_client.cc:670] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.490410 17251 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.491366 17251 tablet_bootstrap.cc:492] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:12.492044 17251 ts_tablet_manager.cc:1403] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.008s
I20260709 13:06:12.492447 17249 tablet_copy_client.cc:538] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.495303 17251 raft_consensus.cc:359] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.496199 17251 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:12.496831 17251 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.500383 17249 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:12.505045 17213 heartbeater.cc:499] Master 127.15.6.62:43625 was elected leader, sending a full tablet report...
I20260709 13:06:12.506062 17251 ts_tablet_manager.cc:1434] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:06:12.508790 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-f66755c5c9714ae1858e6df5473a5cd6 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:12.509244 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-f66755c5c9714ae1858e6df5473a5cd6 on tablet f66755c5c9714ae1858e6df5473a5cd6 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:12.534093 17249 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.534865 17249 tablet_bootstrap.cc:492] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:12.535506 17249 ts_tablet_manager.cc:1403] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.011s
I20260709 13:06:12.538115 17249 raft_consensus.cc:359] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.538890 17249 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:12.539484 17249 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.541750 17249 ts_tablet_manager.cc:1434] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:12.543609 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-6f3eed6f88504d69aad570d8cc480623 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:12.544037 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-6f3eed6f88504d69aad570d8cc480623 on tablet 6f3eed6f88504d69aad570d8cc480623 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:12.588003 17249 ts_tablet_manager.cc:933] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:12.589839 17249 tablet_copy_client.cc:323] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:12.605110 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet d64e83e5333143e393eb71aac8666e63 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:12.605628 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet d64e83e5333143e393eb71aac8666e63 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-d64e83e5333143e393eb71aac8666e63
I20260709 13:06:12.613886 16576 tablet_copy_source_session.cc:215] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.618660 17249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e83e5333143e393eb71aac8666e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.644335 17249 tablet_copy_client.cc:806] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.645280 17249 tablet_copy_client.cc:670] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.648833 17249 tablet_copy_client.cc:538] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.656757 17249 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:12.683538 17249 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.684393 17249 tablet_bootstrap.cc:492] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:12.685027 17249 ts_tablet_manager.cc:1403] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 13:06:12.689865 17249 raft_consensus.cc:359] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.692224 17251 ts_tablet_manager.cc:933] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:12.692174 17249 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:12.692982 17249 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.695559 17249 ts_tablet_manager.cc:1434] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:06:12.700001 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-d64e83e5333143e393eb71aac8666e63 received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:12.700412 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-d64e83e5333143e393eb71aac8666e63 on tablet d64e83e5333143e393eb71aac8666e63 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:12.732259 17251 tablet_copy_client.cc:323] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:12.734009 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet cd0cddf61354438cac7dda825626e2c5 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:12.734503 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet cd0cddf61354438cac7dda825626e2c5 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-cd0cddf61354438cac7dda825626e2c5
I20260709 13:06:12.750183 16501 tablet_copy_source_session.cc:215] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.755635 17251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0cddf61354438cac7dda825626e2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.763082 17187 raft_consensus.cc:1217] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:12.791867 17251 tablet_copy_client.cc:806] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.792467 17251 tablet_copy_client.cc:670] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.795872 17251 tablet_copy_client.cc:538] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.804384 17251 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:12.848405 17251 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.853650 17251 tablet_bootstrap.cc:492] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:12.854389 17251 ts_tablet_manager.cc:1403] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.020s
I20260709 13:06:12.857079 17187 raft_consensus.cc:1217] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:12.857278 17251 raft_consensus.cc:359] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.858083 17251 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:12.859966 17251 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:12.872431 17251 ts_tablet_manager.cc:1434] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:06:12.875568 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-cd0cddf61354438cac7dda825626e2c5 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:12.875985 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-cd0cddf61354438cac7dda825626e2c5 on tablet cd0cddf61354438cac7dda825626e2c5 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:13.102998 17187 raft_consensus.cc:1217] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.195885 17187 raft_consensus.cc:1217] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.336874 17136 raft_consensus.cc:1064] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:13.340258 17136 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.347828 16636 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.349551 17238 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.350045 17187 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.351656 17242 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.354805 16562 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.356046 17238 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.380144 17135 raft_consensus.cc:1064] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:13.382767 17135 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.405320 17242 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.408747 16562 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.418074 17187 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.435587 16389 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.437686 17188 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.440068 17271 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.442273 16486 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.453639 16561 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.455826 17273 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.461663 17273 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:13.510103 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51574.3us
I20260709 13:06:13.515359 17243 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.516914 16636 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.523254 16489 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.554824 16561 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.560099 17187 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.580892 17242 raft_consensus.cc:1064] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:13.583177 17242 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.586999 16489 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.594038 16389 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.616752 16563 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.619726 17136 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.613921 17187 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.629928 17276 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.632434 17238 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.637329 16563 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.645136 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f3eed6f88504d69aad570d8cc480623 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:13.645200 17187 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.647496 16561 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.648568 17276 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.650375 17188 raft_consensus.cc:2955] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.656155 17268 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.664724 16634 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.672173 17268 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.672111 16636 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.680904 16489 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.680905 17186 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.682513 17243 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:13.683754 17271 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.683518 16388 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.693893 17273 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.699851 17186 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.705847 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f66755c5c9714ae1858e6df5473a5cd6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:13.706264 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f3eed6f88504d69aad570d8cc480623 with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:13.709090 16486 raft_consensus.cc:2955] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.717846 16389 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:13.719023 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51561.7us
I20260709 13:06:13.722304 17288 tablet_replica.cc:333] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:13.742875 17288 raft_consensus.cc:2243] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:13.743475 17288 raft_consensus.cc:2272] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:13.749188 17288 ts_tablet_manager.cc:1916] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:13.758057 17241 raft_consensus.cc:1064] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:13.760456 17241 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.767261 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet f66755c5c9714ae1858e6df5473a5cd6 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:13.787256 17288 ts_tablet_manager.cc:1929] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:06:13.789413 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 114680us
I20260709 13:06:13.799032 16636 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.802266 17290 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.811767 16486 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.811782 17238 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.787781 17288 log.cc:1199] T 6f3eed6f88504d69aad570d8cc480623 P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/6f3eed6f88504d69aad570d8cc480623
I20260709 13:06:13.820211 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet 6f3eed6f88504d69aad570d8cc480623 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:13.824013 17188 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.831408 16564 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.842868 17241 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.847422 17241 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.854087 17292 tablet_replica.cc:333] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:13.865986 16388 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.868081 17292 raft_consensus.cc:2243] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:13.868851 17292 raft_consensus.cc:2272] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:13.870844 17186 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.882637 16634 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.898694 17292 ts_tablet_manager.cc:1916] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:13.905534 17241 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.907763 16486 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:06:13.915865 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 75279.3us
I20260709 13:06:13.915010 17188 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.921162 16489 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.932483 16635 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.942441 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.950516 16636 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.953373 17287 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:13.959276 17188 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.960619 17287 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:06:13.969610 16564 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:13.975660 16634 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.977078 17241 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:06:13.980268 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44046.8us
I20260709 13:06:13.984362 17186 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.984519 17296 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.989990 17293 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:13.998637 17292 ts_tablet_manager.cc:1929] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:13.996821 16634 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:14.003573 17188 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.005689 16388 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:14.002885 16638 raft_consensus.cc:2955] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:14.014911 17241 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.018740 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet cd0cddf61354438cac7dda825626e2c5 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:14.022732 17292 log.cc:1199] T f66755c5c9714ae1858e6df5473a5cd6 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/f66755c5c9714ae1858e6df5473a5cd6
I20260709 13:06:14.023411 17188 raft_consensus.cc:2955] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:14.024924 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet f66755c5c9714ae1858e6df5473a5cd6 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:14.024482 17292 tablet_replica.cc:333] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:14.031040 17292 raft_consensus.cc:2243] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.031670 17292 raft_consensus.cc:2272] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.035392 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d64e83e5333143e393eb71aac8666e63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.035828 17292 ts_tablet_manager.cc:1916] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.036805 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cd0cddf61354438cac7dda825626e2c5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.045459 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:14.067435 16472 tablet_service.cc:1558] Processing DeleteTablet for tablet d64e83e5333143e393eb71aac8666e63 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:14.082430 17292 ts_tablet_manager.cc:1929] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.082859 17292 log.cc:1199] T cd0cddf61354438cac7dda825626e2c5 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/cd0cddf61354438cac7dda825626e2c5
I20260709 13:06:14.084403 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet cd0cddf61354438cac7dda825626e2c5 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:14.086998 17299 tablet_replica.cc:333] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:14.087908 17299 raft_consensus.cc:2243] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.088912 17299 raft_consensus.cc:2272] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.091975 17299 ts_tablet_manager.cc:1916] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.102710 17299 ts_tablet_manager.cc:1929] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.102993 17299 log.cc:1199] T d64e83e5333143e393eb71aac8666e63 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/d64e83e5333143e393eb71aac8666e63
I20260709 13:06:14.104228 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet d64e83e5333143e393eb71aac8666e63 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:15.170007 16634 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.176798 16563 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:15.177773 16603 consensus_peers.cc:597] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b235e470ebe04d06993b8dd025e5871b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.178153 17135 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.178853 16485 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.180042 17135 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.185575 17300 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.188154 16564 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.195452 16489 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.211196 16563 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.215701 16386 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:06:15.241974 16529 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 318a7033cb194c3f8c635e0e36d5dc53. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.242270 16634 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.243743 17290 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.244740 16489 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.253328 17290 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.269733 17290 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.276549 16489 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.282877 16634 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.290158 16486 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.294270 16389 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.324326 16638 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:15.325649 16454 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ac4e93cad76428c81439a9c5471f994. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.326617 16563 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.327152 17286 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.328979 17287 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.336300 17301 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.337635 16563 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.345672 16638 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.365298 16563 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.366498 16388 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:06:15.372735 16529 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1d7270021514f3c83a70987981f65cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.373291 16634 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.375046 16486 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.376243 17293 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.379904 17293 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.395955 17307 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.401402 16486 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.407325 16636 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.418660 16386 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:15.609412 17319 ts_tablet_manager.cc:933] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:15.613387 17319 tablet_copy_client.cc:323] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:15.614902 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet b235e470ebe04d06993b8dd025e5871b from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:15.615434 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet b235e470ebe04d06993b8dd025e5871b from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-b235e470ebe04d06993b8dd025e5871b
I20260709 13:06:15.627862 16650 tablet_copy_source_session.cc:215] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:15.630224 17319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b235e470ebe04d06993b8dd025e5871b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.640146 17319 tablet_copy_client.cc:806] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:15.640615 17319 tablet_copy_client.cc:670] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:15.645247 17319 tablet_copy_client.cc:538] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:15.674780 17319 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:15.702209 17319 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:15.703069 17319 tablet_bootstrap.cc:492] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:15.703744 17319 ts_tablet_manager.cc:1403] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.013s
I20260709 13:06:15.706230 17319 raft_consensus.cc:359] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.706773 17319 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:15.707238 17319 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.709890 17319 ts_tablet_manager.cc:1434] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:15.711870 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-b235e470ebe04d06993b8dd025e5871b received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:15.712258 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-b235e470ebe04d06993b8dd025e5871b on tablet b235e470ebe04d06993b8dd025e5871b with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:15.727977 17319 ts_tablet_manager.cc:933] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:15.729522 17319 tablet_copy_client.cc:323] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:15.730996 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet 318a7033cb194c3f8c635e0e36d5dc53 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:15.731501 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet 318a7033cb194c3f8c635e0e36d5dc53 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-318a7033cb194c3f8c635e0e36d5dc53
I20260709 13:06:15.741724 16576 tablet_copy_source_session.cc:215] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:15.744837 17319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318a7033cb194c3f8c635e0e36d5dc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.766012 17319 tablet_copy_client.cc:806] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:15.766520 17319 tablet_copy_client.cc:670] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:15.768172 17324 ts_tablet_manager.cc:933] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:15.776165 17324 tablet_copy_client.cc:323] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:15.777648 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet 9ac4e93cad76428c81439a9c5471f994 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:15.778169 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet 9ac4e93cad76428c81439a9c5471f994 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-9ac4e93cad76428c81439a9c5471f994
I20260709 13:06:15.785516 16501 tablet_copy_source_session.cc:215] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:15.797967 17319 tablet_copy_client.cc:538] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:15.800144 17324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac4e93cad76428c81439a9c5471f994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.806667 17319 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:15.815591 17324 tablet_copy_client.cc:806] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:15.816095 17324 tablet_copy_client.cc:670] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:15.819603 17324 tablet_copy_client.cc:538] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:15.827615 17324 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:15.847935 17327 ts_tablet_manager.cc:933] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:15.855859 17327 tablet_copy_client.cc:323] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:15.859756 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet f1d7270021514f3c83a70987981f65cf from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:15.860285 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet f1d7270021514f3c83a70987981f65cf from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-f1d7270021514f3c83a70987981f65cf
I20260709 13:06:15.871012 17324 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:15.871877 17324 tablet_bootstrap.cc:492] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:15.879323 17324 ts_tablet_manager.cc:1403] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.001s
I20260709 13:06:15.880936 16576 tablet_copy_source_session.cc:215] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:15.882469 17324 raft_consensus.cc:359] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.883258 17324 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:15.883882 17324 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.892062 17327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d7270021514f3c83a70987981f65cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.907842 17319 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:15.908779 17319 tablet_bootstrap.cc:492] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:15.913962 17319 ts_tablet_manager.cc:1403] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.005s
I20260709 13:06:15.913039 17324 ts_tablet_manager.cc:1434] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:06:15.921737 17319 raft_consensus.cc:359] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.922545 17319 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:15.923408 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-9ac4e93cad76428c81439a9c5471f994 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:15.923192 17319 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.923753 17327 tablet_copy_client.cc:806] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:15.925092 17327 tablet_copy_client.cc:670] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:15.926074 17319 ts_tablet_manager.cc:1434] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:06:15.923857 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-9ac4e93cad76428c81439a9c5471f994 on tablet 9ac4e93cad76428c81439a9c5471f994 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:15.930034 17327 tablet_copy_client.cc:538] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:15.939597 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-318a7033cb194c3f8c635e0e36d5dc53 received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:15.940060 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-318a7033cb194c3f8c635e0e36d5dc53 on tablet 318a7033cb194c3f8c635e0e36d5dc53 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:15.952291 17327 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:15.986778 17327 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:15.987604 17327 tablet_bootstrap.cc:492] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:15.988248 17327 ts_tablet_manager.cc:1403] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.007s
I20260709 13:06:15.991175 17327 raft_consensus.cc:359] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.991973 17327 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:15.992574 17327 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:15.995057 17327 ts_tablet_manager.cc:1434] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:15.998628 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-f1d7270021514f3c83a70987981f65cf received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:15.999019 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-f1d7270021514f3c83a70987981f65cf on tablet f1d7270021514f3c83a70987981f65cf with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:16.067420 17188 raft_consensus.cc:1217] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.168849 17188 raft_consensus.cc:1217] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.299541 17188 raft_consensus.cc:1217] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.438972 17188 raft_consensus.cc:1217] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.495612 17135 raft_consensus.cc:1064] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:16.497782 17135 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:16.522408 17188 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.523676 17135 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.524268 16486 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.524333 16564 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.527679 17273 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.528748 17331 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.556231 17135 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.557927 16564 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.573388 17188 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.581174 16389 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.593550 16486 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.622859 16636 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:16.628033 17188 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:16.629922 17135 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.635051 16562 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:16.638620 17331 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.646806 17273 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.656497 17188 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.662894 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b235e470ebe04d06993b8dd025e5871b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:16.672365 16563 raft_consensus.cc:2955] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.698295 17332 raft_consensus.cc:1064] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:16.704927 17332 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:16.722326 16387 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.724982 16636 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.726610 17293 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.727851 16486 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.730692 17188 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.732609 17293 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.740227 17293 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.758481 16472 tablet_service.cc:1558] Processing DeleteTablet for tablet b235e470ebe04d06993b8dd025e5871b with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:16.757845 17332 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.779460 16489 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.793560 16636 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.795825 17188 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.811441 16386 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.825234 16562 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:16.835508 16489 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:16.837430 17186 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:16.838214 17332 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.840394 17290 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.847056 17346 tablet_replica.cc:333] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:16.848309 17290 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.851104 17346 raft_consensus.cc:2243] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:16.853124 17346 raft_consensus.cc:2272] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:16.856666 17346 ts_tablet_manager.cc:1916] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:16.857769 16489 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.862201 17287 raft_consensus.cc:1064] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:16.870929 17287 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:16.877723 16386 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.894596 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet 318a7033cb194c3f8c635e0e36d5dc53 with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:16.896346 17188 raft_consensus.cc:2955] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.911651 17346 ts_tablet_manager.cc:1929] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:16.912087 17346 log.cc:1199] T b235e470ebe04d06993b8dd025e5871b P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/b235e470ebe04d06993b8dd025e5871b
I20260709 13:06:16.913405 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet b235e470ebe04d06993b8dd025e5871b (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:16.919003 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 318a7033cb194c3f8c635e0e36d5dc53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:16.927459 17348 raft_consensus.cc:1064] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:16.929768 17348 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:16.934680 17350 tablet_replica.cc:333] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:16.936427 17350 raft_consensus.cc:2243] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:16.939159 16636 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.942572 17351 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.943745 17188 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.946831 16489 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.948235 16562 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.946875 16636 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.950785 17286 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.952945 17347 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.956509 17188 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.960903 17348 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.968670 17301 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.937142 17350 raft_consensus.cc:2272] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:16.973073 17350 ts_tablet_manager.cc:1916] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:16.979220 17348 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.982263 17187 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:16.987810 17351 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.005750 16386 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.007685 17290 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.009876 16636 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.025688 16489 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.032330 16563 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.052796 17186 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.061280 16386 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.059988 17350 ts_tablet_manager.cc:1929] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.078047 17350 log.cc:1199] T 318a7033cb194c3f8c635e0e36d5dc53 P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/318a7033cb194c3f8c635e0e36d5dc53
I20260709 13:06:17.090947 16563 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:17.094973 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet 318a7033cb194c3f8c635e0e36d5dc53 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:17.096097 16634 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.113672 16489 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:17.114730 16486 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.122181 17290 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.129626 17347 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.133031 16486 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.154131 17186 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.157552 17293 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:17.158416 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1d7270021514f3c83a70987981f65cf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.165957 16634 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.167203 17286 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.169691 17187 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.171422 17286 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.168262 17186 raft_consensus.cc:2955] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.180303 17351 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.182793 16636 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.186017 17187 raft_consensus.cc:2955] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.180823 16386 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.188724 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ac4e93cad76428c81439a9c5471f994 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.200212 16389 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:17.212067 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet f1d7270021514f3c83a70987981f65cf with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:17.212895 17350 tablet_replica.cc:333] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:17.213863 17350 raft_consensus.cc:2243] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.214111 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ac4e93cad76428c81439a9c5471f994 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:17.214501 17350 raft_consensus.cc:2272] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.217262 17361 tablet_replica.cc:333] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:17.218227 17350 ts_tablet_manager.cc:1916] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.218678 17361 raft_consensus.cc:2243] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.219391 17361 raft_consensus.cc:2272] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.225558 17361 ts_tablet_manager.cc:1916] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.231424 17350 ts_tablet_manager.cc:1929] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.231827 17350 log.cc:1199] T f1d7270021514f3c83a70987981f65cf P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/f1d7270021514f3c83a70987981f65cf
I20260709 13:06:17.235194 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet f1d7270021514f3c83a70987981f65cf (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:17.236871 17361 ts_tablet_manager.cc:1929] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.237201 17361 log.cc:1199] T 9ac4e93cad76428c81439a9c5471f994 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/9ac4e93cad76428c81439a9c5471f994
I20260709 13:06:17.238348 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet 9ac4e93cad76428c81439a9c5471f994 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:18.350900 16561 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.363202 16632 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:18.363546 16529 consensus_peers.cc:597] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd80ac0ca5c24b45831f9f1d02066656. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.363607 16485 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.365820 17362 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:18.367664 17290 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:18.380718 17368 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.382443 16486 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.385214 16635 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.399178 16561 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.417214 16389 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:06:18.420558 16529 consensus_peers.cc:597] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb5cfc5d25214ed5a2298f98f0b9a0a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.421727 16635 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.422331 16486 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.424170 17347 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:18.425279 17368 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.435212 17368 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.440053 16486 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.441089 16635 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.452539 16485 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.459002 16635 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.459939 16561 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:18.460234 16454 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6d40aa6b369461bb9f13d568e8450e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.460614 17369 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:18.461575 17370 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.479525 16635 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.477595 17369 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.478909 16388 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.483691 16561 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.496685 16485 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.504956 16635 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.506430 17369 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:18.507275 16454 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ddfb4b0791d74c589434dee63459ca4f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.507740 16389 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.515669 16561 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.516950 17363 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.523996 17369 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.525208 16632 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.541013 16388 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.551676 16561 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:18.750628 17389 ts_tablet_manager.cc:933] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:18.752460 17389 tablet_copy_client.cc:323] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:18.754175 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet dd80ac0ca5c24b45831f9f1d02066656 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:18.754738 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet dd80ac0ca5c24b45831f9f1d02066656 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-dd80ac0ca5c24b45831f9f1d02066656
I20260709 13:06:18.762672 16576 tablet_copy_source_session.cc:215] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:18.765877 17389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80ac0ca5c24b45831f9f1d02066656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.779567 17389 tablet_copy_client.cc:806] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:18.780278 17389 tablet_copy_client.cc:670] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:18.784337 17389 tablet_copy_client.cc:538] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:18.794441 17389 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:18.810065 17389 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:18.810925 17389 tablet_bootstrap.cc:492] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:18.811547 17389 ts_tablet_manager.cc:1403] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.009s
I20260709 13:06:18.814481 17389 raft_consensus.cc:359] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.815157 17389 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:18.815644 17389 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.818248 17389 ts_tablet_manager.cc:1434] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:18.823092 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-dd80ac0ca5c24b45831f9f1d02066656 received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:18.823514 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-dd80ac0ca5c24b45831f9f1d02066656 on tablet dd80ac0ca5c24b45831f9f1d02066656 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:18.885344 17389 ts_tablet_manager.cc:933] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:18.887660 17389 tablet_copy_client.cc:323] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:18.889173 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:18.889670 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-bb5cfc5d25214ed5a2298f98f0b9a0a9
I20260709 13:06:18.893576 17394 ts_tablet_manager.cc:933] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:18.897025 16576 tablet_copy_source_session.cc:215] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:18.899960 17389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.901597 17394 tablet_copy_client.cc:323] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:18.904956 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet ddfb4b0791d74c589434dee63459ca4f from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:18.905449 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet ddfb4b0791d74c589434dee63459ca4f from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-ddfb4b0791d74c589434dee63459ca4f
I20260709 13:06:18.916987 16501 tablet_copy_source_session.cc:215] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:18.919242 17394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfb4b0791d74c589434dee63459ca4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.921658 17389 tablet_copy_client.cc:806] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:18.922169 17389 tablet_copy_client.cc:670] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:18.925642 17389 tablet_copy_client.cc:538] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:18.930243 17394 tablet_copy_client.cc:806] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:18.930864 17394 tablet_copy_client.cc:670] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:18.933449 17389 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:18.933851 17394 tablet_copy_client.cc:538] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:18.940495 17394 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:18.955960 17389 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:18.956763 17389 tablet_bootstrap.cc:492] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:18.957357 17389 ts_tablet_manager.cc:1403] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.002s
I20260709 13:06:18.960000 17389 raft_consensus.cc:359] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.960789 17389 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:18.961380 17389 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.963582 17389 ts_tablet_manager.cc:1434] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:18.965139 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-bb5cfc5d25214ed5a2298f98f0b9a0a9 received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:18.965529 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-bb5cfc5d25214ed5a2298f98f0b9a0a9 on tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:18.967866 17389 ts_tablet_manager.cc:933] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:18.970357 17389 tablet_copy_client.cc:323] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:18.972185 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet a6d40aa6b369461bb9f13d568e8450e7 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:18.972678 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet a6d40aa6b369461bb9f13d568e8450e7 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-a6d40aa6b369461bb9f13d568e8450e7
W20260709 13:06:18.977490 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08002616c0 after lost signal to thread 15387
W20260709 13:06:18.978572 16420 debug-util.cc:398] Leaking SignalData structure 0x7b080020ad60 after lost signal to thread 16423
W20260709 13:06:18.979871 16420 debug-util.cc:398] Leaking SignalData structure 0x7b080003b760 after lost signal to thread 16515
I20260709 13:06:18.987733 16501 tablet_copy_source_session.cc:215] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:18.988375 16420 debug-util.cc:398] Leaking SignalData structure 0x7b0800261620 after lost signal to thread 16590
I20260709 13:06:18.987903 17394 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:06:18.989495 16420 debug-util.cc:398] Leaking SignalData structure 0x7b0800305300 after lost signal to thread 16664
I20260709 13:06:18.990262 17394 tablet_bootstrap.cc:492] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
W20260709 13:06:18.990710 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08000cb7a0 after lost signal to thread 17212
I20260709 13:06:18.991206 17394 ts_tablet_manager.cc:1403] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.007s
I20260709 13:06:18.991291 17389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d40aa6b369461bb9f13d568e8450e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.994240 17394 raft_consensus.cc:359] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:18.995065 17394 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:18.995769 17394 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:19.006598 17394 ts_tablet_manager.cc:1434] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.005s
I20260709 13:06:19.015961 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-ddfb4b0791d74c589434dee63459ca4f received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:19.016371 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-ddfb4b0791d74c589434dee63459ca4f on tablet ddfb4b0791d74c589434dee63459ca4f with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:19.016762 17389 tablet_copy_client.cc:806] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.017264 17389 tablet_copy_client.cc:670] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.020399 17389 tablet_copy_client.cc:538] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.027770 17389 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:19.067355 17389 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.069020 17389 tablet_bootstrap.cc:492] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:19.069655 17389 ts_tablet_manager.cc:1403] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.015s
I20260709 13:06:19.072111 17389 raft_consensus.cc:359] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:19.072886 17389 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:19.073474 17389 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:19.077716 17389 ts_tablet_manager.cc:1434] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:06:19.080188 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-a6d40aa6b369461bb9f13d568e8450e7 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:19.080576 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-a6d40aa6b369461bb9f13d568e8450e7 on tablet a6d40aa6b369461bb9f13d568e8450e7 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:19.362018 17186 raft_consensus.cc:1217] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.411996 17186 raft_consensus.cc:1217] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.457314 17186 raft_consensus.cc:1217] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.458704 17187 raft_consensus.cc:1217] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:06:19.482781 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 66272.3us
I20260709 13:06:19.768246 17406 raft_consensus.cc:1064] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:19.773255 17406 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:19.779870 16485 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.779878 16632 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.779914 17187 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.781816 17401 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.783807 17406 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.784667 17403 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.793280 17403 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:19.795217 17187 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:19.805923 16632 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:19.812161 17347 raft_consensus.cc:1064] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:19.814515 17347 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:19.817966 16485 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:19.843158 16636 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.844674 17401 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.828197 16386 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:19.852526 16485 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.854722 17401 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.852969 17187 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.860299 17347 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:19.869081 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 71335.4us
I20260709 13:06:19.890547 17401 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:19.964869 17188 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:19.993108 16632 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.004123 16491 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.025122 17423 raft_consensus.cc:1064] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:20.027455 17423 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:20.036931 16563 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.038097 17185 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.041754 17363 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.045495 17369 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.046949 16632 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.051517 17369 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:20.073326 17363 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.074978 16388 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.082593 17370 raft_consensus.cc:1064] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:20.083278 16562 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:20.086490 16636 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.099129 17185 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.100497 17347 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.086869 17370 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:20.106063 17186 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.109992 16563 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:20.114861 16388 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.116179 17405 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.121073 16636 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.127046 17347 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:20.144968 16634 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.147253 17186 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.150084 17401 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.150202 16632 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.129961 17185 raft_consensus.cc:2955] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.158416 17347 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:06:20.164521 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd80ac0ca5c24b45831f9f1d02066656 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.166168 17368 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.169128 16634 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.175429 17186 raft_consensus.cc:2955] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.184541 16389 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.185499 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.194664 16563 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:06:20.197351 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 61849.3us
I20260709 13:06:20.204370 17188 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.205307 16472 tablet_service.cc:1558] Processing DeleteTablet for tablet dd80ac0ca5c24b45831f9f1d02066656 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:20.206593 16632 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.208374 16563 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.210366 16491 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:20.207058 17423 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:06:20.219405 17369 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.222262 17429 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.224098 17188 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.227298 17423 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.231344 16634 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.244280 17429 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.247414 16387 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.250519 17188 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.264453 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:20.265583 17423 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.269335 17434 tablet_replica.cc:333] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:20.264492 17370 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:20.271337 16389 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.273831 16632 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.279039 17434 raft_consensus.cc:2243] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.280123 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6d40aa6b369461bb9f13d568e8450e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.284057 16634 raft_consensus.cc:2955] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.285306 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet a6d40aa6b369461bb9f13d568e8450e7 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:20.288007 17434 raft_consensus.cc:2272] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.289462 17185 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.297529 17438 tablet_replica.cc:333] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:20.299363 16563 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.300679 16389 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.303858 17438 raft_consensus.cc:2243] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.304637 17438 raft_consensus.cc:2272] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.307806 17438 ts_tablet_manager.cc:1916] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.325431 17438 ts_tablet_manager.cc:1929] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.325912 17438 log.cc:1199] T a6d40aa6b369461bb9f13d568e8450e7 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/a6d40aa6b369461bb9f13d568e8450e7
I20260709 13:06:20.327533 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet a6d40aa6b369461bb9f13d568e8450e7 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:20.339686 17434 ts_tablet_manager.cc:1916] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.339457 16486 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:20.346637 16563 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.348719 17188 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.349620 17370 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.351955 17423 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.356187 17429 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.357582 16564 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.363154 17434 ts_tablet_manager.cc:1929] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.364060 17185 raft_consensus.cc:2955] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:20.365383 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ddfb4b0791d74c589434dee63459ca4f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.369200 17434 log.cc:1199] T dd80ac0ca5c24b45831f9f1d02066656 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/dd80ac0ca5c24b45831f9f1d02066656
I20260709 13:06:20.371155 17434 tablet_replica.cc:333] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:20.371974 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet dd80ac0ca5c24b45831f9f1d02066656 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:20.373752 16388 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.372185 17434 raft_consensus.cc:2243] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.376789 17434 raft_consensus.cc:2272] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.382815 17434 ts_tablet_manager.cc:1916] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.390936 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet ddfb4b0791d74c589434dee63459ca4f with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:20.402156 17434 ts_tablet_manager.cc:1929] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.402637 17434 log.cc:1199] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/bb5cfc5d25214ed5a2298f98f0b9a0a9
I20260709 13:06:20.403960 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet bb5cfc5d25214ed5a2298f98f0b9a0a9 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:20.404073 17439 tablet_replica.cc:333] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:20.404829 17439 raft_consensus.cc:2243] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.405339 17439 raft_consensus.cc:2272] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.407931 17439 ts_tablet_manager.cc:1916] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.417171 17439 ts_tablet_manager.cc:1929] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.417428 17439 log.cc:1199] T ddfb4b0791d74c589434dee63459ca4f P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/ddfb4b0791d74c589434dee63459ca4f
I20260709 13:06:20.418678 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet ddfb4b0791d74c589434dee63459ca4f (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:21.453608 16564 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:21.458546 16632 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:21.458770 16486 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:21.460109 17442 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:21.460884 16529 consensus_peers.cc:597] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18244033cce043c69c8f4584b91ddc0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.460928 17440 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:21.467597 17442 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.468995 16632 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.470311 16486 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.487999 16564 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:21.489768 16388 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:06:21.499012 16529 consensus_peers.cc:597] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd6d2553f797441c910fb72d81b1049f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.500689 16491 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:21.502802 16632 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:21.502874 17447 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:21.504154 17440 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:21.514537 17447 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.516067 16634 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.516513 16486 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.537640 16634 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:21.540277 16388 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.547626 16561 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:21.547742 16603 consensus_peers.cc:597] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4a969bf0b354736bf91615b8648cf36. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.547766 16486 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:21.550073 17419 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:21.551573 17422 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:21.567847 17419 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.573297 16486 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.574745 16561 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.584824 16634 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:21.596254 16388 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.597836 16485 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:21.599807 16603 consensus_peers.cc:597] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1b4ff396aa14325948460c8a0fcd925. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.600760 17422 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:21.603255 16561 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:21.604406 17422 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:21.617123 17457 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.619104 16485 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.621775 16563 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:21.668427 16389 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.937537 17463 ts_tablet_manager.cc:933] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:21.939234 17463 tablet_copy_client.cc:323] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:21.940573 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet cd6d2553f797441c910fb72d81b1049f from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:21.941007 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet cd6d2553f797441c910fb72d81b1049f from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-cd6d2553f797441c910fb72d81b1049f
I20260709 13:06:21.948755 16576 tablet_copy_source_session.cc:215] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:21.958297 17463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6d2553f797441c910fb72d81b1049f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:21.974586 17463 tablet_copy_client.cc:806] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:21.975075 17463 tablet_copy_client.cc:670] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:21.979405 17463 tablet_copy_client.cc:538] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:21.987185 17463 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:22.001384 17466 ts_tablet_manager.cc:933] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:22.003008 17463 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.003221 17466 tablet_copy_client.cc:323] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:22.003909 17463 tablet_bootstrap.cc:492] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:22.004516 17463 ts_tablet_manager.cc:1403] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.013s
I20260709 13:06:22.005074 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet e1b4ff396aa14325948460c8a0fcd925 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:22.005479 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet e1b4ff396aa14325948460c8a0fcd925 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-e1b4ff396aa14325948460c8a0fcd925
I20260709 13:06:22.008005 17463 raft_consensus.cc:359] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.008805 17463 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:22.009424 17463 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.012493 17463 ts_tablet_manager.cc:1434] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:22.012723 16650 tablet_copy_source_session.cc:215] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.014056 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-cd6d2553f797441c910fb72d81b1049f received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:22.014456 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-cd6d2553f797441c910fb72d81b1049f on tablet cd6d2553f797441c910fb72d81b1049f with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:22.017510 17469 ts_tablet_manager.cc:933] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:22.017776 17466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b4ff396aa14325948460c8a0fcd925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.024613 17469 tablet_copy_client.cc:323] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:22.026177 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet d4a969bf0b354736bf91615b8648cf36 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:22.026640 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet d4a969bf0b354736bf91615b8648cf36 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-d4a969bf0b354736bf91615b8648cf36
I20260709 13:06:22.031297 16650 tablet_copy_source_session.cc:215] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.035259 17469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a969bf0b354736bf91615b8648cf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.037822 17466 tablet_copy_client.cc:806] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.038370 17466 tablet_copy_client.cc:670] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.041916 17466 tablet_copy_client.cc:538] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.042763 17463 ts_tablet_manager.cc:933] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:22.050438 17466 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:22.053573 17463 tablet_copy_client.cc:323] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:22.054261 17469 tablet_copy_client.cc:806] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.055095 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet 18244033cce043c69c8f4584b91ddc0d from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:22.055153 17469 tablet_copy_client.cc:670] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.055549 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet 18244033cce043c69c8f4584b91ddc0d from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-18244033cce043c69c8f4584b91ddc0d
I20260709 13:06:22.059059 17469 tablet_copy_client.cc:538] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.062278 16576 tablet_copy_source_session.cc:215] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.065016 17463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18244033cce043c69c8f4584b91ddc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.067531 17469 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:22.082980 17463 tablet_copy_client.cc:806] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.084065 17463 tablet_copy_client.cc:670] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.087347 17463 tablet_copy_client.cc:538] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.096112 17463 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:22.101519 17469 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.102389 17469 tablet_bootstrap.cc:492] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:22.103000 17469 ts_tablet_manager.cc:1403] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.013s
I20260709 13:06:22.105793 17469 raft_consensus.cc:359] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.107481 17469 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:22.108094 17469 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.109036 17466 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.109848 17466 tablet_bootstrap.cc:492] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:22.110461 17466 ts_tablet_manager.cc:1403] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.009s
I20260709 13:06:22.110740 17469 ts_tablet_manager.cc:1434] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:06:22.117022 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-d4a969bf0b354736bf91615b8648cf36 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:22.117455 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-d4a969bf0b354736bf91615b8648cf36 on tablet d4a969bf0b354736bf91615b8648cf36 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:22.116238 17466 raft_consensus.cc:359] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.123915 17466 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:22.124553 17466 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.127646 17463 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.128501 17463 tablet_bootstrap.cc:492] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:22.129112 17463 ts_tablet_manager.cc:1403] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.004s
I20260709 13:06:22.131538 17466 ts_tablet_manager.cc:1434] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:06:22.133275 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-e1b4ff396aa14325948460c8a0fcd925 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:22.133667 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-e1b4ff396aa14325948460c8a0fcd925 on tablet e1b4ff396aa14325948460c8a0fcd925 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:22.136073 17463 raft_consensus.cc:359] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.137718 17463 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:22.138325 17463 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:22.140803 17463 ts_tablet_manager.cc:1434] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:22.142499 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-18244033cce043c69c8f4584b91ddc0d received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:22.142876 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-18244033cce043c69c8f4584b91ddc0d on tablet 18244033cce043c69c8f4584b91ddc0d with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:22.449960 17185 raft_consensus.cc:1217] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:22.533236 17185 raft_consensus.cc:1217] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:22.539831 17185 raft_consensus.cc:1217] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:22.599855 17185 raft_consensus.cc:1217] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:22.957932 17456 raft_consensus.cc:1064] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:22.961104 17456 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:22.967974 17188 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:22.968372 16563 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:22.969344 17422 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:22.970434 17456 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:22.971168 16486 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:22.972568 17422 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:22.985500 17422 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:22.997704 17188 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:22.999303 17456 raft_consensus.cc:1064] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:23.001504 17456 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:23.004197 16486 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.035125 16389 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.040143 17185 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.047030 17419 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.050599 16486 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.051884 17456 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.053714 17447 raft_consensus.cc:1064] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:23.056313 16561 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.056424 17447 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:23.058858 16561 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.066447 16632 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.068339 17188 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.068619 17456 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:23.067842 17476 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:23.074673 17476 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.075585 17483 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.076861 16486 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.080905 16486 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.088655 17447 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.088361 17188 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:06:23.113510 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 44247.8us
I20260709 13:06:23.122815 17491 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.131418 16491 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.140182 16561 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.146589 17492 raft_consensus.cc:1064] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:23.148990 17492 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:23.145773 16632 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.155061 16634 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:23.172164 17188 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.192637 16386 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.194371 16386 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.208654 17188 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.210078 17483 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.215613 16486 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.219805 17419 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.220566 17483 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.224891 17185 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.231482 16634 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.232857 17492 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.236356 16491 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.236759 17186 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.238708 17491 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.239586 17492 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.249344 16486 raft_consensus.cc:2955] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.255155 16637 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:23.261531 16389 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.269492 17188 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.269721 16564 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.270691 17419 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.276855 17456 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.285780 17187 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.289549 17422 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.305564 16561 raft_consensus.cc:2955] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.285712 16563 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:23.312387 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1b4ff396aa14325948460c8a0fcd925 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:23.316115 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d4a969bf0b354736bf91615b8648cf36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:23.320586 17185 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.322108 17492 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.339550 17447 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.340170 16387 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.350210 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet e1b4ff396aa14325948460c8a0fcd925 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:23.358834 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a969bf0b354736bf91615b8648cf36 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:23.360235 17185 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.365610 17506 tablet_replica.cc:333] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:23.368285 17506 raft_consensus.cc:2243] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:23.369112 17506 raft_consensus.cc:2272] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:23.367120 17505 tablet_replica.cc:333] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:23.375823 17491 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.378556 16486 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.381237 17505 raft_consensus.cc:2243] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:23.382469 17476 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.386045 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cd6d2553f797441c910fb72d81b1049f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:23.385761 17505 raft_consensus.cc:2272] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:23.397378 17505 ts_tablet_manager.cc:1916] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:23.398592 16486 raft_consensus.cc:2955] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.402941 17186 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.405097 17506 ts_tablet_manager.cc:1916] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:23.409524 16386 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.427906 17505 ts_tablet_manager.cc:1929] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:23.429589 17505 log.cc:1199] T e1b4ff396aa14325948460c8a0fcd925 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/e1b4ff396aa14325948460c8a0fcd925
I20260709 13:06:23.429176 17506 ts_tablet_manager.cc:1929] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:23.431162 17506 log.cc:1199] T d4a969bf0b354736bf91615b8648cf36 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/d4a969bf0b354736bf91615b8648cf36
I20260709 13:06:23.433368 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet d4a969bf0b354736bf91615b8648cf36 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:23.434095 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet cd6d2553f797441c910fb72d81b1049f with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:23.435004 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet e1b4ff396aa14325948460c8a0fcd925 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:23.437850 16389 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.438663 17507 tablet_replica.cc:333] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:23.438016 16486 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.439747 17507 raft_consensus.cc:2243] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:23.441548 17507 raft_consensus.cc:2272] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:23.447021 17507 ts_tablet_manager.cc:1916] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:23.456749 16634 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.473857 17507 ts_tablet_manager.cc:1929] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:23.474354 17507 log.cc:1199] T cd6d2553f797441c910fb72d81b1049f P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/cd6d2553f797441c910fb72d81b1049f
I20260709 13:06:23.477159 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet cd6d2553f797441c910fb72d81b1049f (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:23.483758 16564 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:23.489364 17186 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.489710 16634 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:23.490729 17491 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.492115 17491 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.497887 17476 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.499729 17186 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.504670 16634 raft_consensus.cc:2955] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:23.506736 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18244033cce043c69c8f4584b91ddc0d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:23.520152 16389 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.542531 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet 18244033cce043c69c8f4584b91ddc0d with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:23.543730 17505 tablet_replica.cc:333] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:23.544817 17505 raft_consensus.cc:2243] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:23.545315 17505 raft_consensus.cc:2272] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:23.548640 17505 ts_tablet_manager.cc:1916] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:23.561590 17505 ts_tablet_manager.cc:1929] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:23.561852 17505 log.cc:1199] T 18244033cce043c69c8f4584b91ddc0d P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/18244033cce043c69c8f4584b91ddc0d
I20260709 13:06:23.562966 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet 18244033cce043c69c8f4584b91ddc0d (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:24.600721 16637 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:24.605321 16561 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:24.605414 16486 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:24.605818 16603 consensus_peers.cc:597] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 755c5be0c60f44e5a3df52484c5c934f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.606510 17478 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.607156 17456 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.613196 17483 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.614408 16486 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.620450 16561 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.626693 16564 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:24.639497 16386 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:06:24.659448 16529 consensus_peers.cc:597] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71cad9c33f0b4530881909502ebdc720. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.665891 16637 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:24.668627 16491 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:24.670737 17492 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.673002 17517 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.686878 17491 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.688328 16491 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.688763 16634 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.702530 16386 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.704097 16634 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:24.713089 16603 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26f64e4c7b2a4c3c92b69f1d3cbd9737. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.714010 16491 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:24.715047 17511 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.714092 16564 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:24.716876 17511 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.725521 17478 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.728530 16563 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.729460 16486 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.745769 16491 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:24.744829 16389 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.766645 16634 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:24.766966 16454 consensus_peers.cc:597] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a22c30518dd74380871bcf169099e049. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.767767 17462 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.768318 16563 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:24.769740 17462 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.775245 17475 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.777454 16634 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.784731 16563 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:24.788978 16389 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.101668 17527 ts_tablet_manager.cc:933] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:25.103389 17527 tablet_copy_client.cc:323] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:25.104708 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:25.105217 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-26f64e4c7b2a4c3c92b69f1d3cbd9737
I20260709 13:06:25.113807 16650 tablet_copy_source_session.cc:215] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:25.117343 17527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:25.121289 17529 ts_tablet_manager.cc:933] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:25.133344 17527 tablet_copy_client.cc:806] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:25.133904 17527 tablet_copy_client.cc:670] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:25.135918 17531 ts_tablet_manager.cc:933] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:25.141028 17527 tablet_copy_client.cc:538] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:25.146521 17529 tablet_copy_client.cc:323] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:25.148160 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet 71cad9c33f0b4530881909502ebdc720 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:25.148656 17531 tablet_copy_client.cc:323] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:25.148687 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet 71cad9c33f0b4530881909502ebdc720 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-71cad9c33f0b4530881909502ebdc720
I20260709 13:06:25.151038 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet 755c5be0c60f44e5a3df52484c5c934f from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:25.151515 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet 755c5be0c60f44e5a3df52484c5c934f from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-755c5be0c60f44e5a3df52484c5c934f
I20260709 13:06:25.160514 16650 tablet_copy_source_session.cc:215] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:25.172290 17527 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:25.185607 16576 tablet_copy_source_session.cc:215] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:25.192081 17529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cad9c33f0b4530881909502ebdc720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:25.194706 17531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755c5be0c60f44e5a3df52484c5c934f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:25.217918 17531 tablet_copy_client.cc:806] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:25.218488 17531 tablet_copy_client.cc:670] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:25.218992 17529 tablet_copy_client.cc:806] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:25.219475 17529 tablet_copy_client.cc:670] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:25.223253 17529 tablet_copy_client.cc:538] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:25.223263 17531 tablet_copy_client.cc:538] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:25.227720 17527 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:25.228659 17527 tablet_bootstrap.cc:492] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:25.229295 17527 ts_tablet_manager.cc:1403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.022s
I20260709 13:06:25.232777 17529 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:25.232228 17527 raft_consensus.cc:359] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.233299 17527 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:25.232882 17531 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:25.233982 17527 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.247215 17527 ts_tablet_manager.cc:1434] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:06:25.251071 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-26f64e4c7b2a4c3c92b69f1d3cbd9737 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:25.251500 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-26f64e4c7b2a4c3c92b69f1d3cbd9737 on tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:25.269173 17529 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:25.270257 17529 tablet_bootstrap.cc:492] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:25.270937 17529 ts_tablet_manager.cc:1403] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.000s
I20260709 13:06:25.273850 17531 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:25.274677 17531 tablet_bootstrap.cc:492] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:25.275314 17531 ts_tablet_manager.cc:1403] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.006s
I20260709 13:06:25.273701 17529 raft_consensus.cc:359] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.277050 17529 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:25.277958 17531 raft_consensus.cc:359] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.278812 17531 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:25.278390 17529 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.279512 17531 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.280869 17529 ts_tablet_manager.cc:1434] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:06:25.282258 17531 ts_tablet_manager.cc:1434] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:25.286069 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-755c5be0c60f44e5a3df52484c5c934f received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:25.286433 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-755c5be0c60f44e5a3df52484c5c934f on tablet 755c5be0c60f44e5a3df52484c5c934f with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:25.286711 17527 ts_tablet_manager.cc:933] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:25.287328 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-71cad9c33f0b4530881909502ebdc720 received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:25.287739 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-71cad9c33f0b4530881909502ebdc720 on tablet 71cad9c33f0b4530881909502ebdc720 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:25.289364 17527 tablet_copy_client.cc:323] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:25.292369 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet a22c30518dd74380871bcf169099e049 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:25.292845 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet a22c30518dd74380871bcf169099e049 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-a22c30518dd74380871bcf169099e049
I20260709 13:06:25.298032 16501 tablet_copy_source_session.cc:215] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:25.300367 17527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22c30518dd74380871bcf169099e049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:25.312021 17527 tablet_copy_client.cc:806] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:25.312508 17527 tablet_copy_client.cc:670] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:25.315631 17527 tablet_copy_client.cc:538] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:25.322666 17527 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:25.338882 17527 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:25.339701 17527 tablet_bootstrap.cc:492] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:25.340197 17527 ts_tablet_manager.cc:1403] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.018s	user 0.018s	sys 0.000s
I20260709 13:06:25.342147 17527 raft_consensus.cc:359] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.342693 17527 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:25.343189 17527 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:25.345126 17527 ts_tablet_manager.cc:1434] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:25.346707 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-a22c30518dd74380871bcf169099e049 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:25.347020 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-a22c30518dd74380871bcf169099e049 on tablet a22c30518dd74380871bcf169099e049 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:25.572167 17185 raft_consensus.cc:1217] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:25.588986 17185 raft_consensus.cc:1217] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:25.632174 17185 raft_consensus.cc:1217] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:25.839376 17185 raft_consensus.cc:1217] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:25.997479 17511 raft_consensus.cc:1064] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:25.999257 17511 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.006883 17186 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.008322 16563 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.008083 16486 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.009651 17540 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.010679 17483 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.012451 17483 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.031423 17541 raft_consensus.cc:1064] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:26.033195 17541 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.037984 17540 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.047119 16634 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.048369 17186 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.048451 17541 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.048719 16491 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.049650 17492 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.050493 17491 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.052004 17186 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.058320 16563 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.064254 16388 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.068980 16491 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.103832 17491 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.105713 16486 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.125468 17186 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.131419 16632 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.143728 16387 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.154106 16634 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.159904 16486 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.160189 17186 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.161453 17544 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.163321 17540 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.170665 17540 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.171680 17185 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.179508 16563 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.186247 17187 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.188007 16491 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.188629 17491 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.189914 17541 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.192128 17483 raft_consensus.cc:1064] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:26.193871 17483 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.197528 17541 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.202416 17187 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.203979 16491 raft_consensus.cc:2955] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.209620 16486 raft_consensus.cc:2955] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.217916 16386 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.236342 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet 71cad9c33f0b4530881909502ebdc720 with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:26.237763 16386 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.239179 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 755c5be0c60f44e5a3df52484c5c934f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:26.242676 16485 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.244598 16564 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.257879 17511 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.268821 17186 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.270699 17544 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.273699 17483 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.316241 17558 tablet_replica.cc:333] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:26.318324 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet 755c5be0c60f44e5a3df52484c5c934f with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:26.318390 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71cad9c33f0b4530881909502ebdc720 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:26.338126 17511 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.359014 16485 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.375753 16389 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.379479 17564 tablet_replica.cc:333] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:26.380765 17564 raft_consensus.cc:2243] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:26.393708 17564 raft_consensus.cc:2272] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:26.388772 17186 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.395699 16562 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.397892 17564 ts_tablet_manager.cc:1916] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:26.419198 17564 ts_tablet_manager.cc:1929] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:26.419529 17533 raft_consensus.cc:1064] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:26.421368 17558 raft_consensus.cc:2243] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:26.422113 17558 raft_consensus.cc:2272] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:26.421949 17533 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.419538 17564 log.cc:1199] T 755c5be0c60f44e5a3df52484c5c934f P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/755c5be0c60f44e5a3df52484c5c934f
I20260709 13:06:26.425611 17558 ts_tablet_manager.cc:1916] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:26.428378 16632 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.435220 17185 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.436589 17544 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.439395 16485 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.440868 17511 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.454258 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet 755c5be0c60f44e5a3df52484c5c934f (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:26.464584 16632 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.465782 17518 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.467767 17558 ts_tablet_manager.cc:1929] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:26.468279 17558 log.cc:1199] T 71cad9c33f0b4530881909502ebdc720 P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/71cad9c33f0b4530881909502ebdc720
I20260709 13:06:26.470798 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet 71cad9c33f0b4530881909502ebdc720 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:26.471252 16485 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.472944 16561 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.474841 17186 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:26.476174 17542 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.477324 17559 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.478317 17544 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.483639 17542 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.485343 17186 raft_consensus.cc:2955] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.488364 17185 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.494791 16632 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.503607 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:26.510588 16387 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.515501 16389 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.523703 16564 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.542167 16486 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:26.548079 17186 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.550277 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:26.550822 17518 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.551189 17564 tablet_replica.cc:333] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:26.554044 16563 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:26.555900 17542 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.565122 17542 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.569864 17185 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.573120 17564 raft_consensus.cc:2243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:26.573750 17564 raft_consensus.cc:2272] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:26.572149 16561 raft_consensus.cc:2955] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.577809 17564 ts_tablet_manager.cc:1916] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:26.586189 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a22c30518dd74380871bcf169099e049 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:26.593470 16386 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:26.610556 17564 ts_tablet_manager.cc:1929] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:26.610987 17564 log.cc:1199] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/26f64e4c7b2a4c3c92b69f1d3cbd9737
I20260709 13:06:26.612007 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet a22c30518dd74380871bcf169099e049 with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:26.612876 17558 tablet_replica.cc:333] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:26.612900 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet 26f64e4c7b2a4c3c92b69f1d3cbd9737 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:26.613804 17558 raft_consensus.cc:2243] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:26.614545 17558 raft_consensus.cc:2272] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:26.619449 17558 ts_tablet_manager.cc:1916] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:26.632913 17558 ts_tablet_manager.cc:1929] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:26.633374 17558 log.cc:1199] T a22c30518dd74380871bcf169099e049 P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/a22c30518dd74380871bcf169099e049
I20260709 13:06:26.636029 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet a22c30518dd74380871bcf169099e049 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:27.673306 16634 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:27.679507 16563 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:27.679656 16603 consensus_peers.cc:597] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1670d7fa8dd74ffb9fc8584e273d75da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:27.680749 16485 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.680768 17560 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:27.682341 17544 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.689576 17560 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.691223 16561 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.692301 16485 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.705579 16386 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.706045 16634 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:27.714294 16603 consensus_peers.cc:597] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16de3b472e2a4b62908fb29412b52f14. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:27.714387 16561 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.715063 16486 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.716050 17560 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.716765 17544 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.737854 17560 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.740326 16485 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.742377 16561 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.765473 16387 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.766577 16485 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:27.776217 16632 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:27.777904 16454 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f95c63e093b4ba3b6fa7c2c62b717c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:27.779541 16561 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.778403 17582 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:27.781205 17518 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.788596 17582 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.790167 16632 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.802063 16485 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:27.804286 16386 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.805392 16561 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.809291 16634 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:27.810181 16454 consensus_peers.cc:597] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08a8884f986b4b43beecab72a521a3eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:27.811123 17542 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.825486 16561 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.829212 17542 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.828819 16634 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.827529 17588 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.833657 16561 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:27.853169 16386 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 2 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:28.222373 17590 ts_tablet_manager.cc:933] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:28.224500 17590 tablet_copy_client.cc:323] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:28.225741 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet 1670d7fa8dd74ffb9fc8584e273d75da from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:28.226128 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet 1670d7fa8dd74ffb9fc8584e273d75da from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-1670d7fa8dd74ffb9fc8584e273d75da
I20260709 13:06:28.231750 16650 tablet_copy_source_session.cc:215] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:28.234139 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1670d7fa8dd74ffb9fc8584e273d75da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.245486 17590 tablet_copy_client.cc:806] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:28.245947 17590 tablet_copy_client.cc:670] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:28.249150 17590 tablet_copy_client.cc:538] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:28.256708 17590 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:28.279165 17593 ts_tablet_manager.cc:933] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:28.282274 17590 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.283138 17590 tablet_bootstrap.cc:492] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:28.283849 17590 ts_tablet_manager.cc:1403] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.012s
I20260709 13:06:28.286715 17590 raft_consensus.cc:359] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.289006 17590 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:28.289691 17590 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.288718 17594 ts_tablet_manager.cc:933] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:28.291601 17593 tablet_copy_client.cc:323] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:28.296813 17598 ts_tablet_manager.cc:933] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:28.299386 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:28.299923 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-2f95c63e093b4ba3b6fa7c2c62b717c9
I20260709 13:06:28.310485 16501 tablet_copy_source_session.cc:215] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:28.312047 17590 ts_tablet_manager.cc:1434] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.001s
I20260709 13:06:28.313359 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.317736 17598 tablet_copy_client.cc:323] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:28.320156 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet 16de3b472e2a4b62908fb29412b52f14 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:28.320632 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet 16de3b472e2a4b62908fb29412b52f14 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-16de3b472e2a4b62908fb29412b52f14
I20260709 13:06:28.315851 17594 tablet_copy_client.cc:323] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:28.331463 16649 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-1670d7fa8dd74ffb9fc8584e273d75da received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:28.331971 16649 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-1670d7fa8dd74ffb9fc8584e273d75da on tablet 1670d7fa8dd74ffb9fc8584e273d75da with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:28.334985 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet 08a8884f986b4b43beecab72a521a3eb from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:28.335439 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet 08a8884f986b4b43beecab72a521a3eb from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-08a8884f986b4b43beecab72a521a3eb
I20260709 13:06:28.336871 16650 tablet_copy_source_session.cc:215] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:28.337162 17593 tablet_copy_client.cc:806] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:28.337677 17593 tablet_copy_client.cc:670] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:28.340494 17598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16de3b472e2a4b62908fb29412b52f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.342125 16501 tablet_copy_source_session.cc:215] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:28.344218 17593 tablet_copy_client.cc:538] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:28.347334 17594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a8884f986b4b43beecab72a521a3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.353868 17593 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:28.360983 17598 tablet_copy_client.cc:806] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:28.361539 17598 tablet_copy_client.cc:670] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:28.365899 17594 tablet_copy_client.cc:806] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:28.426226 17594 tablet_copy_client.cc:670] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:28.437259 17598 tablet_copy_client.cc:538] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:28.481650 17593 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.483695 17593 tablet_bootstrap.cc:492] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:28.487473 17593 ts_tablet_manager.cc:1403] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.009s
I20260709 13:06:28.501767 17594 tablet_copy_client.cc:538] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:28.528605 17593 raft_consensus.cc:359] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.533768 17593 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:28.538724 17593 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.541095 17593 ts_tablet_manager.cc:1434] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 13:06:28.555914 17594 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:28.559482 17598 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:28.562821 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-2f95c63e093b4ba3b6fa7c2c62b717c9 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:28.563464 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-2f95c63e093b4ba3b6fa7c2c62b717c9 on tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:28.643357 17598 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.644328 17598 tablet_bootstrap.cc:492] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:28.645098 17598 ts_tablet_manager.cc:1403] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.018s
I20260709 13:06:28.648773 17598 raft_consensus.cc:359] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.649638 17598 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:28.650203 17594 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.650362 17598 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.651131 17594 tablet_bootstrap.cc:492] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:28.652848 17594 ts_tablet_manager.cc:1403] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.010s
I20260709 13:06:28.655846 17594 raft_consensus.cc:359] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.656633 17594 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:28.657269 17594 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:28.660876 17594 ts_tablet_manager.cc:1434] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:28.663317 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-08a8884f986b4b43beecab72a521a3eb received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:28.663748 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-08a8884f986b4b43beecab72a521a3eb on tablet 08a8884f986b4b43beecab72a521a3eb with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:28.668632 17598 ts_tablet_manager.cc:1434] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:06:28.670035 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-16de3b472e2a4b62908fb29412b52f14 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:28.670356 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-16de3b472e2a4b62908fb29412b52f14 on tablet 16de3b472e2a4b62908fb29412b52f14 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:28.717067 17186 raft_consensus.cc:1217] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:06:28.796027 17186 raft_consensus.cc:1217] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:28.815994 17186 raft_consensus.cc:1217] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:28.889935 17186 raft_consensus.cc:1217] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:29.222741 17606 raft_consensus.cc:1064] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:29.225350 17606 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.235554 16563 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.235584 17186 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.237288 17610 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.241809 16485 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.243103 17606 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.244372 17618 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.258132 17618 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.259449 16485 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.276187 16387 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.276706 17186 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.278481 16563 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.285267 17603 raft_consensus.cc:1064] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:29.287704 17603 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.306351 16632 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:29.309091 17518 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.320973 17186 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:29.323225 17518 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.328478 16563 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:29.329748 17518 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.333357 17518 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.335265 17185 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.348706 16632 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.351994 16563 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.366252 16388 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.365487 16632 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.379511 16563 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.380762 17185 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.381386 17606 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.382148 17618 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.390035 16486 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.394233 17186 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:29.393702 17610 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.395716 17612 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.401031 16561 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.403818 17186 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.402354 17603 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.401074 16564 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:29.407125 17187 raft_consensus.cc:2955] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.412035 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16de3b472e2a4b62908fb29412b52f14 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:29.422477 17612 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.429759 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08a8884f986b4b43beecab72a521a3eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:29.432588 16561 raft_consensus.cc:2955] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.420986 16386 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.439605 17618 raft_consensus.cc:1064] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:29.442034 17618 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.445377 16387 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 2 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.456648 17612 raft_consensus.cc:1064] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:29.463323 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet 16de3b472e2a4b62908fb29412b52f14 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:29.468530 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet 08a8884f986b4b43beecab72a521a3eb with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:29.465893 17612 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.494686 16632 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.494781 17186 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.498993 17631 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:29.508101 17518 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:29.512982 16561 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.515072 17603 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.524035 17635 tablet_replica.cc:333] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:06:29.525224 17635 raft_consensus.cc:2243] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:29.524638 16561 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.525951 17635 raft_consensus.cc:2272] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.526772 17634 tablet_replica.cc:333] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:29.528108 17634 raft_consensus.cc:2243] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:29.529534 17634 raft_consensus.cc:2272] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.530747 17187 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.531987 16564 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.532337 17635 ts_tablet_manager.cc:1916] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.533772 16486 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.523244 17631 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.533804 17544 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:29.537995 17610 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.542001 17634 ts_tablet_manager.cc:1916] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.542157 17606 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.549728 16632 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.548935 16389 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.584250 17610 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.595629 16486 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.596866 17187 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.605039 16388 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.608392 17186 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.614957 17634 ts_tablet_manager.cc:1929] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:29.615424 17634 log.cc:1199] T 16de3b472e2a4b62908fb29412b52f14 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/16de3b472e2a4b62908fb29412b52f14
I20260709 13:06:29.616954 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet 16de3b472e2a4b62908fb29412b52f14 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:29.618597 17635 ts_tablet_manager.cc:1929] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:06:29.620522 17635 log.cc:1199] T 08a8884f986b4b43beecab72a521a3eb P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/08a8884f986b4b43beecab72a521a3eb
I20260709 13:06:29.622732 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet 08a8884f986b4b43beecab72a521a3eb (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:29.622985 16561 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.645465 16637 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.649469 16486 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:29.650728 16561 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.651121 17186 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.652611 17544 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.654060 17544 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:29.656973 17186 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.662052 16637 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.663699 17612 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.666025 17631 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.670179 17518 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.671154 17618 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.678380 17187 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.679843 16561 raft_consensus.cc:2955] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.682288 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:29.680466 17186 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.690707 16637 raft_consensus.cc:2955] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.697727 16388 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 3 to 4, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.709422 16389 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 3 to 4, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:29.711742 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1670d7fa8dd74ffb9fc8584e273d75da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:29.724121 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55174
I20260709 13:06:29.726114 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet 1670d7fa8dd74ffb9fc8584e273d75da with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40216
I20260709 13:06:29.729377 17634 tablet_replica.cc:333] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:06:29.734154 17634 raft_consensus.cc:2243] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:29.734875 17634 raft_consensus.cc:2272] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.736541 17643 tablet_replica.cc:333] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:06:29.737566 17643 raft_consensus.cc:2243] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:29.738193 17634 ts_tablet_manager.cc:1916] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.738327 17643 raft_consensus.cc:2272] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.744297 17643 ts_tablet_manager.cc:1916] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.753945 17634 ts_tablet_manager.cc:1929] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:29.754372 17634 log.cc:1199] T 1670d7fa8dd74ffb9fc8584e273d75da P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/1670d7fa8dd74ffb9fc8584e273d75da
I20260709 13:06:29.755290 17643 ts_tablet_manager.cc:1929] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:29.755647 17643 log.cc:1199] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/2f95c63e093b4ba3b6fa7c2c62b717c9
I20260709 13:06:29.755985 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet 1670d7fa8dd74ffb9fc8584e273d75da (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:29.757185 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet 2f95c63e093b4ba3b6fa7c2c62b717c9 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:06:30.803565 16561 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:30.809531 16634 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:30.810619 16529 consensus_peers.cc:597] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b8d067430b24267b8a20f78d68ac412. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.811231 16486 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.811177 17624 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:30.812841 17571 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.822567 17624 raft_consensus.cc:2955] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.824096 16486 raft_consensus.cc:2955] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.828377 16634 raft_consensus.cc:2955] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.834751 16637 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:30.837962 16386 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.852356 16485 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:30.853749 16603 consensus_peers.cc:597] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc4151437571420aa297eb389f8c35af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.853665 17610 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.852408 16561 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.858139 17610 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.865793 17618 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.867702 16486 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.872364 16564 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.891096 16386 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.892020 16634 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:30.902302 16603 consensus_peers.cc:597] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2d7c9def9a84db7a3a3e5199a328236. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.904136 16561 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.905572 16486 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.906069 17657 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.906733 17644 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.916816 17657 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.920543 16486 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.924760 16561 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.936077 16386 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.943715 16486 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:30.951860 16564 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:30.952229 16454 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82af48cecc58434e959547ec318fa4c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.953097 17518 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.954335 16634 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.955597 17518 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.966907 17651 raft_consensus.cc:2955] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.968482 16564 raft_consensus.cc:2955] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.972039 16637 raft_consensus.cc:2955] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:30.997875 16389 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 2, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 1 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:31.300217 17666 ts_tablet_manager.cc:933] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:31.302037 17666 tablet_copy_client.cc:323] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:31.303495 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet cc4151437571420aa297eb389f8c35af from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:31.303911 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet cc4151437571420aa297eb389f8c35af from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-cc4151437571420aa297eb389f8c35af
I20260709 13:06:31.309377 16650 tablet_copy_source_session.cc:215] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:31.312258 17666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4151437571420aa297eb389f8c35af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.328737 17666 tablet_copy_client.cc:806] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:31.329242 17666 tablet_copy_client.cc:670] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:31.332626 17666 tablet_copy_client.cc:538] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:31.339491 17666 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:31.357209 17666 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:31.357805 17666 tablet_bootstrap.cc:492] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:31.358265 17666 ts_tablet_manager.cc:1403] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.004s
I20260709 13:06:31.361331 17666 raft_consensus.cc:359] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:31.362197 17666 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:31.362862 17666 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:31.381043 17669 ts_tablet_manager.cc:933] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:31.382969 17672 ts_tablet_manager.cc:933] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:31.387859 17671 ts_tablet_manager.cc:933] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:31.391194 17669 tablet_copy_client.cc:323] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:06:31.393559 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet 82af48cecc58434e959547ec318fa4c5 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:06:31.394086 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet 82af48cecc58434e959547ec318fa4c5 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-82af48cecc58434e959547ec318fa4c5
I20260709 13:06:31.398900 17672 tablet_copy_client.cc:323] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:06:31.400413 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet a2d7c9def9a84db7a3a3e5199a328236 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:06:31.401034 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet a2d7c9def9a84db7a3a3e5199a328236 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-a2d7c9def9a84db7a3a3e5199a328236
I20260709 13:06:31.409868 17666 ts_tablet_manager.cc:1434] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.051s	user 0.014s	sys 0.009s
I20260709 13:06:31.412079 16501 tablet_copy_source_session.cc:215] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:31.412746 16650 tablet_copy_source_session.cc:215] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:31.416440 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-cc4151437571420aa297eb389f8c35af received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:31.416960 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-cc4151437571420aa297eb389f8c35af on tablet cc4151437571420aa297eb389f8c35af with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:31.418035 17672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d7c9def9a84db7a3a3e5199a328236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.424618 17669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82af48cecc58434e959547ec318fa4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.513470 17671 tablet_copy_client.cc:323] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:06:31.518241 17672 tablet_copy_client.cc:806] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:31.518884 17672 tablet_copy_client.cc:670] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:31.591367 17672 tablet_copy_client.cc:538] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:31.619393 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:32.466578 16454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.027s
W20260709 13:06:32.576289 16454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.027s
W20260709 13:06:32.849009 17669 consensus_meta.cc:287] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.960s	user 0.008s	sys 0.000s
I20260709 13:06:32.803109 17678 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:32.850353 17678 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:32.852865 17677 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:32.853427 17677 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:32.862892 17678 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:32.863525 17678 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:32.864041 17678 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:32.865926 17678 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:32.820778 17631 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:32.875260 17631 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:32.877244 17631 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:32.883637 17669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48048 (request call id 235) took 1523 ms. Trace:
I20260709 13:06:32.884166 17669 rpcz_store.cc:276] 0709 13:06:31.360015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.360122 (+   107us) service_pool.cc:224] Handling call
0709 13:06:31.381518 (+ 21396us) ts_tablet_manager.cc:934] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
0709 13:06:31.415282 (+ 33764us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:31.888602 (+473320us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.888715 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:32.882887 (+994172us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:32.883196 (+   309us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:32.883493 (+   297us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:32.883554 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":229,"tablet-copy.queue_time_us":20451,"thread_start_us":29071,"threads_started":2}
I20260709 13:06:32.885785 17669 tablet_copy_client.cc:806] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:32.887324 17669 tablet_copy_client.cc:670] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:32.893783 17677 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.056155 17682 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.056808 17682 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.059137 17682 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:33.139951 17672 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:33.225467 17678 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.226212 17678 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.228371 17678 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:33.228914 17678 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.229426 17678 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:33.231475 17678 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:33.362339 16454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.018s	sys 0.013s
W20260709 13:06:33.457075 16454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.018s	sys 0.013s
I20260709 13:06:33.428434 17685 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.461544 17686 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.462073 17686 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.461270 17685 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.464447 17685 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:33.456316 17683 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.468418 17683 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.470558 17683 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:33.471076 17683 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.464542 17686 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:33.456182 16605 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.008s	sys 0.001s
W20260709 13:06:33.473039 16605 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.008s	sys 0.001s
I20260709 13:06:33.473495 17686 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.485477 17688 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.486021 17688 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.488776 17688 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:33.489825 17688 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.491760 17688 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.473989 17686 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.471580 17683 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.503165 17698 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.503396 17694 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.494777 17680 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.494603 17687 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.497527 17692 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.497993 17689 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.517550 17686 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.526496 17700 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.526346 17692 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.509043 17698 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.507885 17678 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.505168 17694 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.667071 17686 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.671855 17682 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.525432 17687 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.685333 17691 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.682963 17686 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.682719 17682 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.674453 17683 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:33.674052 17678 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.667145 17680 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.687245 17684 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.686717 17692 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.669889 17689 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.687209 17687 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.699329 17687 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.699491 17686 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:33.699942 17682 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:33.699774 17687 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.700347 17689 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.700732 17698 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.701152 17690 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.672086 17700 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.702167 17694 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:33.703050 17683 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.699978 17686 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.703612 17681 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.704083 17689 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.687353 17701 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.706835 17697 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.706889 17701 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.714376 17689 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.714789 17695 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.716799 17701 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.701694 17687 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.701674 17690 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.697191 17702 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.720624 17693 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:33.712671 17694 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.712093 17686 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.729156 17702 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.707764 17684 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.712147 17683 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.727532 17678 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:33.727707 17687 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:33.685829 17691 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.907905 17690 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:33.721201 17681 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.021759 17700 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:33.707432 17697 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.184469 17684 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.185099 17684 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.185546 17684 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.187410 17684 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.187991 17696 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.750682 17694 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:33.728134 17695 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.188532 17696 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.002365 17688 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.193885 17696 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.195377 17691 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.195716 17699 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:33.739759 17693 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.202968 17693 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.203459 17693 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.203902 17693 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:33.922230 17687 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.208022 17702 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.208534 17702 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.209005 17702 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.229043 17683 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.230569 17695 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.232657 17694 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.223098 17699 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.236689 17687 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.226996 17690 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.242725 17690 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.205722 17693 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.197166 17684 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.265089 17684 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.277351 17686 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.279208 17704 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.279928 17704 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.281780 17690 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.283469 17702 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.285006 17697 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.291828 17689 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.281949 17704 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:34.399960 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.360s	user 0.024s	sys 0.016s
W20260709 13:06:34.400439 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.361s	user 0.024s	sys 0.016s
W20260709 13:06:34.409948 16605 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.000s	sys 0.002s
W20260709 13:06:34.420392 16605 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.000s	sys 0.003s
I20260709 13:06:34.442715 17708 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.448498 17704 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.456141 17719 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.456485 17704 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.456913 17719 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.458571 17704 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.459208 17719 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.459386 17704 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.459775 17719 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.449111 17705 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.460427 17705 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.462452 17705 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.449203 17702 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.463018 17702 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:34.462754 17688 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.459859 17704 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.464051 17688 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.464993 17702 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.465619 17704 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.465999 17688 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.466141 17708 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.467041 17721 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.453469 17686 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.468451 17708 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.468215 17686 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.453984 17695 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.454033 17700 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.469136 17695 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.469637 17700 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.470129 17686 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.455094 17720 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.471016 17720 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.471628 17700 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.451969 17697 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.449047 17691 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.472175 17700 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.465621 17719 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.473026 17691 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.459851 17684 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.471421 17695 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.517753 17707 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.517875 17715 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.518358 17707 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.518501 17715 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.520736 17715 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.448621 17696 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.470603 17686 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:34.521559 16454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.002s	sys 0.013s
W20260709 13:06:34.568500 16454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.003s	sys 0.013s
W20260709 13:06:34.516506 16529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.011s	sys 0.009s
W20260709 13:06:34.569432 16529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.009s
I20260709 13:06:34.521317 17715 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.472214 17697 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.471935 17721 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.515282 17700 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.520714 17707 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.568745 17717 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.579649 17684 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.570744 17686 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:34.570876 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 84963.8us
I20260709 13:06:34.576876 17695 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.580631 17680 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.587103 17718 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.573509 17696 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.574842 17715 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.580173 17717 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.585233 17690 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.594981 17713 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.585798 17684 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.588677 17718 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:34.717808 16531 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.006s	sys 0.015s
W20260709 13:06:34.784663 16606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.016s	sys 0.006s
I20260709 13:06:34.810667 17725 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.811240 17725 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.593910 17714 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.813560 17724 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.813472 17714 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.814188 17724 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.814747 17725 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.815375 17725 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.592123 17680 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.590852 17697 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.815913 17725 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:34.816989 16531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.008s	sys 0.028s
W20260709 13:06:34.741331 17154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.009s	sys 0.005s
W20260709 13:06:34.817337 16606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.017s	sys 0.011s
I20260709 13:06:34.818603 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:34.821081 17725 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.593568 17707 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.822166 16634 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:34.703734 17696 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.761270 17681 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.809590 17719 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:34.740502 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002de880 after lost signal to thread 15387
I20260709 13:06:34.596943 17721 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.599697 17689 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:34.824820 17154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.014s	sys 0.010s
I20260709 13:06:34.815558 17714 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.687350 17722 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.832165 17715 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.718302 17723 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.591732 17695 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.845059 17720 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.823661 17707 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.816066 17680 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.812166 17690 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:34.847416 17691 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:34.847359 17721 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.848647 17686 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:34.849701 17714 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:34.850883 17715 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:34.850018 17725 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.867763 17696 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.851397 17689 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:34.597144 17713 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:34.851899 17722 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.853820 17723 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.008527 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.009210 17187 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:34.867964 17718 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.011406 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:34.884191 17715 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.012166 17183 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:34.851918 17726 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.013792 17729 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.014297 17729 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.016440 17729 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:34.865655 17700 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:35.018927 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.042145 16637 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.024080 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.027067 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:34.868345 17724 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.040943 17730 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.981207 17707 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.013657 17726 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.017204 17732 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.024638 17725 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.977927 17684 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.002854 17716 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:34.868745 17721 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:34.866319 17714 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.072834 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.123723 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.138774 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.140578 17715 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.043568 17718 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.144464 17718 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.043152 17723 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.043848 17681 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.056928 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.018021 17691 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.151753 17188 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:35.125103 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.175590 17729 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.175597 17691 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.177501 17684 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.177604 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.121518 17680 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.126359 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:35.191708 16604 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.630s (SENT) [suppressed 1 similar messages]
I20260709 13:06:35.128214 17695 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.126477 17710 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.077978 17690 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.126215 17731 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.021595 17696 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.180506 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.206923 16637 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.176312 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.124142 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.207769 16491 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.193832 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:35.182405 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002def60 after lost signal to thread 16423
I20260709 13:06:35.191774 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.191901 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.175135 17728 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.211966 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.212586 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.217607 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.180009 17733 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.179741 17716 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.208686 17680 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.220785 17731 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.221107 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.175642 17681 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.175478 17732 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.220631 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.212355 17724 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.262389 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.202849 17715 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.261976 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.216605 17182 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:35.222857 17721 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.208106 17729 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.215525 17695 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.215677 17690 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.176512 17730 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:35.208562 17684 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.218765 17710 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.383008 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.421413 17186 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.372702 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.385969 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.423400 17188 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
W20260709 13:06:35.394146 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 214229us
I20260709 13:06:35.270681 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.399873 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.437690 16561 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.268342 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.426041 16636 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:35.420074 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.442263 17181 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.442754 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.442955 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.443321 16562 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.427894 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.447949 16633 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:35.448380 17716 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.448859 17716 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.449378 16385 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 122) took 4040 ms. Trace:
I20260709 13:06:35.449283 17716 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.450129 17717 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:35.449776 16385 rpcz_store.cc:276] 0709 13:06:31.408852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.409000 (+   148us) service_pool.cc:224] Handling call
0709 13:06:35.449295 (+4040295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252015,"reported_tablets":1}
I20260709 13:06:35.450228 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.267143 17713 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.369117 17718 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.265568 17689 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.384690 17726 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.372764 17699 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.271044 17691 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:35.369117 17707 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.426936 17725 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.264164 17733 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:35.453918 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7ce0 after lost signal to thread 16515
I20260709 13:06:35.462188 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.462383 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.467089 16562 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.467372 17684 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.463200 17722 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:35.467994 17707 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.465700 17716 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.267637 17731 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.457010 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.263377 17734 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.219237 17728 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.446069 17696 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.269770 17732 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.481084 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.267911 17737 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:06:35.468319 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002f36e0 after lost signal to thread 16590
I20260709 13:06:35.469684 17181 raft_consensus.cc:1217] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:35.484985 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.464756 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.444792 17695 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:35.486429 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.487068 16558 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.488615 17729 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.482221 17734 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.475924 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.476951 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.477982 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.492231 17188 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.479642 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet 9b8d067430b24267b8a20f78d68ac412 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:06:35.493165 16603 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.493276 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet 9b8d067430b24267b8a20f78d68ac412 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-9b8d067430b24267b8a20f78d68ac412
I20260709 13:06:35.494213 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.495428 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.495711 17694 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.479022 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.499579 16562 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.469872 17707 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.480696 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.481029 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.481541 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.501157 16565 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.446518 17715 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.482025 17681 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.475785 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.465564 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.483742 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.269575 17680 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:35.482892 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.512159 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.472143 17742 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.487578 17695 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.503262 16563 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.514292 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.487257 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.456143 17724 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.518108 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.496106 17694 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.502753 17685 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.510721 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.512748 16485 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.513548 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.521648 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.437822 17690 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.492969 17714 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.516772 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.524262 16563 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.521045 17694 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.524941 16486 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.525604 17690 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.523626 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.529173 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.516077 17730 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.530350 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.517616 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.502861 17697 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:35.516152 17209 debug-util.cc:398] Leaking SignalData structure 0x7b0800032440 after lost signal to thread 16664
I20260709 13:06:35.518234 17742 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.520212 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.518957 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.519724 17725 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.536237 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.532127 17697 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.519829 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.520870 17724 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.521440 17685 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.515662 16560 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
W20260709 13:06:35.526408 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 212652us
I20260709 13:06:35.527397 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.527592 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.528187 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.544284 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.544749 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.545432 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.546597 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:35.546917 17209 debug-util.cc:398] Leaking SignalData structure 0x7b0800148480 after lost signal to thread 17212
W20260709 13:06:35.547338 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed000 after lost signal to thread 17671
W20260709 13:06:35.547618 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002d83c0 after lost signal to thread 17673
I20260709 13:06:35.547667 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.542434 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.532591 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.550612 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.535138 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.536018 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.522204 16561 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.518847 17182 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.517539 17733 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.541184 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.542033 17685 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.539063 17152 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.542522 17184 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:35.536706 17725 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.545352 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.539081 16603 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.530776 17734 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.536192 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.567840 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.568189 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.560199 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.560374 17722 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.551561 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.569965 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.568739 16561 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.561337 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.538667 17714 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.561515 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.562625 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.563416 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.565609 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.569859 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.540472 17697 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.574172 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.574743 16491 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.572628 16563 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:35.572863 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.571404 17714 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.570108 17722 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.577839 17722 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.542179 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.565686 17725 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.545369 16488 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.573277 17728 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.581194 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.581818 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.490198 17737 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.580044 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.583989 16563 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.578502 17714 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.615660 16565 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:35.597568 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.592100 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.633833 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.615293 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.633129 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.632192 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.642328 17742 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.628399 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.632398 17680 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.643041 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.586989 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.586236 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.644717 17691 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.604200 16576 tablet_copy_source_session.cc:215] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:35.645622 17691 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.646111 17691 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.579627 17740 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.647073 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.641177 16561 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.648650 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.606956 17672 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:35.643019 17737 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.647030 17740 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.651703 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.632824 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.652544 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.653622 17685 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.651646 17740 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.632794 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.649555 16486 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
W20260709 13:06:35.644639 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57727.9us
I20260709 13:06:35.658635 16485 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.607869 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.661671 16488 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:35.649750 17694 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.664186 16636 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:35.588069 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.664830 16560 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.667014 16635 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.667909 17694 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.665812 17672 tablet_bootstrap.cc:492] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:35.669135 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:35.669750 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.670207 17182 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.670387 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.671128 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.671669 16486 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.672976 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.606048 17715 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.583634 17710 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.676703 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.677330 16485 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.679411 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.679648 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.680270 16485 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.681857 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.614807 17725 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.630817 17697 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.684633 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.643559 17722 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.688416 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.688467 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.690904 17672 ts_tablet_manager.cc:1403] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 2.551s	user 0.036s	sys 0.027s
I20260709 13:06:35.711433 16635 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.696291 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.714398 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.712463 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.714934 16560 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.715777 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:35.716552 17181 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.716843 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.717411 16560 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.717489 17153 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.713394 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.718187 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.718478 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:35.698065 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.700677 17725 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.701538 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.702394 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.703434 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.703652 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.704075 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.704253 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.705251 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.706341 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:35.727110 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.712085 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.697139 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.712025 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.713433 16633 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:35.719673 16562 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.727254 16634 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.666450 17691 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.728540 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.731223 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.731758 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.728101 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.732369 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:35.731849 16639 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:35.731355 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.733078 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.733147 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.733878 17742 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.748175 17742 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.748466 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.734282 17736 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.735200 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.735714 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.752890 16489 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.753093 17722 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.749616 17685 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.723408 16560 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.736140 16566 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.724190 17721 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.755246 17721 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.755635 17721 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.755924 17691 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.725415 16557 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.736126 17672 raft_consensus.cc:359] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:35.737001 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:35.731443 16559 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:35.738410 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.739503 17669 tablet_copy_client.cc:538] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:35.741101 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.741217 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.743620 17733 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.741990 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.746651 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.743949 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.748600 17742 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.734139 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.749478 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.750236 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.751387 16634 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:35.783766 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.788971 16637 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.757118 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.782172 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:35.731678 17725 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.789304 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.786092 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.790279 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:35.787639 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 43765.9us
I20260709 13:06:35.790078 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.793370 17691 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.795823 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.753199 17697 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.797679 17748 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.798418 17748 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.798743 17748 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.799052 17748 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.756373 17694 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.796593 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:35.794384 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.802762 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.802901 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.800725 16635 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:35.783363 17722 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.808416 17722 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.793743 17725 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.785391 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:35.808038 17697 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.808938 17725 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.809161 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.810322 17736 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.810734 17736 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.811064 17736 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.783576 17672 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:35.814100 17749 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.786375 17733 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.786191 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:35.815748 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58684.9us
I20260709 13:06:35.799975 17717 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.817381 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.800145 17691 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.818187 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.808892 17722 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.824596 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.838336 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.825313 17669 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:35.817627 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:35.827394 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.828585 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.823644 17721 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.802130 17694 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.786058 17714 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.842461 17749 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.842828 17749 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.843163 17749 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.843667 17721 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:35.790434 17740 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:35.845214 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.846442 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.846838 17740 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:35.841951 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:35.848557 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.849179 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.850193 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.850471 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.809043 17697 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.851883 17697 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.855242 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.857179 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.858560 17697 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.858907 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.859930 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.860857 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.878851 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.863103 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.879163 16456 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.880080 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.879968 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.880473 17739 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.881263 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.881908 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.882071 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.883036 17739 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.862771 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.864014 17694 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.863569 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.878785 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.881166 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:35.885030 17697 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:35.865393 16455 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.888487 17699 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.888845 17699 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:35.889178 17699 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.815958 17733 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:35.893601 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 90870.8us
I20260709 13:06:35.826579 17717 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.839341 17691 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.895273 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.844038 17714 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:35.907913 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 94810.1us
I20260709 13:06:35.909284 17671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8d067430b24267b8a20f78d68ac412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:35.889513 16557 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:35.865897 17721 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.912449 17745 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.915684 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.899859 17717 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:35.914439 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 64298.1us
I20260709 13:06:35.918246 17753 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:35.918994 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 48687us
I20260709 13:06:35.919570 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.921213 17751 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.921587 17751 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.921936 17751 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.923619 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.926999 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:35.894127 17680 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:35.930228 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:35.930835 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.931147 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:35.915167 17714 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.932744 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.934350 17754 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.916551 17721 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.928817 17739 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.892809 17672 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:35.931914 17181 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:35.929477 17740 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.932438 17728 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:35.945952 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 50756us
I20260709 13:06:35.949095 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.949168 16456 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.950402 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.950878 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.951303 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.926136 17745 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.952253 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.952471 17745 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.943851 17721 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.952138 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.955391 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.954792 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.943745 17739 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:35.929121 17715 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:35.942538 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:35.947655 17740 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.929383 17753 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:35.955193 17680 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:35.958779 17685 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.971400 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.998607 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.966190 17699 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:35.947230 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:35.929932 17710 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:35.970379 16456 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.953823 17696 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.950213 17728 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:35.971237 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:36.008394 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.956715 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:35.975159 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:35.964762 17751 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:35.955912 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:35.991852 16529 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.022454 16486 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.005156 16635 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.018661 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.975396 17740 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.992136 17681 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.016748 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.028211 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:35.975281 17753 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.018070 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:35.994309 17685 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.042552 17685 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.043552 17672 ts_tablet_manager.cc:1434] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.324s	user 0.003s	sys 0.014s
I20260709 13:06:36.018204 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:36.020622 17742 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.018492 17716 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.021909 16636 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:35.971743 17714 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.026302 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.022662 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:36.015364 17754 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.016598 17728 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.042225 16456 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.003463 17755 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.027868 17715 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.023967 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.044878 17696 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.048367 17689 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.076004 16489 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 2: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:36.075687 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.060616 17714 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:36.064709 17695 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.022943 17748 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.029243 17737 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:06:36.096277 17714 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.098500 17755 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.080286 17681 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:06:36.097014 17754 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:36.136073 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 60452.7us
I20260709 13:06:36.133051 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.135324 17182 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:36.112342 17716 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.144050 17181 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.096606 17694 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.039551 17739 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.159441 16488 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.149791 17725 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.159920 17689 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.160569 17748 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:36.165376 16637 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.141678 17750 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.159652 17694 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.165395 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.199023 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.155205 17695 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:36.212564 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.212958 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.201840 17707 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.215544 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.237401 17180 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.190512 17689 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:36.208181 17690 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.256453 17751 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.235832 17739 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.267998 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.211431 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.214138 17742 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:36.273069 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.213337 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.276096 17689 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.229063 17707 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:36.235350 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.295230 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.296238 16636 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:36.299912 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 376297us
I20260709 13:06:36.259687 17690 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:36.300598 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.313975 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.309778 17751 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.316390 17751 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.316758 17751 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.324594 17690 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.327188 17680 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.328864 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:36.332979 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 380909us
I20260709 13:06:36.310913 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.325593 17690 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.338950 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.237592 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.345307 16637 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.327723 17726 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.347050 16634 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.327346 17760 consensus_queue.cc:1059] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.341591 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.348495 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.357803 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:36.361876 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:36.363490 17725 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.342618 17689 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.368237 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:36.357906 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.369060 17761 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.367182 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:36.371783 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:36.372826 17152 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:36.356217 17694 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.376374 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.349931 17726 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:36.375804 17725 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.369109 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.368872 17691 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.375674 17761 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.374374 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.375896 17748 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.378872 17694 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.396596 17694 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.392818 16638 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.399674 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.392966 17691 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.393152 17756 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.393395 17748 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:36.393528 17752 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.394794 17716 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.388914 17184 raft_consensus.cc:1217] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:36.384325 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.395560 17685 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.395895 17721 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.401113 16529 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.402693 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.404031 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.383524 17725 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:36.388662 17669 tablet_bootstrap.cc:700] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent opening tablet: real 0.175s	user 0.001s	sys 0.005s
I20260709 13:06:36.410549 17756 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.421052 17756 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.356587 17707 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.388653 17761 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:36.382503 17722 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.412619 16640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:36.428347 16640 raft_consensus.cc:606] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:36.417232 17725 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.417472 16635 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:36.417178 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.417927 17685 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.419075 17734 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.407953 17748 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.388286 17740 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.406203 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.408165 17716 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:06:36.413039 17736 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.601s	user 0.000s	sys 0.009s
I20260709 13:06:36.410967 17697 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:36.431892 17711 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.434170 17762 raft_consensus.cc:1064] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:36.427119 17761 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.440011 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.441277 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.444180 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.444423 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.450816 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:36.451292 17699 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:36.414121 17691 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:36.488216 16455 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.494937 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.495054 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.463008 17707 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.453769 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:36.453225 17749 consensus_meta.cc:287] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.607s	user 0.000s	sys 0.018s
I20260709 13:06:36.497634 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.459602 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.505270 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.465185 17737 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.500031 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:36.433437 17726 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.506888 17753 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.508090 17722 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.457162 17697 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:36.475309 17736 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.491161 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:36.512051 17726 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.505331 17757 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.512287 17751 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.510026 17715 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:36.515264 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 138923us
W20260709 13:06:36.498834 17733 consensus_meta.cc:287] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.000s
I20260709 13:06:36.519315 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.498616 17711 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.456804 17716 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.497347 17742 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.505198 17696 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:36.528795 17188 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.515550 17725 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.515996 17699 consensus_queue.cc:1059] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:36.509766 17737 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:36.514286 17756 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.521718 17734 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.535440 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.549189 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.550489 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.550707 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:36.516276 17749 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.538369 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.536393 17733 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.542721 17751 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:36.543095 17745 consensus_meta.cc:287] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.590s	user 0.014s	sys 0.006s
I20260709 13:06:36.543854 17183 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.536806 17695 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.544014 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.536662 17711 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.538605 16636 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.546489 17718 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.555998 17745 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.552996 17715 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.571414 17733 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:36.571923 17721 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.572196 17749 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.572819 16485 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.554433 17722 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.554628 17710 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.578253 17696 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:36.547214 17737 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.590168 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.568526 17718 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:36.573441 17760 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.584558 17696 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:36.559214 17748 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.603518 17745 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:36.604640 17717 consensus_meta.cc:287] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.672s	user 0.004s	sys 0.004s
I20260709 13:06:36.605005 17717 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.606774 17717 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:36.607316 17728 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.005s
I20260709 13:06:36.607511 17737 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.608891 16632 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.590242 17740 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.625826 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.576944 17697 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.637096 17736 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.621232 17753 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:36.644769 17714 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.006s
I20260709 13:06:36.645042 17748 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.637737 17696 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.648379 17725 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.650259 17716 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.652897 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.628418 17718 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.655725 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.636435 17182 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.615746 17728 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.659332 17714 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.661214 17728 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:36.661408 17187 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.661963 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.662864 16560 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.662901 17671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48054 (request call id 253) took 5293 ms. Trace:
I20260709 13:06:36.632697 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.666793 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:36.656142 17718 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:36.670305 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 269632us
W20260709 13:06:36.668047 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 222282us
I20260709 13:06:36.697808 17740 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.693876 17756 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.694199 17714 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:36.707690 17685 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.701638 17707 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:06:36.723855 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 191290us
I20260709 13:06:36.721187 17696 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.721920 17685 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:36.708168 17717 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:36.736802 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.737787 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:36.739336 17768 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.739228 16636 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.704878 17763 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:36.663892 17671 rpcz_store.cc:276] 0709 13:06:31.365598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.365707 (+   109us) service_pool.cc:224] Handling call
0709 13:06:31.388215 (+ 22508us) ts_tablet_manager.cc:934] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
0709 13:06:35.825671 (+4437456us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:36.461167 (+635496us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:36.461287 (+   120us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:36.647232 (+185945us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:36.647531 (+   299us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:36.653564 (+  6033us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:36.658983 (+  5419us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":235,"tablet-copy.queue_time_us":20555,"thread_start_us":139843,"threads_started":2}
I20260709 13:06:36.737812 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.743660 17751 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.746747 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.756145 17758 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.748441 17699 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:36.745594 17751 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:36.739717 17768 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.757557 17671 tablet_copy_client.cc:806] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
W20260709 13:06:36.764158 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 74730.6us
I20260709 13:06:36.740801 17728 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:06:36.764767 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 214331us
I20260709 13:06:36.749261 17757 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:36.770745 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.761837 17768 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.774367 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.775844 16605 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.776592 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:36.777808 17769 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.778232 17769 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.778573 17769 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.749398 17739 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:36.763149 17685 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.783586 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.786386 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.786600 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.779549 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.787671 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.773005 17671 tablet_copy_client.cc:670] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:36.790057 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:36.791165 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.781761 17752 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.796834 17752 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.796916 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.797247 17752 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.797581 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.791095 16636 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.791852 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.797523 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.798761 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.780926 17707 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.799429 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:36.795481 17714 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.792356 17691 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:36.824970 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.824645 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.798498 17725 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:36.836097 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.775957 17762 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.801398 17685 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.791232 17772 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.770182 17758 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:06:36.801740 17699 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.839668 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.776839 17751 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.837482 17669 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:36.826100 17728 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.859126 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:36.835520 17694 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.837428 17691 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:36.848332 17707 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.844322 17760 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.858295 17699 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:06:36.873544 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.864108 17695 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.864099 17772 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:06:36.877965 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.848186 17725 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:36.833730 16558 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:36.871065 17691 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.880385 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.833770 17752 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:36.881909 17680 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.883371 17730 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.878328 17728 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.884873 17680 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:36.883244 17725 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.888592 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.881100 17772 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.872226 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:36.900256 16634 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.891505 17669 tablet_bootstrap.cc:492] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:36.887507 17730 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:06:36.909683 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 218855us
I20260709 13:06:36.902554 17765 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.924713 17745 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.900894 17710 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.910020 17690 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.910470 17754 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:36.944506 17182 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.945385 17187 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.946550 17669 ts_tablet_manager.cc:1403] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 1.121s	user 0.034s	sys 0.036s
I20260709 13:06:36.940310 17710 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:36.940109 17745 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:36.945873 17690 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:36.954320 17694 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.951613 17763 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.910303 17699 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.960983 17752 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:36.959311 17763 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:36.949083 17680 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:36.968369 17689 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 13:06:36.954483 17754 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.956625 17730 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:36.977149 17761 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:36.979283 17730 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.003963 17763 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.007563 17763 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.980067 17699 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:37.016067 17773 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:06:37.018700 17669 raft_consensus.cc:359] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:37.020642 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 194907us
I20260709 13:06:37.030023 17184 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.031083 17761 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:37.008056 17751 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.033699 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:37.031859 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 172793us
I20260709 13:06:37.036435 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.037911 17707 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:37.037321 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.038786 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.039606 17707 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.040259 17707 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.040335 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.040975 17734 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.041356 17734 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:37.041643 17724 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.042343 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.042135 17734 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:37.044082 17724 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.044251 17734 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.045138 17724 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.046092 17724 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.045311 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.046928 17707 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.048183 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.046416 17724 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:37.049891 17724 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.051028 17724 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.051478 17707 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.058722 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.060634 17734 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.061971 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.063807 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.064883 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.065927 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.068092 16604 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:36.969365 17745 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.012244 17680 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.973948 17690 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.028390 17669 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:37.005992 17728 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:06:37.080329 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.008566 17754 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:36.977473 17710 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.081956 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.065876 17760 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.065630 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:37.066529 17707 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.075429 17771 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.063707 17734 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.089867 16604 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.097760 16604 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.085078 17737 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.084753 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:37.083007 17685 consensus_queue.cc:1175] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "359213375db14f3d874c121993f90d76" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:06:37.100392 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.094003 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-a2d7c9def9a84db7a3a3e5199a328236 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:06:37.090230 17690 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.089766 17745 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.115118 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.098479 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.100646 17717 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.088050 17691 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.115238 17710 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.125128 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:37.125864 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.121768 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.127897 17776 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:37.128484 17711 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.005s
I20260709 13:06:37.116974 17765 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.087339 17764 consensus_queue.cc:1059] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:37.117633 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-a2d7c9def9a84db7a3a3e5199a328236 on tablet a2d7c9def9a84db7a3a3e5199a328236 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.129370 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.163650 16634 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.128944 17711 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.166159 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.167500 16638 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.168329 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.128268 16631 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:37.123987 17782 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.159314 17788 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.160471 17187 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:37.161638 16639 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.128319 17776 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:37.169514 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.170264 17725 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.103410 17669 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:37.118266 17737 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.163683 17764 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.162935 17781 consensus_queue.cc:1059] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:37.196609 17691 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:37.199512 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.184499 17776 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:37.201665 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.204957 17671 tablet_copy_client.cc:538] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.187600 17764 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.204538 17780 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:37.227489 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.228578 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.231173 16560 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.184402 17769 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.227380 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.198694 17711 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:37.186045 17782 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.233788 17717 raft_consensus.cc:3055] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.202216 17761 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.236328 17184 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:37.238781 17716 consensus_meta.cc:287] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.003s
W20260709 13:06:36.520809 17759 consensus_queue.cc:1175] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "16b5b367990f4b5c862484bdec0b9226" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:37.234894 17756 raft_consensus.cc:1064] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:37.248584 17714 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.243739 17717 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:37.251520 17696 consensus_meta.cc:287] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.005s
I20260709 13:06:37.263185 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.253278 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.256109 17734 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:37.264140 16639 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:37.271893 16632 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:37.273394 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.274230 17782 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.274714 17714 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.275511 17694 raft_consensus.cc:993] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:06:37.275990 17694 raft_consensus.cc:1081] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:06:37.277135 17717 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.278126 17788 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.278687 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.279651 17669 ts_tablet_manager.cc:1434] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.325s	user 0.006s	sys 0.001s
I20260709 13:06:37.281486 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-82af48cecc58434e959547ec318fa4c5 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:06:37.281893 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-82af48cecc58434e959547ec318fa4c5 on tablet 82af48cecc58434e959547ec318fa4c5 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.283136 16632 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.278635 17788 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.248648 17756 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.296541 16632 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.286321 17769 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:37.227514 17775 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 13:06:37.295761 17768 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.507s	user 0.004s	sys 0.004s
I20260709 13:06:37.298513 17765 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.297981 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:37.286463 17772 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.296089 16566 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:37.273334 17764 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:37.319757 16634 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.304047 17681 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.303565 17768 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.320367 17737 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:37.332394 16640 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.333528 16631 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:37.321379 17681 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.333796 17788 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.357402 16636 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:37.331545 17772 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:37.347994 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64680us
I20260709 13:06:37.358814 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:37.352581 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 231398us
I20260709 13:06:37.341566 17776 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:37.361063 16637 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.362207 16631 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.364137 16634 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.361991 17776 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:37.363663 17714 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:37.372218 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 264272us
I20260709 13:06:37.373308 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.361078 17681 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.374517 16454 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.376089 17730 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.376430 17730 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.376752 17730 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.376720 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.377316 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.378109 16454 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.378914 17699 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.379245 17699 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:37.379573 17699 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.380441 17784 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.380791 17784 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:37.381115 17784 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.386706 17699 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.388945 17699 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.389884 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.389438 16389 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 2 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.391023 17696 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.391381 17696 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:37.391424 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.391826 17696 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.393000 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.393976 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.394227 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.394583 17789 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.394939 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.395275 17680 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.395614 17739 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.396294 17739 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.396697 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.397236 16489 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.397572 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.397732 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.398128 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.399266 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.399657 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.400074 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.400246 16483 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.400461 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.400709 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.401193 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.400449 17671 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:06:37.404735 16632 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.405021 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.408876 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.409549 16485 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 2: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:37.409672 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.410380 16489 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:37.410341 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.413080 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.414085 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.415153 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.416213 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.417246 17184 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:37.415524 16485 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.418118 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.418551 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.418877 17761 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.419112 16485 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:37.408254 17714 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.409050 17740 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.420064 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.420527 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.421547 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.423687 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.395676 17680 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.424259 17680 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.425040 17737 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.427801 16491 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.428227 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.428937 17737 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.420049 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.430015 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.430408 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.430527 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.431066 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.429050 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.431540 17737 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.432475 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.432860 17764 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.433772 17737 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:37.434818 17690 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.434899 16482 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.435235 17690 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:37.419265 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.436105 17690 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.436111 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.437304 17730 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.437862 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.438194 17690 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.387590 17784 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.440641 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.431535 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.442351 16491 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.443326 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.448582 17180 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.452762 16490 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.453279 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.453418 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:37.454066 17182 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:37.450834 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:37.454308 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.454872 17188 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:37.454965 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:37.447072 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.457587 17733 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.458106 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.458670 17733 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.444109 17740 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.459005 17733 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.459987 17152 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.460395 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.460096 17740 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.460927 17714 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.459033 17761 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.461053 16562 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:37.458999 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.447196 16489 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 2: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:37.454885 16490 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:37.464602 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:37.464902 16563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:06:37.465423 16563 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.465747 16563 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.466249 17152 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.466837 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.465835 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.446967 16486 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:37.468775 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.473121 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:37.473125 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.473143 16561 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:37.474386 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.460843 17756 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.476992 17756 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.461614 17765 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:06:37.460891 17184 raft_consensus.cc:1217] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:37.478358 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:37.480937 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.481683 17725 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.486294 17757 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:37.493872 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.461714 17733 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.480460 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:37.504733 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.508041 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:37.439697 17730 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.475968 17793 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.480142 17761 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.507200 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:37.526016 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.527021 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:37.527271 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:06:37.528510 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48130.1us
I20260709 13:06:37.529268 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.516645 17725 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:37.517194 17800 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.479983 17714 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.527628 16636 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
W20260709 13:06:37.534991 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56698us
I20260709 13:06:37.481205 17715 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.495781 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.530321 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:06:37.535315 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.536878 16634 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.535133 16484 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.541842 17794 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:37.542485 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.542883 17794 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.504946 17695 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.536149 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.544798 16604 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.520216 17768 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:37.515681 16558 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:37.546785 16489 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:37.549432 16563 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.549818 17778 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.550951 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.556318 16636 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:37.552297 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.543285 17794 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.554169 16562 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.561786 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.503991 17777 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:37.562642 16563 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:37.563555 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:37.540401 17715 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:37.564218 16636 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.564569 16636 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.548100 17694 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.565325 16636 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.567417 16634 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.547977 17756 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.548430 17752 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.520740 17790 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:37.568571 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.543074 16484 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:37.572639 16636 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.546082 17695 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:37.520864 17742 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:37.538129 17730 consensus_queue.cc:1059] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:37.554629 17733 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.576879 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.576910 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.577642 17783 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.557471 17799 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.578409 17183 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.579133 17179 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.579953 17717 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.555063 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.580436 17725 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.581226 17715 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.561491 16487 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.544430 17788 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:37.544687 17765 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:37.562561 17726 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.540086 17696 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.586688 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.543532 17789 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:37.609285 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:37.588588 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.609822 16490 raft_consensus.cc:606] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.610668 16604 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.611733 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.590916 16489 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:37.591806 17742 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.574821 17768 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.593287 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.595834 17695 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.596323 17681 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.596994 17730 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.585883 17752 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:37.588093 17694 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.590619 17778 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.636124 16636 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:37.597697 17777 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:37.613967 17691 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.618333 17768 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.620155 17764 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.614097 17756 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.608004 17799 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:37.614197 17697 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.634730 16640 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.614395 17742 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.648679 17742 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.649894 16488 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.613353 16604 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.634702 17680 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.651206 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.651808 16491 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.652757 17680 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.617295 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.653584 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:37.653851 16484 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:37.634558 17779 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.607712 17711 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:37.638404 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:37.626999 16487 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:37.644084 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.626328 17730 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.633128 17752 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:37.644896 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.635473 17715 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.633919 17695 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.673753 16486 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:37.693295 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:37.694706 17694 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.636107 17793 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.706962 17730 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.708324 17730 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.651727 16485 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:37.680094 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.649854 17742 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.639899 17777 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.557534 17794 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:37.682171 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 43857.7us
I20260709 13:06:37.643347 17739 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.723730 17739 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:37.682668 17795 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:06:37.641829 17764 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.732311 17757 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.732721 17757 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.632807 17790 consensus_queue.cc:1059] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:06:37.733076 17696 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.733628 17696 raft_consensus.cc:3055] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.639706 17798 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:37.685855 17799 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.690884 17726 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.681365 17778 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.727839 17739 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:37.731017 17763 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.683394 17768 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.735018 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:37.733969 17696 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.738041 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.733456 17757 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.740625 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:37.726094 17777 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.768898 16485 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:37.769585 16486 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.736675 16487 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:37.732523 17764 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.789642 17764 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.790210 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:37.790935 17181 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.791481 17179 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.759271 16562 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:37.738051 17798 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.792935 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:37.793601 17185 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:37.792512 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:37.794075 17798 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:37.794780 17798 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.795209 17798 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:37.741223 17726 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:37.773219 16485 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.774025 17696 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.779938 16488 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.784518 16482 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.785221 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.769553 17778 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:37.752547 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.787629 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.807705 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.808156 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.809036 17717 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.809154 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.809561 17717 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.809844 17690 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.810220 17690 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.810482 17759 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.811828 16604 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:06:37.804122 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.758710 17763 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.810160 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.810675 17690 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.790937 17182 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:06:37.812835 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.814254 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.815157 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.816349 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:37.813725 16604 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.818125 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.828718 17767 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.830555 17716 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.831610 17680 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.831975 17680 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.810341 17717 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.832749 17680 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.839622 16562 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:37.812216 17759 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.842495 17690 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.844334 17759 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.847965 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.819927 17757 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.805719 17752 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.822125 17715 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.823668 17771 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.823823 17772 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:37.823757 17737 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:37.827263 17762 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.803366 17787 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.196s
I20260709 13:06:37.840903 17775 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.853436 16454 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:37.866261 16637 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:37.855742 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.852599 17758 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.850129 17699 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:37.853227 17715 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.856691 17696 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.880460 16558 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.880362 17715 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.884022 17793 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.885262 17775 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.886098 17775 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.888082 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:37.878908 17762 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.864526 17737 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:06:37.889951 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 67116.1us
I20260709 13:06:37.827478 17798 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.875654 17771 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.897959 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.898516 17699 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.877369 17790 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.876549 17772 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.877090 17788 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:37.906033 17772 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.893364 17737 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.892204 16604 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:37.920768 17761 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:37.921646 17761 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.904198 17699 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.924463 17699 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.925527 17699 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.926088 17769 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:37.926576 17769 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:37.919675 17180 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:37.903256 17752 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:37.929339 17787 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:37.873518 17726 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.894372 17778 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.937213 17689 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:37.938723 17689 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:37.939235 17715 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.943359 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:37.933492 16604 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:37.904261 17690 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:37.937218 17793 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:37.939065 17783 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.939435 17689 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.948190 17689 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.931815 17769 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.889736 17762 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.914358 17788 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:37.959050 17685 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.961820 17685 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:37.962316 17784 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.957888 17793 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.970536 17759 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:37.976604 16559 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:37.977062 17794 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.971140 16557 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.979467 17781 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:37.980540 17685 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:37.980867 17711 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.990553 16483 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:37.992816 16560 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.017745 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:38.017840 17715 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.064175 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.016636 17757 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:38.018786 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.057713 17685 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.077416 17685 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:38.066965 17788 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.076680 16559 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:38.081871 17763 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.083122 17763 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.059190 17793 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:06:38.078395 17685 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:38.088284 17800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.020s	sys 0.082s
W20260709 13:06:38.108469 17800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.020s	sys 0.082s
I20260709 13:06:38.108776 17800 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:06:38.109668 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.074576 17757 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.076553 17691 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:06:38.107342 17714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.015s	sys 0.011s
I20260709 13:06:38.080752 17777 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.114037 17789 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.087277 17776 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:38.109697 17800 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.114225 17804 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:06:38.149735 17714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.015s	sys 0.011s
I20260709 13:06:38.179780 17714 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:38.180728 17714 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.115329 17725 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:06:38.159087 17759 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.158910 17789 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:38.197114 16484 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:38.205652 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:38.206243 16490 raft_consensus.cc:606] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:38.206578 16490 raft_consensus.cc:614] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:38.208925 17188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.016s	sys 0.010s
W20260709 13:06:38.209630 17188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.016s	sys 0.010s
I20260709 13:06:38.197566 17804 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:38.211371 17801 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:06:38.229794 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.015s
W20260709 13:06:38.231376 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.000s	sys 0.016s
I20260709 13:06:38.233847 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:38.235247 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.248625 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.251333 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 435043us
I20260709 13:06:38.253422 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.257115 16637 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.254945 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.259891 16637 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:38.254700 17802 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:06:38.262974 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.290197 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:38.290759 16490 raft_consensus.cc:606] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:38.291095 16490 raft_consensus.cc:614] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:38.264120 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.279629 17726 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:38.291193 17809 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.317375 17809 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:38.317795 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a22c30518dd74380871bcf169099e049"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:38.319470 17809 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.320012 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.320569 16562 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:38.294849 17757 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.332474 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:38.333199 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:38.292269 17803 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.389799 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:38.261147 17789 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.322517 17726 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:38.392940 17808 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:06:38.405493 17680 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.389232 17777 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:38.388608 17715 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:38.401639 17726 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.406952 17789 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.332576 17737 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:38.403223 17690 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:38.422627 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.394665 17803 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.412734 17715 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.428323 16559 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:38.432431 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:38.429075 17737 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.433468 16634 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:38.434816 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1158) took 1019 ms. Trace:
I20260709 13:06:38.441375 16490 raft_consensus.cc:606] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:38.441738 16490 raft_consensus.cc:614] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:38.442386 17730 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.442737 17730 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:38.444301 17804 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.435212 16483 rpcz_store.cc:276] 0709 13:06:37.415414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.415958 (+   544us) service_pool.cc:224] Handling call
0709 13:06:38.434645 (+1018687us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54002d7154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:38.434745 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222794112}
I20260709 13:06:38.443459 17730 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.473312 17715 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:38.491952 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.492789 16640 raft_consensus.cc:2393] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:38.494518 17803 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.495035 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:38.468868 17730 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.490715 17715 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.503247 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:38.503288 17183 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.510525 17737 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.511045 17737 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.511895 17183 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.514943 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.518882 17737 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:38.518735 17726 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.521834 17726 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.523010 17671 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.513098 17715 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.527912 17180 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:38.530067 17781 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.532315 17715 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.533179 17671 tablet_bootstrap.cc:492] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:06:38.533885 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:38.534437 17759 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.534790 17759 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:38.533896 17671 ts_tablet_manager.cc:1403] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 1.134s	user 0.025s	sys 0.017s
I20260709 13:06:38.537428 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.535516 17759 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.531733 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:38.541623 17775 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.541949 17775 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.542253 17775 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.546252 17759 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.551967 16559 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.552219 17671 raft_consensus.cc:359] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:38.553031 17671 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:06:38.553637 17671 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:38.554100 17711 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.554500 17711 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:38.555291 17711 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.556262 17711 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.558705 17183 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.560854 17671 ts_tablet_manager.cc:1434] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.002s
I20260709 13:06:38.563261 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-9b8d067430b24267b8a20f78d68ac412 received from {username='slave'} at 127.0.0.1:49162
I20260709 13:06:38.563959 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-9b8d067430b24267b8a20f78d68ac412 on tablet 9b8d067430b24267b8a20f78d68ac412 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:38.566164 16558 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.563367 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:38.567108 16559 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.567468 17182 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:38.568450 16566 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.570878 16637 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.579485 17775 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.587318 17775 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:38.621239 17765 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.622252 17765 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:38.614688 16456 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:38.625963 17730 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.626513 17730 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.626927 17730 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.627573 16634 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.629189 16638 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.623996 17789 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.614670 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 56) took 1193 ms. Trace:
I20260709 13:06:38.632068 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:38.634752 16566 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.629231 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.636955 16559 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.629880 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.631202 16484 rpcz_store.cc:276] 0709 13:06:37.420740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.654406 (+233666us) service_pool.cc:224] Handling call
0709 13:06:37.654720 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.205562 (+550842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.613817 (+408255us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400259254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:38.614362 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135080320}
W20260709 13:06:38.640450 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 64223.6us
I20260709 13:06:38.642719 17765 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.643385 17769 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.645777 17789 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.648203 17765 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.651293 16488 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.654661 16487 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.655382 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:38.629068 16640 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.656348 17182 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.657097 16483 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.660418 17187 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.662927 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:38.663946 16482 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:38.665673 17789 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.668555 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:38.668893 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.670910 17690 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.671559 17690 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.673215 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:38.674448 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:38.675436 16486 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.675868 17793 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.676542 17793 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:38.678002 17793 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.684438 17187 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.687034 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 125) took 1326 ms. Trace:
I20260709 13:06:38.681370 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.706723 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:38.710474 16483 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.713176 16482 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.722872 16385 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 2, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 2 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:38.749722 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 48431.1us
I20260709 13:06:38.681066 16559 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.729454 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.730337 17803 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.752301 17803 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.752625 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.753002 17803 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.753396 17803 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:38.753895 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.754380 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:38.754485 17803 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.753281 17751 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:38.756023 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.753280 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.757472 16638 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:38.732446 17804 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.758466 17779 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.738297 17695 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.759140 17695 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:38.760010 16566 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.759636 17695 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.760512 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.761518 17779 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.763152 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:38.739189 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 71065.4us
I20260709 13:06:38.679697 17690 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.684023 17789 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.766887 16487 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.767474 17789 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.768674 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.769829 17823 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.692746 16389 rpcz_store.cc:276] 0709 13:06:37.360944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.361098 (+   154us) service_pool.cc:224] Handling call
0709 13:06:38.686767 (+1325669us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:37.511719 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:37.512300 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:37.512334 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:06:37.512353 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:37.512686 (+   333us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:37.512758 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:37.512791 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:37.512968 (+   177us) tablet.cc:701] Row locks acquired
0709 13:06:37.512985 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:37.513110 (+   125us) write_op.cc:270] Start()
0709 13:06:37.513224 (+   114us) write_op.cc:276] Timestamp: P: 1783602397513070 usec, L: 0
0709 13:06:37.513247 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:37.513893 (+   646us) log.cc:844] Serialized 527 byte log entry
0709 13:06:38.468024 (+954131us) op_driver.cc:464] REPLICATION: finished
0709 13:06:38.621892 (+153868us) write_op.cc:301] APPLY: starting
0709 13:06:38.622121 (+   229us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:38.622326 (+   205us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:38.622483 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:38.680869 (+ 58386us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:38.681157 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:38.681225 (+    68us) write_op.cc:312] APPLY: finished
0709 13:06:38.681598 (+   373us) log.cc:844] Serialized 23 byte log entry
0709 13:06:38.682911 (+  1313us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.683031 (+   120us) write_op.cc:454] Released schema lock
0709 13:06:38.683090 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:38.683560 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.683597 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26120,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":151058,"apply.run_cpu_time_us":2748,"apply.run_wall_time_us":61735,"num_ops":1,"prepare.queue_time_us":103818,"prepare.run_cpu_time_us":178212,"prepare.run_wall_time_us":342176,"raft.queue_time_us":128633,"raft.run_cpu_time_us":39564,"raft.run_wall_time_us":137480,"replication_time_us":939420,"spinlock_wait_cycles":1314048,"thread_start_us":591792,"threads_started":4,"wal-append.queue_time_us":593309}]]}
I20260709 13:06:38.771517 17823 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.731439 17806 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.772846 17730 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:38.772650 17789 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.765259 17804 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.765232 17766 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.766228 16529 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.773500 16566 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.686760 17182 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:38.776742 17803 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.790760 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.791863 17761 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.792481 17761 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.800298 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.801710 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.803925 17714 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:38.807631 16487 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.808542 17779 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.809245 16491 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.811954 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:38.809186 17779 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:38.823745 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57648.4us
I20260709 13:06:38.814055 16487 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:38.821280 17806 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:38.826651 16488 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.815433 17800 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:38.820847 16483 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:38.830364 17779 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.830842 17779 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.831198 17779 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:38.832185 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.813503 16566 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.836655 17806 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.837006 16638 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:38.839340 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 144620us
I20260709 13:06:38.834262 17690 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.832489 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:38.847990 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.848755 16557 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:38.849351 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.849939 16640 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:38.850718 17759 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.854166 17759 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.858155 17759 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:38.858966 16483 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.859278 17806 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.861478 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:38.861737 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:38.863092 17726 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.863668 17726 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.865209 16562 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:38.865816 17726 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.866276 16485 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.866686 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:38.867326 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:38.868120 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:38.868403 17761 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:38.866279 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:38.858170 17690 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:38.870041 16561 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.870499 16485 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:38.870872 17690 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.872340 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:38.875175 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.876425 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:38.877101 16565 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.880851 17730 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.868966 16482 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:38.882123 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:38.882680 16562 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.884308 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:38.885088 16487 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:38.891566 17793 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.891722 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:38.883651 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:38.882011 16557 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:38.902410 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.855857 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:38.896718 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:38.898433 16486 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:38.896202 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.895886 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:38.871526 17690 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.908185 16638 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:38.908771 17761 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.909175 17761 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.909509 17761 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.912075 17685 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:38.913259 17691 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:38.913980 17685 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.915000 17697 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.915169 17685 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.915410 17697 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:38.908257 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:38.917272 16564 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.918915 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:38.896093 17730 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.927386 17187 raft_consensus.cc:2393] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:38.900440 17793 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:38.931277 16565 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:38.915666 17685 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:38.936601 16566 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:38.929814 17730 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:38.943222 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 49711.4us
I20260709 13:06:38.947731 17759 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.948342 17759 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.948151 17776 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:38.950510 17759 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.951871 17726 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:38.952325 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.953040 16640 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:38.937618 16558 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:38.940524 17690 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:38.943984 17730 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.964839 17680 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:38.965971 17841 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:38.957728 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:38.916592 17697 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:38.980002 17726 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:38.980643 17759 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.981119 17740 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.982779 17737 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.979718 16638 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:38.984324 17840 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:06:38.984946 17715 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.984843 17793 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:38.989326 16564 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:38.942912 17779 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.005106 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:39.019423 17856 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:39.031981 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 77786.1us
I20260709 13:06:39.045553 16486 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:39.059631 17756 consensus_queue.cc:1059] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.060396 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:39.047128 17779 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.048393 17680 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.980084 17772 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:06:39.006527 17690 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.053903 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.066998 17685 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.068435 17685 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.059633 17717 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:39.072501 17680 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.074579 17680 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.075079 17680 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.061144 16487 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:39.075979 17711 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:39.076354 17711 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:39.077173 16562 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:39.075606 17680 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.077198 17711 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.061395 16485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:39.080271 17711 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.039453 17714 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.080670 17856 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.082867 17856 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.008090 17187 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:39.074986 16388 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 2, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 2 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:39.002619 17726 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.080286 17680 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.092423 16388 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:06:39.084437 17800 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.101668 17751 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.116184 17751 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:39.104547 17846 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:39.105943 17726 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.024086 17759 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.108367 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:39.120358 16456 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:39.109912 16634 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:39.121655 17779 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.122143 17779 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:39.090121 17697 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.124459 17730 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.114893 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:39.106730 17690 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.007547 17715 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.080830 17763 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.109097 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:39.114475 17842 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:06:39.005733 17737 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.088150 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:39.123184 17779 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:39.051916 17695 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:39.181802 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 52843.6us
W20260709 13:06:39.174813 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 56780.9us
I20260709 13:06:39.216080 16638 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:39.180583 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.198369 16485 raft_consensus.cc:606] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:39.220980 16485 raft_consensus.cc:614] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:39.178772 17851 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:06:39.091943 17856 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:39.227424 16564 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:39.222725 17761 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.199282 17858 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:39.231295 16565 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:39.239699 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.132536 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 65722.5us
I20260709 13:06:39.157451 17680 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.183887 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:39.242059 17695 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.181934 17717 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:06:39.267169 17793 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:06:39.256318 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.260000 17856 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.273339 16561 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.260393 17751 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.153314 17800 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.200479 17726 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:39.237329 17759 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.132536 17804 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:06:39.262063 16483 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:39.299248 17188 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:39.302831 17184 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:39.303872 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:39.306757 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:39.283915 17695 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:39.316304 16561 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:39.272955 17680 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.265949 17763 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.322885 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:39.323132 17761 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.310604 17789 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:39.335402 16638 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:39.322772 17691 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.314934 17726 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.201440 17183 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:39.351809 17789 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.298118 17858 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.353554 16566 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:06:39.358002 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 84630.7us
I20260709 13:06:39.358716 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:39.350405 16558 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:39.360293 17761 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.355417 17695 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.366705 17730 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.384831 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:39.354678 17691 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.380174 17685 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.378490 17690 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.391330 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:39.394369 16636 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.384557 17804 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.386602 17799 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.457934 17695 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.458210 17699 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:39.458829 17699 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.477454 16636 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:39.443221 17730 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.395462 17726 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.489665 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:39.443476 17856 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.444419 17756 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.492151 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:39.427634 17715 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.394922 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:39.460824 17699 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.461880 17690 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.392450 17761 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.497476 17854 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:39.498205 17762 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.498661 17737 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.499076 17870 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 13:06:39.478111 17680 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.427429 17751 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:06:39.502329 17768 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:39.440619 17793 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:06:39.502919 17869 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:39.503309 17871 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.456386 17685 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.464150 17799 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.512419 17694 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.731060 17694 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.512938 17762 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.512998 17179 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:39.515728 17819 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:06:39.559384 17810 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:06:39.505610 17789 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.555971 17691 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.562443 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:39.506850 16482 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.557147 17756 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:39.500429 17776 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:06:39.480521 17804 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.564005 17761 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.508762 17699 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:39.558601 17875 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:06:39.556809 17866 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:06:39.556257 17863 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:06:39.779016 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:39.785571 17185 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:39.498046 17711 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:39.516904 17800 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.513190 17854 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.787914 17854 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:39.595683 17680 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.788203 17778 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:39.580478 17858 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.700803 16566 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.726615 17871 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.788774 17804 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.789547 17778 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:39.727438 17869 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.728041 17685 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.736690 17694 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.746415 17762 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:39.801576 17762 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:39.802067 17855 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.747750 17697 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.001s
I20260709 13:06:39.750312 17799 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.753288 17781 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.802590 17855 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.803138 17781 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.803532 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:39.799016 17699 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:39.805218 17781 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.805015 17699 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.734338 17769 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.805995 17769 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.758066 17763 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.808749 17763 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.809201 17763 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.784983 17717 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:06:39.758720 17691 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.762012 17759 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:39.811396 17759 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.764873 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:39.764021 17695 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:39.766795 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:39.804268 17180 raft_consensus.cc:2368] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:39.783484 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:39.813688 17869 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.812407 17179 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:39.811812 17871 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.811295 17691 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.767836 17789 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.812683 17695 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.816723 17789 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:39.768451 16558 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.832806 16566 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:39.788800 17680 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:39.836144 16487 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.000s	sys 0.048s
I20260709 13:06:39.895727 16529 leader_election.cc:400] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:39.898242 16529 leader_election.cc:403] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:39.909289 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:39.909896 16566 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:39.904394 16565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.013s	sys 0.017s
W20260709 13:06:39.899322 17152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.023s
W20260709 13:06:39.897949 16487 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.000s	sys 0.049s
W20260709 13:06:39.904536 16561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.008s
W20260709 13:06:39.931257 16565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.013s	sys 0.018s
W20260709 13:06:39.941556 16561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.008s
W20260709 13:06:39.933084 17152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.014s	sys 0.023s
I20260709 13:06:39.958595 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:39.976627 16566 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:39.897073 17871 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.988741 16531 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.004s
W20260709 13:06:39.989056 16531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.011s	sys 0.004s
I20260709 13:06:39.992520 17759 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.987677 17756 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:39.987252 17854 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:40.003556 17763 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:39.989701 17695 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.006059 17789 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.006382 17769 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.006501 17855 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.012670 17691 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.008524 17717 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.018664 17717 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.010100 17768 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.020345 17768 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.022274 17768 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.008388 17854 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.028339 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.059029 16566 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
W20260709 13:06:39.977758 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 592031us
W20260709 13:06:39.986907 16560 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.014s
I20260709 13:06:40.060065 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:40.055724 16532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.004s	sys 0.013s
W20260709 13:06:40.085134 16532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.004s	sys 0.013s
W20260709 13:06:40.055649 16563 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.017s
W20260709 13:06:40.086066 16563 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.004s	sys 0.018s
W20260709 13:06:40.074997 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 247179us
I20260709 13:06:40.088696 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.089296 16561 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:40.092072 16562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.019s
W20260709 13:06:40.092401 16562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.010s	sys 0.019s
I20260709 13:06:40.092957 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.087549 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:06:40.090284 16638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.000s	sys 0.043s
W20260709 13:06:40.094503 16638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.000s	sys 0.043s
I20260709 13:06:40.023845 17717 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:40.082377 16560 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.000s	sys 0.014s
W20260709 13:06:40.060725 17806 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.015s	sys 0.012s
W20260709 13:06:40.058189 16564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.011s
I20260709 13:06:40.096177 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:40.104130 16564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.015s	sys 0.011s
I20260709 13:06:40.104136 16561 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:40.056967 17803 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.055313 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.118374 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.119989 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.121059 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.123380 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.047067 16482 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:40.023761 16558 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:40.089288 17759 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.110244 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.095288 17763 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.130311 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:40.131587 16563 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:40.105857 17806 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.016s	sys 0.013s
I20260709 13:06:40.024955 17680 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:40.107307 16559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.014s	sys 0.015s
I20260709 13:06:40.107234 17717 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.116252 17779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.021s
I20260709 13:06:40.125284 17881 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.126086 16483 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:40.126402 16639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.016s	sys 0.046s
I20260709 13:06:40.127031 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.095364 17871 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.115511 17867 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.106591 16565 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.117516 17789 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.134931 16530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.094s	sys 0.139s
W20260709 13:06:40.129673 17730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.032s
I20260709 13:06:40.137426 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:40.140455 16639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.016s	sys 0.046s
I20260709 13:06:40.141003 16561 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
W20260709 13:06:40.134953 16559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.014s	sys 0.015s
I20260709 13:06:40.135293 17877 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.135988 17699 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.127638 17803 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.136879 17680 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:40.137904 17779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.021s
W20260709 13:06:40.142064 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 365515us
W20260709 13:06:40.144817 16530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.094s	sys 0.139s
I20260709 13:06:40.140597 17881 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.150777 16485 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
W20260709 13:06:40.152194 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 793492us
I20260709 13:06:40.153044 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.153620 16565 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:40.145430 17730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.003s	sys 0.032s
W20260709 13:06:40.162475 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.154304 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 370828us
I20260709 13:06:40.135164 17763 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.179286 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.140130 17717 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.147629 17699 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:40.185863 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.013s	sys 0.020s
W20260709 13:06:40.186174 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.013s	sys 0.020s
W20260709 13:06:40.186437 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 696797us
I20260709 13:06:40.150662 17799 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.151635 17680 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:40.280889 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.150916 17854 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:06:40.255048 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 67363.5us
I20260709 13:06:40.175666 17730 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:40.286841 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.287436 16636 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:40.187851 17699 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.181442 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.144902 17867 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.171339 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.258335 17188 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Advancing to term 2
I20260709 13:06:40.146385 17789 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:40.268525 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.286038 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.173005 17881 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.285192 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.292541 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.253443 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.258962 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:40.290930 17823 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.039s	sys 0.070s
I20260709 13:06:40.184069 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:40.284497 17680 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.328069 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.254546 17751 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:40.325237 16564 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.151757 17877 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.288236 17854 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.315740 17800 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:40.315485 16482 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.315358 17891 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.329089 17183 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:40.149420 16487 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:40.353080 17887 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:40.351971 16636 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:40.367832 17776 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:40.398801 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 275454us
W20260709 13:06:40.361008 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 176993us
I20260709 13:06:40.325325 16483 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
W20260709 13:06:40.330471 17823 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.039s	sys 0.070s
I20260709 13:06:40.316511 17883 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.316562 17900 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.326184 16490 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.385422 17789 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.385878 17800 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:40.379364 17891 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.380065 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.380465 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.324903 17879 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.380386 16564 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:40.376024 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.311786 17799 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:40.423175 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.441481 16635 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:40.376394 17761 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.383101 17711 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.375929 17898 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.383201 17695 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:40.383424 17694 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:40.379205 17871 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:40.379667 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 93741.7us
I20260709 13:06:40.398209 17776 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.447963 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:40.432868 17900 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.432999 17751 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.457211 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:06:40.453747 17903 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:06:40.397368 17730 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.450065 17898 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.426450 17887 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.454314 17789 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.453996 17763 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.457683 17776 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.467082 17717 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.458436 17871 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.453837 17883 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.459532 17803 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.459003 17900 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.487936 17913 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.488451 17913 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.489033 17759 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:40.451316 17711 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.483415 16633 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:40.455288 17879 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.491972 17759 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.483392 17763 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.494971 17763 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.495380 16563 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:40.496945 17763 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.497588 17763 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.498111 17763 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.498860 17883 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.499425 16566 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:40.499960 17759 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:40.500101 17180 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.500723 17763 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.478382 17871 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.502128 17776 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.502712 17871 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.455840 17695 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.476887 17799 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.480265 17793 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.467974 17898 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.475867 17891 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.497033 17711 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.505180 17913 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.504760 17800 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:40.505863 17892 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:06:40.507058 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1182) took 1177 ms. Trace:
I20260709 13:06:40.485582 17877 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.507391 16562 rpcz_store.cc:276] 0709 13:06:39.329903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.330317 (+   414us) service_pool.cc:224] Handling call
0709 13:06:39.348776 (+ 18459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.388249 (+ 39473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.388281 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.393710 (+  5429us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.097584 (+703874us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:40.097625 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.097691 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.506849 (+409158us) raft_consensus.cc:1685] finished
0709 13:06:40.506871 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.506984 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90538,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":38338,"thread_start_us":651103,"threads_started":2,"wal-append.queue_time_us":743146}
I20260709 13:06:40.493691 17909 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.450459 17761 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.517789 17695 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.518126 17793 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.529062 17793 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:40.475065 17888 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:06:40.518661 17867 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:40.504153 17897 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:06:40.531431 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1168) took 1314 ms. Trace:
I20260709 13:06:40.531818 16559 rpcz_store.cc:276] 0709 13:06:39.216736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.218268 (+  1532us) service_pool.cc:224] Handling call
0709 13:06:39.218691 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.331955 (+113264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.338517 (+  6562us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.387750 (+ 49233us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.624877 (+237127us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b18003f8e60. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:06:40.155508 (+530631us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:40.176412 (+ 20904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.182182 (+  5770us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.531150 (+348968us) raft_consensus.cc:1685] finished
0709 13:06:40.531169 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.531373 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68433,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":19167104,"thread_start_us":748733,"threads_started":2,"wal-append.queue_time_us":893443}
I20260709 13:06:40.500456 17759 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.468847 17884 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.462555 17751 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.501214 17879 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.464177 17694 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.535456 17909 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.599745 17694 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.533632 17881 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:40.604228 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 156431us
W20260709 13:06:40.606547 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 149421us
I20260709 13:06:40.607055 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:40.600263 17802 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:40.534570 17789 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.606853 17854 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.625764 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.626358 17756 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.616071 17778 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.499675 17699 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.603170 17898 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.646838 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 65) took 1289 ms. Trace:
I20260709 13:06:40.641494 17711 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.625443 17912 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.647267 16638 rpcz_store.cc:276] 0709 13:06:39.357865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.357978 (+   113us) service_pool.cc:224] Handling call
0709 13:06:39.358252 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.365657 (+  7405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.365692 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.378297 (+ 12605us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.094869 (+716572us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:40.398586 (+303717us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.427833 (+ 29247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.427912 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.646567 (+218655us) raft_consensus.cc:1685] finished
0709 13:06:40.646587 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.646741 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3946,"prepare.queue_time_us":408399,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":39610,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":10584,"thread_start_us":953957,"threads_started":2,"wal-append.queue_time_us":894531}
I20260709 13:06:40.644038 17778 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.650727 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1170) took 1431 ms. Trace:
W20260709 13:06:40.670683 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 49993.2us
I20260709 13:06:40.674257 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.655910 17887 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.658294 17776 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.661458 17778 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.646092 17756 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.657845 17884 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.675314 17917 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.684653 17751 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.656447 17711 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.684906 17899 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:40.671540 16560 rpcz_store.cc:276] 0709 13:06:39.217296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.221865 (+  4569us) service_pool.cc:224] Handling call
0709 13:06:39.227576 (+  5711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.227846 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:40.108584 (+880738us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.617255 (+508671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.624411 (+  7156us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:40.626171 (+  1760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.643199 (+ 17028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.648744 (+  5545us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":808012,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":61656,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":1357464,"threads_started":3,"wal-append.queue_time_us":399454}
I20260709 13:06:40.693298 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.708477 17187 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:40.698503 17767 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:40.699652 17898 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.700675 17699 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.701332 17881 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.677953 17922 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.679411 17779 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.717379 17779 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.705498 17711 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.718124 17793 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.658972 17912 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.719138 17789 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.719744 17803 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.720182 17793 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.720273 17803 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:40.722191 17880 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.410s	user 0.000s	sys 0.006s
I20260709 13:06:40.724068 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.725718 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:40.728407 17711 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.728782 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:40.728792 17711 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.729560 17711 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.729897 17854 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.730239 17854 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:40.730577 17854 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.726681 17917 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.733160 17756 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.735822 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.736398 17187 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.737625 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.737602 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.740509 16491 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:40.741729 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 63) took 1635 ms. Trace:
I20260709 13:06:40.742089 16639 rpcz_store.cc:276] 0709 13:06:39.106187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.111993 (+  5806us) service_pool.cc:224] Handling call
0709 13:06:39.112358 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.175436 (+ 63078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.175469 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.184294 (+  8825us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.145464 (+961170us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:40.145502 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.145565 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.721920 (+576355us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b24003e36a8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332249c4 00007f0633222acb 00007f06333dddc9 00007f06333dda55 00007f06333dd09d 00007f063600f10e 00007f063602688c 00007f0636025bb6 00007f06360257d8 00007f063602f221
0709 13:06:40.737989 (+ 16069us) raft_consensus.cc:1685] finished
0709 13:06:40.738009 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.741668 (+  3659us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40943,"raft.queue_time_us":62354,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":6074,"spinlock_wait_cycles":10325888,"thread_start_us":960788,"threads_started":1,"wal-append.queue_time_us":992618}
I20260709 13:06:40.711196 17767 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.747406 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.691639 17900 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.747918 16486 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:40.722436 17761 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.746013 17188 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:40.750151 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:40.720445 17912 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.733176 17917 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.737479 17699 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.752964 17881 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.754652 17923 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.756747 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.753890 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.757622 16482 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 2: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:40.757848 16488 raft_consensus.cc:2410] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:40.758874 17923 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:40.783095 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 55068.9us
I20260709 13:06:40.754717 17699 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.783089 17923 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.711459 17899 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.788193 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:40.788611 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.765727 17881 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.788650 16486 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:40.792316 17922 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.797472 17899 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.784391 17917 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:40.797749 17922 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.799247 17917 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.801931 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.786327 17756 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:40.801262 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.800962 17767 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:40.808364 17884 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.808914 17884 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:40.809816 17900 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.807649 16489 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:40.798312 17912 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.811213 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.811440 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:40.809774 17904 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.416s	user 0.000s	sys 0.003s
I20260709 13:06:40.803514 17881 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.824059 16491 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.824937 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.826752 17759 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.828164 17918 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.828652 17918 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.829028 17699 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.830015 16490 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.829689 16491 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.834375 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.835094 16490 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.836004 16385 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 236) took 2226 ms. Trace:
I20260709 13:06:40.833137 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.840904 16489 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:40.800578 17680 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:40.844363 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 43627.7us
I20260709 13:06:40.845024 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.846426 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.847211 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.848349 17695 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.848737 17695 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:40.849164 17695 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.849766 17803 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.848510 17887 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.850338 17887 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:40.809821 17884 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:40.848695 17867 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.850709 17887 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.854110 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.854692 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.855450 16491 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:40.856657 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.856863 17877 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.857086 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.856873 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.857393 17877 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.858106 16557 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.858366 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.856698 17883 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:40.858640 16565 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.856256 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.859899 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.860188 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.860481 16566 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.860818 16561 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.860829 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:40.862715 16456 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.862998 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.863746 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.866950 16485 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:40.867624 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.812126 17756 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.868714 16489 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.858250 16560 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:06:40.870141 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.873016 16566 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.872711 16635 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:40.871929 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.872414 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.876605 16491 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:40.829511 17778 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.886451 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:40.871495 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:40.887638 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.859051 17867 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:40.888257 16564 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.832223 17912 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.853494 17759 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.871742 17900 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.898903 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.898177 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.899662 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.896938 16490 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.900422 16491 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:40.900645 16489 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.902595 16635 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:40.871960 17699 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.908958 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.893550 17730 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.910239 17730 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:40.910612 17730 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.868162 17883 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:40.910779 17756 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:41.067916 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.068662 17179 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
W20260709 13:06:40.921586 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.070948 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.975733 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.920795 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:40.968436 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.895522 17867 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.075139 16491 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:41.074167 16490 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:41.081278 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.975443 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.946969 16486 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:41.081843 16490 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:41.087311 16489 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:40.903021 17900 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.902343 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:40.904268 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.005178 17759 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.000594 17180 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Advancing to term 3
I20260709 13:06:41.094998 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.001971 17877 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:40.976688 17922 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.189266 17922 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:41.001225 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.007609 17909 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.098879 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:41.084263 17699 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:41.005447 17711 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.100682 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:41.175019 17923 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:40.913280 17899 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.186s
I20260709 13:06:41.177003 17883 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:40.910956 17717 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.193s
I20260709 13:06:41.094453 17900 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.177510 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.178185 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.179978 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.180099 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.244990 16638 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:41.180758 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.245606 16636 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:41.181344 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:41.182060 17934 log.cc:927] Time spent T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 13:06:41.188681 16635 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:41.190466 16491 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.099175 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:41.243664 17185 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:41.249208 17188 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.034106 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:41.189810 17922 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.196771 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:41.096397 17929 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.093891 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:41.221561 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 120961us
I20260709 13:06:41.189141 17877 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:41.244336 16632 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:41.167836 17881 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.191130 17917 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.253386 16639 raft_consensus.cc:2368] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:41.248100 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.291958 16640 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:41.190873 17918 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.271631 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.289084 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.242246 17756 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.192937 17759 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.251936 17680 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.271176 16483 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.231142 16559 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:41.303143 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.254848 17883 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:41.298842 17877 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.334129 17883 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.242538 17699 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:41.339956 17896 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.909s	user 0.016s	sys 0.000s
I20260709 13:06:41.340358 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.340873 16454 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:41.341585 17917 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.331453 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:41.341945 17917 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.342298 17917 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.344045 17938 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.346588 17877 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.339318 17883 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.341039 17185 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:41.327894 17182 raft_consensus.cc:2393] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:41.338670 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.330034 17184 raft_consensus.cc:2410] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:41.299127 17778 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:41.289700 17929 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.335198 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.302227 17937 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:41.293480 17695 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.332286 17936 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.341076 17699 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.335412 17694 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.348198 17881 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.362190 17188 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:41.363058 17902 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.378432 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.381201 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.371529 17717 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.387393 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.377130 17694 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.386184 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.376806 17912 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.382536 17902 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.398059 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.388549 17778 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.380502 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.402009 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.389431 16560 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.388288 17717 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.378167 17867 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.397214 17740 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.394456 17694 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.373688 17937 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.379901 17936 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:41.398702 17902 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.381839 17881 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.413374 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.414706 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.415202 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.416026 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.400121 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.401386 17778 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.421411 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.419730 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:41.424744 16561 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:41.425688 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.425752 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.405239 17756 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.428059 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:41.408972 17717 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.435962 17877 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.436336 17877 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:41.436683 17877 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.408174 16557 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:41.417004 17923 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.445397 17867 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.445541 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.446051 17867 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.446945 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.447060 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:41.447523 17183 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:41.448125 16559 raft_consensus.cc:2393] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:41.449002 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:41.449488 16559 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.449378 17877 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.449992 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.451021 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.450835 17900 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.452885 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.453392 16564 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:41.447598 16563 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.412688 17740 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:41.412341 17711 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.454490 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:41.460645 17885 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.461040 17885 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.461208 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:41.461567 17885 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.462145 17699 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.462510 17699 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.462821 17699 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.426203 17883 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.451521 17877 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.458875 16491 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:41.425312 17778 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.459447 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:41.433430 17756 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.472873 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:41.407675 17730 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.444716 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.440238 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.461400 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:41.477948 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.478351 17929 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.478515 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.479821 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:41.480402 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.480681 17900 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.481696 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.475919 16454 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:41.454093 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:41.483960 17922 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.648249 17885 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.650858 17885 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:41.549636 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 147695us
I20260709 13:06:41.534590 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.652473 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.464130 17923 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.538867 16389 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.552278 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:40.909565 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:41.652745 16485 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
W20260709 13:06:41.503288 17153 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.091s (SENT) [suppressed 29 similar messages]
I20260709 13:06:41.675215 16566 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:41.553290 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.654917 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.544164 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:40.836380 16385 rpcz_store.cc:276] 0709 13:06:38.609550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.615763 (+  6213us) service_pool.cc:224] Handling call
0709 13:06:40.835924 (+2220161us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:38.940764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:39.115363 (+174599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:39.115412 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:06:39.115430 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:39.119739 (+  4309us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:39.134652 (+ 14913us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:39.157569 (+ 22917us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:39.182226 (+ 24657us) tablet.cc:701] Row locks acquired
0709 13:06:39.182274 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:06:39.182436 (+   162us) write_op.cc:270] Start()
0709 13:06:39.182579 (+   143us) write_op.cc:276] Timestamp: P: 1783602399182387 usec, L: 0
0709 13:06:39.182602 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:39.261535 (+ 78933us) log.cc:844] Serialized 532 byte log entry
0709 13:06:40.037550 (+776015us) op_driver.cc:464] REPLICATION: finished
0709 13:06:40.468799 (+431249us) write_op.cc:301] APPLY: starting
0709 13:06:40.475179 (+  6380us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:40.475272 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:40.475397 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:40.475621 (+   224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:40.475762 (+   141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:40.475823 (+    61us) write_op.cc:312] APPLY: finished
0709 13:06:40.490465 (+ 14642us) log.cc:844] Serialized 23 byte log entry
0709 13:06:40.490656 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:40.490730 (+    74us) write_op.cc:454] Released schema lock
0709 13:06:40.490771 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:40.491124 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:40.491153 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":421629,"apply.run_cpu_time_us":1616,"apply.run_wall_time_us":26631,"num_ops":1,"prepare.queue_time_us":113107,"prepare.run_cpu_time_us":6838,"prepare.run_wall_time_us":337758,"replication_time_us":854782,"thread_start_us":394553,"threads_started":2}]]}
I20260709 13:06:41.538141 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 223) took 2467 ms. Trace:
I20260709 13:06:41.705375 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.657246 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.709744 16490 raft_consensus.cc:2368] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
W20260709 13:06:41.710470 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53287.5us
I20260709 13:06:41.469535 17883 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:41.528683 17854 consensus_meta.cc:287] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.002s
I20260709 13:06:41.675891 17181 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:41.671723 17950 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.659464 17923 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.671828 17885 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:41.500056 17909 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:41.653980 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 153613us
I20260709 13:06:41.725975 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:41.653719 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 177864us
I20260709 13:06:41.465335 17740 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.485395 17756 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.655646 16491 raft_consensus.cc:2410] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:41.548853 17936 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.528407 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.707253 16486 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:41.549583 17779 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.535691 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.706300 16489 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:41.708184 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:41.741768 16561 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:41.484594 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 56604.3us
I20260709 13:06:41.707923 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:41.539479 17943 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:41.494607 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:41.697248 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:41.541164 17946 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:41.659195 16564 raft_consensus.cc:2368] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:41.531105 16483 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:41.711158 16604 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.495100 17789 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.716017 16563 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:41.544281 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.531360 17695 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.716961 16566 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:41.621219 17694 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.699045 17881 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.704985 17957 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:41.720182 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 250276us
I20260709 13:06:41.723476 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.653013 17917 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.719329 17711 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:41.716679 17793 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.026s	sys 0.043s
I20260709 13:06:41.727674 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:41.776122 16490 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.708124 16484 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:41.724184 17950 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.622208 17902 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:41.780041 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:41.718250 17883 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.744937 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:41.746495 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.783245 16489 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:41.784161 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.784675 16489 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:41.785271 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.726402 17923 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.749393 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:41.750833 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:41.751138 17730 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.745934 16389 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.753176 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.709247 16388 rpcz_store.cc:276] 0709 13:06:39.071222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.071431 (+   209us) service_pool.cc:224] Handling call
0709 13:06:41.538078 (+2466647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:39.267747 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:39.268288 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:39.268318 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:06:39.268334 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:39.268746 (+   412us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:39.268789 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:39.268813 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:39.269100 (+   287us) tablet.cc:701] Row locks acquired
0709 13:06:39.269118 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:39.269241 (+   123us) write_op.cc:270] Start()
0709 13:06:39.269337 (+    96us) write_op.cc:276] Timestamp: P: 1783602399269196 usec, L: 0
0709 13:06:39.269352 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:06:39.269896 (+   544us) log.cc:844] Serialized 906 byte log entry
0709 13:06:40.435145 (+1165249us) op_driver.cc:464] REPLICATION: finished
0709 13:06:40.491455 (+ 56310us) write_op.cc:301] APPLY: starting
0709 13:06:40.491520 (+    65us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:40.491626 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:40.491726 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:40.492108 (+   382us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:40.492266 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:40.492310 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:40.492485 (+   175us) log.cc:844] Serialized 29 byte log entry
0709 13:06:40.492634 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:40.492718 (+    84us) write_op.cc:454] Released schema lock
0709 13:06:40.492754 (+    36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":337119,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":53538,"apply.run_cpu_time_us":1547,"apply.run_wall_time_us":1547,"mutex_wait_us":1419,"num_ops":2,"prepare.queue_time_us":150825,"prepare.run_cpu_time_us":2522,"prepare.run_wall_time_us":15813,"replication_time_us":1155862,"thread_start_us":164787,"threads_started":1}]]}
I20260709 13:06:41.757949 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:41.759222 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.788728 16485 raft_consensus.cc:2368] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:41.789011 16640 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:41.746908 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.760391 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.760032 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.789798 16563 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:41.761175 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 50113.6us
I20260709 13:06:41.722427 17854 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.763829 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.745599 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:41.765024 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.776693 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.774197 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.745885 17929 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.749737 16487 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:41.798978 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 87) took 1002 ms. Trace:
I20260709 13:06:41.760545 17789 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.800030 17789 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.801090 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:41.758347 17955 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:41.775918 17711 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:41.802312 17711 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.804339 17854 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.783093 16638 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.778429 17957 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.807473 16566 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:41.774966 17751 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.808151 17751 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.754209 16488 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:41.737100 17885 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:41.808506 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.809396 16491 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:41.809557 17885 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.810103 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.810529 17694 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:41.790040 16486 raft_consensus.cc:2410] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:06:41.790993 16558 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:41.779536 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:41.812120 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.790367 16604 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.812747 16558 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:41.813310 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:41.813815 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:41.802224 17955 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:41.814361 16558 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.791718 17767 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.796984 16564 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:41.792090 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:41.781525 17950 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.794325 16530 leader_election.cc:400] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:41.821988 16530 leader_election.cc:403] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:41.794628 16639 raft_consensus.cc:2368] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:41.764808 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.796006 16565 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:41.794085 17905 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:41.797662 17695 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:41.812306 16483 raft_consensus.cc:2368] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
W20260709 13:06:44.300513 16483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 794) took 3206 ms (client timeout 2040 ms). Trace:
W20260709 13:06:44.300889 16483 rpcz_store.cc:269] 0709 13:06:41.094319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.759605 (+665286us) service_pool.cc:224] Handling call
0709 13:06:44.300410 (+2540805us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.301920 16483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 813) took 2558 ms (client timeout 1538 ms). Trace:
W20260709 13:06:44.302273 16483 rpcz_store.cc:269] 0709 13:06:41.743397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.301758 (+2558361us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.301866 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.303025 16483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 792) took 3210 ms (client timeout 2227 ms). Trace:
W20260709 13:06:44.303345 16483 rpcz_store.cc:269] 0709 13:06:41.092491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.302880 (+3210389us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.302981 (+   101us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:41.809252 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 85) took 1021 ms. Trace:
I20260709 13:06:44.307858 17980 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.308336 17980 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.312193 17988 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:41.794898 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:42.517560 17970 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.314497 17970 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.315918 17987 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.316458 17970 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:42.520725 17971 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.825152 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:44.307214 16482 rpcz_store.cc:276] 0709 13:06:40.787547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.757724 (+970177us) service_pool.cc:224] Handling call
0709 13:06:41.794031 (+ 36307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.808925 (+ 14894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.808954 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.808999 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.809030 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.809093 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.809201 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:42.417647 16558 consensus_meta.cc:287] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.002s
I20260709 13:06:44.326277 16558 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
W20260709 13:06:44.326752 16558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1493) took 2845 ms (client timeout 2034 ms). Trace:
W20260709 13:06:44.327064 16558 rpcz_store.cc:269] 0709 13:06:41.481555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.813487 (+331932us) service_pool.cc:224] Handling call
0709 13:06:44.326695 (+2513208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:42.381112 16559 consensus_meta.cc:287] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.893s	user 0.005s	sys 0.009s
I20260709 13:06:44.328480 16559 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
W20260709 13:06:44.328956 16559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1482) took 3149 ms (client timeout 1946 ms). Trace:
W20260709 13:06:44.329278 16559 rpcz_store.cc:269] 0709 13:06:41.179189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.448773 (+269584us) service_pool.cc:224] Handling call
0709 13:06:44.328891 (+2880118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.330070 16559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 65) took 2984 ms (client timeout 2505 ms). Trace:
W20260709 13:06:44.330399 16559 rpcz_store.cc:269] 0709 13:06:41.345322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.329901 (+2984579us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.330001 (+   100us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.331135 16559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1494) took 2427 ms (client timeout 1959 ms). Trace:
W20260709 13:06:42.133698 16560 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.721s	user 0.001s	sys 0.006s
I20260709 13:06:44.332482 16560 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:44.333420 16560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1213) took 3364 ms (client timeout 2855 ms). Trace:
W20260709 13:06:44.333731 16560 rpcz_store.cc:269] 0709 13:06:40.968876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.006180 (+ 37304us) service_pool.cc:224] Handling call
0709 13:06:44.333249 (+3327069us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540017ff54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.333364 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238558080}
W20260709 13:06:44.334625 16560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1221) took 2431 ms (client timeout 2004 ms). Trace:
W20260709 13:06:44.334930 16560 rpcz_store.cc:269] 0709 13:06:41.903090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.334482 (+2431392us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.334581 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:41.828256 16561 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
W20260709 13:06:44.336696 16561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1486) took 3141 ms (client timeout 2097 ms). Trace:
W20260709 13:06:44.337002 16561 rpcz_store.cc:269] 0709 13:06:41.195001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.707698 (+512697us) service_pool.cc:224] Handling call
0709 13:06:44.336639 (+2628941us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.337674 16561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1219) took 2435 ms (client timeout 2044 ms). Trace:
W20260709 13:06:44.337960 16561 rpcz_store.cc:269] 0709 13:06:41.902631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.337541 (+2434910us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.337632 (+    91us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.338627 16561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 67) took 2992 ms (client timeout 2628 ms). Trace:
W20260709 13:06:44.338897 16561 rpcz_store.cc:269] 0709 13:06:41.345805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.338481 (+2992676us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.338564 (+    83us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.339531 16561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1216) took 2437 ms (client timeout 2151 ms). Trace:
I20260709 13:06:41.834890 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.340560 16562 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:44.340976 16562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1491) took 2908 ms (client timeout 2211 ms). Trace:
W20260709 13:06:44.341265 16562 rpcz_store.cc:269] 0709 13:06:41.432931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.834661 (+401730us) service_pool.cc:224] Handling call
0709 13:06:44.340922 (+2506261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.341907 16562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1223) took 2438 ms (client timeout 2160 ms). Trace:
W20260709 13:06:44.342172 16562 rpcz_store.cc:269] 0709 13:06:41.903539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.341777 (+2438238us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.341867 (+    90us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.342777 16562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1217) took 2440 ms (client timeout 2393 ms). Trace:
W20260709 13:06:44.343039 16562 rpcz_store.cc:269] 0709 13:06:41.902158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.342657 (+2440499us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.342739 (+    82us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:41.817869 16563 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:41.833627 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:41.844239 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:42.158221 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 277710us
I20260709 13:06:41.835922 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:41.857930 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 71704us
I20260709 13:06:41.821064 16638 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
W20260709 13:06:44.347771 16558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 63) took 3002 ms (client timeout 2319 ms). Trace:
W20260709 13:06:42.342828 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 85973.1us
I20260709 13:06:41.792933 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:06:44.335626 16560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1218) took 2433 ms (client timeout 2017 ms). Trace:
I20260709 13:06:44.355382 17181 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:44.355839 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 2.53052e+06us
I20260709 13:06:44.356549 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:44.355332 16560 rpcz_store.cc:269] 0709 13:06:41.902392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.335491 (+2433099us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.335583 (+    92us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:44.358106 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.359448 17991 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.853780 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:41.798358 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:41.831775 17694 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.362736 17694 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:42.135280 17699 consensus_meta.cc:287] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.000s
I20260709 13:06:44.364158 17699 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.366083 17699 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.775053 17717 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:44.362555 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 2.52648e+06us
I20260709 13:06:44.370158 17717 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:44.373553 16603 connection.cc:256] RPC call timeout handler was delayed by -1.2170334290000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
I20260709 13:06:41.808511 17751 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.381898 17181 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:44.382439 17181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 303) took 2594 ms (client timeout 2160 ms). Trace:
I20260709 13:06:41.853194 17695 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:42.126107 17711 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.384902 17695 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.385370 17711 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:42.147213 17756 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:42.130821 17778 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.629s	user 0.004s	sys 0.000s
I20260709 13:06:44.388463 17778 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.389876 17751 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.390358 17778 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:42.150925 17789 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.392706 17789 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:41.777948 17793 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.026s	sys 0.043s
I20260709 13:06:41.796243 17800 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.897919 17799 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:42.519862 17803 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.399176 17803 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.401047 17803 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.831249 17881 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.816013 17854 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.402787 17854 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.403147 17854 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.387624 17756 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:41.830248 17899 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.405283 17899 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.407106 17899 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:42.382766 17918 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.408444 17918 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.410300 17918 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:42.155368 17883 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:41.816202 17887 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.946s	user 0.006s	sys 0.002s
I20260709 13:06:44.412000 17887 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.412529 17883 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.413293 16560 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.413803 17887 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:41.809346 17902 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:41.859521 17905 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:44.417369 17905 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:44.418149 17905 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.419358 17905 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.792349 17917 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:42.132320 17923 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.422333 17923 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:41.796522 17936 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:44.423427 17936 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:44.423842 17936 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.160727 17938 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.425868 17938 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:42.425504 17950 consensus_meta.cc:287] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.000s
I20260709 13:06:44.428544 17950 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.430383 17950 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:41.815991 17955 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:41.808440 17957 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:41.886267 17958 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:06:43.759034 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.012s	user 0.017s	sys 0.024s
I20260709 13:06:44.068740 17972 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.433379 17936 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:41.799371 16487 rpcz_store.cc:276] 0709 13:06:40.796273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.469479 (+673206us) service_pool.cc:224] Handling call
0709 13:06:41.798908 (+329429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.425462 17854 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.141189 17973 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.143590 17759 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:44.144500 17975 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.148252 16456 connection.cc:256] RPC call timeout handler was delayed by -1.8404770160000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 13:06:44.148468 17976 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:44.149627 17937 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:44.166376 16566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1488) took 2970 ms (client timeout 2213 ms). Trace:
W20260709 13:06:44.435071 16456 connection.cc:256] RPC call timeout handler was delayed by -1.6543075310000859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 13:06:44.435074 17975 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.435081 17973 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.436164 16564 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:44.436935 17854 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:44.437355 17975 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:44.190011 17977 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.437727 16564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1492) took 2958 ms (client timeout 2042 ms). Trace:
I20260709 13:06:44.191056 17978 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.192093 17979 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.435499 16566 rpcz_store.cc:269] 0709 13:06:41.195513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.773954 (+578441us) service_pool.cc:224] Handling call
0709 13:06:44.166185 (+2392231us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400440054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.166307 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25229696}
I20260709 13:06:44.204346 17965 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.434600 17938 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.438654 17976 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.439100 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.209095 17981 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.438540 17979 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:44.439740 17981 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.216400 17982 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.435426 16456 connection.cc:256] RPC call timeout handler was delayed by -1.6432387669999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:06:44.207839 16486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 790) took 3115 ms (client timeout 2188 ms). Trace:
W20260709 13:06:44.440882 16456 connection.cc:256] RPC call timeout handler was delayed by -1.5343387670000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 13:06:44.440661 17982 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:44.441282 16456 connection.cc:256] RPC call timeout handler was delayed by -1.4830341949999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25070000000000003s for a response
I20260709 13:06:44.441529 17979 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.441780 16456 connection.cc:256] RPC call timeout handler was delayed by -1.398438767000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 13:06:44.441541 17975 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.224074 17983 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.230505 17691 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:44.438449 17978 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.442626 17975 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.443027 17691 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.444437 17978 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.261139 16490 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 2.483s	user 0.017s	sys 0.019s
I20260709 13:06:41.796859 16389 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.444655 17975 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.438282 17936 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.274746 17912 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.240099 17985 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.312707 17988 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.445791 17912 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.445845 17985 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.447099 17988 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.247555 17986 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:44.316394 17987 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.447832 17985 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:42.140627 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.317047 17971 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.449636 16557 raft_consensus.cc:2368] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
W20260709 13:06:44.450093 16557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1495) took 2502 ms (client timeout 1707 ms). Trace:
I20260709 13:06:44.450214 17981 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.450459 16557 rpcz_store.cc:269] 0709 13:06:41.947643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.140347 (+192704us) service_pool.cc:224] Handling call
0709 13:06:44.450023 (+2309676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.450733 17986 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.451246 17971 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.322307 17990 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.322621 17980 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:44.323221 16483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 807) took 2972 ms (client timeout 2063 ms). Trace:
W20260709 13:06:44.324035 16482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 806) took 2984 ms (client timeout 2085 ms). Trace:
W20260709 13:06:44.452302 16482 rpcz_store.cc:269] 0709 13:06:41.339249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.323875 (+2984626us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.323982 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:44.452031 17990 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.452836 17986 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:44.453071 16482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 814) took 2709 ms (client timeout 2111 ms). Trace:
W20260709 13:06:44.453441 16482 rpcz_store.cc:269] 0709 13:06:41.743968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.452902 (+2708934us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.453010 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:44.454046 17990 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.324304 17989 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.454299 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:44.345836 16565 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
W20260709 13:06:44.346449 16488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 86) took 3556 ms (client timeout 2126 ms). Trace:
W20260709 13:06:44.353274 16558 rpcz_store.cc:269] 0709 13:06:41.344850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.347603 (+3002753us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.347715 (+   112us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.348745 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 809) took 2997 ms (client timeout 2104 ms). Trace:
I20260709 13:06:44.460915 16557 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:44.353289 16638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 828) took 2609 ms (client timeout 1930 ms). Trace:
W20260709 13:06:44.354317 16561 rpcz_store.cc:269] 0709 13:06:41.901887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.339399 (+2437512us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.339491 (+    92us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:44.461609 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1474) took 3372 ms. Trace:
W20260709 13:06:44.331444 16559 rpcz_store.cc:269] 0709 13:06:41.903783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.330996 (+2427213us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.331091 (+    95us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:41.830539 17184 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.359563 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:44.360391 17153 connection.cc:256] RPC call timeout handler was delayed by -2.0542036560001407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 13:06:44.363018 17781 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:42.413823 17740 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.667s	user 0.005s	sys 0.002s
I20260709 13:06:44.375784 17775 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.377414 17694 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.465499 17990 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.465849 17990 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.466161 17990 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.462915 17955 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:06:44.464339 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 104844us
I20260709 13:06:44.468647 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:44.468442 17955 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.469664 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:44.470603 17955 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:44.470752 17971 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.470620 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:44.467950 17950 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.471992 17950 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.472476 17740 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.472206 16530 leader_election.cc:400] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:44.472066 17989 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:44.473301 16530 leader_election.cc:403] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.473932 17950 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:44.474411 17938 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:44.471434 17971 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:44.474905 17989 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:44.475095 17971 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.475330 17989 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.476859 17971 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.474176 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:44.478821 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:44.393105 17751 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:44.482741 17971 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.397403 17187 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.400451 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:44.398265 17799 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.464005 16557 rpcz_store.cc:276] 0709 13:06:41.088935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.451259 (+3362324us) service_pool.cc:224] Handling call
0709 13:06:44.451558 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.461373 (+  9815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.461559 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.484457 17971 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.484668 17799 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.432351 16560 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:44.434031 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.693s	user 0.017s	sys 0.024s
I20260709 13:06:44.437492 17973 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.485394 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 2.74921e+06us
I20260709 13:06:44.487032 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:44.488713 17187 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:44.489218 17900 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.438813 17965 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:44.440150 16566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1496) took 2298 ms (client timeout 2872 ms). Trace:
I20260709 13:06:44.441377 17977 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:44.442111 16456 connection.cc:256] RPC call timeout handler was delayed by -1.3633387669999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 13:06:44.489997 17187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 283) took 2695 ms (client timeout 2872 ms). Trace:
W20260709 13:06:44.490238 16566 rpcz_store.cc:269] 0709 13:06:42.142218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.438871 (+2296653us) service_pool.cc:224] Handling call
0709 13:06:44.439774 (+   903us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.490445 17187 rpcz_store.cc:269] 0709 13:06:41.794756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.795270 (+   514us) service_pool.cc:224] Handling call
0709 13:06:44.489848 (+2694578us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b54005ff0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.489941 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83328768}
I20260709 13:06:44.491508 17965 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:44.491945 17977 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.489269 17800 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.492653 16485 raft_consensus.cc:2368] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:44.492799 17971 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:44.493577 16485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 812) took 3073 ms (client timeout 1794 ms). Trace:
I20260709 13:06:44.492408 16530 leader_election.cc:400] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
W20260709 13:06:44.493954 16485 rpcz_store.cc:269] 0709 13:06:41.419786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.794699 (+374913us) service_pool.cc:224] Handling call
0709 13:06:44.493386 (+2698687us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400369054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.493514 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409457024}
I20260709 13:06:44.495052 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.445322 17691 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:44.232653 17984 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:44.496747 17984 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.498184 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.498795 17984 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.294433 17152 connection.cc:256] RPC call timeout handler was delayed by -1.6878838970000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:06:44.321012 16491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1245) took 2970 ms (client timeout 2004 ms). Trace:
W20260709 13:06:44.248065 16512 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9860 after lost signal to thread 15387
I20260709 13:06:44.448109 17983 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:44.499571 16456 connection.cc:256] RPC call timeout handler was delayed by -1.3129387669999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 13:06:44.499930 16456 connection.cc:256] RPC call timeout handler was delayed by -1.2581770159999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 13:06:44.500099 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:44.500316 16456 connection.cc:256] RPC call timeout handler was delayed by -1.1709139759999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:06:44.500654 16456 connection.cc:256] RPC call timeout handler was delayed by -1.0981731589999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:06:44.500985 17983 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.501327 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.442615 17982 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.344514 16563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 62) took 2999 ms (client timeout 2091 ms). Trace:
W20260709 13:06:44.502051 16563 rpcz_store.cc:269] 0709 13:06:41.344604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.800875 (+456271us) service_pool.cc:224] Handling call
0709 13:06:44.344457 (+2543582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.502488 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:44.502995 16635 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.503307 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1214) took 2969 ms. Trace:
I20260709 13:06:44.503634 16563 rpcz_store.cc:276] 0709 13:06:41.533809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.502649 (+2968840us) service_pool.cc:224] Handling call
0709 13:06:44.502886 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.503027 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.503049 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.503085 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.503113 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.503175 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.503262 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.504657 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.505678 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.506582 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.507057 16563 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:44.324509 16484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 801) took 3223 ms (client timeout 1513 ms). Trace:
I20260709 13:06:44.455453 16482 raft_consensus.cc:2368] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
W20260709 13:06:44.499478 16491 rpcz_store.cc:269] 0709 13:06:41.350385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.320853 (+2970468us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.320956 (+   103us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.508168 16482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 810) took 3148 ms (client timeout 3329 ms). Trace:
W20260709 13:06:44.508522 16512 debug-util.cc:398] Leaking SignalData structure 0x7b0800144020 after lost signal to thread 16423
I20260709 13:06:44.508832 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.508997 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.495736 16485 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:44.509747 16512 debug-util.cc:398] Leaking SignalData structure 0x7b08003b99a0 after lost signal to thread 16515
W20260709 13:06:44.510157 16512 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9940 after lost signal to thread 16516
W20260709 13:06:44.499372 17152 connection.cc:256] RPC call timeout handler was delayed by -1.6878838970000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:06:44.510712 17152 connection.cc:256] RPC call timeout handler was delayed by -1.6867360559999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 13:06:44.511222 16512 debug-util.cc:398] Leaking SignalData structure 0x7b08003177e0 after lost signal to thread 16590
I20260709 13:06:44.509356 16491 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:44.511514 16512 debug-util.cc:398] Leaking SignalData structure 0x7b0800339180 after lost signal to thread 16591
I20260709 13:06:44.512174 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.512687 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:44.441200 16486 rpcz_store.cc:269] 0709 13:06:41.092027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.207604 (+3115577us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.207732 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:44.513820 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.448143 17185 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
W20260709 13:06:44.510218 16484 rpcz_store.cc:269] 0709 13:06:41.100704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.445265 (+344561us) service_pool.cc:224] Handling call
0709 13:06:44.324337 (+2879072us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54000505d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.324447 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579229440}
I20260709 13:06:44.515384 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:44.516040 16484 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:44.516894 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.517437 16484 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.510066 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.434115 17972 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.520294 16633 raft_consensus.cc:2368] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:44.499359 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.521515 16637 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.521849 17972 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.434640 16487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 791) took 3342 ms (client timeout 2524 ms). Trace:
W20260709 13:06:44.522396 16487 rpcz_store.cc:269] 0709 13:06:41.092269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.434465 (+3342196us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.434579 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.511024 17152 connection.cc:256] RPC call timeout handler was delayed by -1.6574964189999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 13:06:44.515344 17185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 302) took 2683 ms (client timeout 2109 ms). Trace:
W20260709 13:06:44.508643 16482 rpcz_store.cc:269] 0709 13:06:41.359615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.454056 (+3094441us) service_pool.cc:224] Handling call
0709 13:06:44.508113 (+ 54057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.509673 16639 raft_consensus.cc:2368] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:44.514495 16486 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:44.524897 17152 connection.cc:256] RPC call timeout handler was delayed by -1.644896418999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 13:06:44.526366 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.527029 16634 raft_consensus.cc:2368] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
W20260709 13:06:44.524225 17185 rpcz_store.cc:269] 0709 13:06:41.832393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.853572 (+ 21179us) service_pool.cc:224] Handling call
0709 13:06:44.515189 (+2661617us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54005fe6d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.515285 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201394560}
I20260709 13:06:44.523852 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1237) took 3713 ms. Trace:
I20260709 13:06:44.528378 16487 rpcz_store.cc:276] 0709 13:06:40.810934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.523079 (+3712145us) service_pool.cc:224] Handling call
0709 13:06:44.523354 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.523523 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.523548 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.523591 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:44.523629 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.523683 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.523785 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.528853 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 802) took 3240 ms. Trace:
I20260709 13:06:44.529394 16482 rpcz_store.cc:276] 0709 13:06:41.288369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.528047 (+3239678us) service_pool.cc:224] Handling call
0709 13:06:44.528356 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.528526 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.528559 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.528601 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:44.528636 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.528691 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.528795 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.456957 17987 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.440832 17976 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:44.447778 17912 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.438261 16564 rpcz_store.cc:269] 0709 13:06:41.479544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.818448 (+338904us) service_pool.cc:224] Handling call
0709 13:06:44.437560 (+2619112us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b540040ea54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.437671 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209209088}
I20260709 13:06:44.536727 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.537207 16564 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.455303 16490 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:44.461959 16558 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:44.538470 16490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 804) took 3246 ms (client timeout 1726 ms). Trace:
I20260709 13:06:44.343775 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:44.460956 16488 rpcz_store.cc:269] 0709 13:06:40.789840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.535423 (+745583us) service_pool.cc:224] Handling call
0709 13:06:44.346385 (+2810962us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.461438 16638 rpcz_store.cc:269] 0709 13:06:41.743911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.744714 (+   803us) service_pool.cc:224] Handling call
0709 13:06:44.353183 (+2608469us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.538800 16490 rpcz_store.cc:269] 0709 13:06:41.292210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.719783 (+427573us) service_pool.cc:224] Handling call
0709 13:06:44.538412 (+2818629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.539546 16562 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:44.539934 16562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 64) took 3194 ms (client timeout 3163 ms). Trace:
W20260709 13:06:44.461247 16489 rpcz_store.cc:269] 0709 13:06:41.351182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.348588 (+2997406us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.348692 (+   104us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:44.540233 16562 rpcz_store.cc:269] 0709 13:06:41.345082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.343517 (+2998435us) service_pool.cc:224] Handling call
0709 13:06:44.539876 (+196359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.541003 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:44.463236 16565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1473) took 3377 ms (client timeout 2507 ms). Trace:
W20260709 13:06:44.541518 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 46593.6us
I20260709 13:06:44.460271 17881 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:44.464802 17781 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:44.465119 17153 connection.cc:256] RPC call timeout handler was delayed by -1.9490046250000432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3163s for a response
I20260709 13:06:44.479447 17938 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.479848 16604 connection.cc:256] RPC call timeout handler was delayed by -1.6543118690000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:06:44.474766 17740 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:44.461854 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 83328.3us
I20260709 13:06:44.480472 17775 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.480711 17990 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.481276 17184 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:44.501452 17983 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:44.452095 16483 rpcz_store.cc:269] 0709 13:06:41.350737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.323067 (+2972330us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:44.323169 (+   102us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:44.511061 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:44.512517 16512 debug-util.cc:398] Leaking SignalData structure 0x7b080024a8e0 after lost signal to thread 16664
I20260709 13:06:44.445495 16389 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 2 to 3, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.462589 16561 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.463351 16559 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:44.541507 16562 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:44.543653 16530 leader_election.cc:400] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:44.591143 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 61) took 3246 ms. Trace:
I20260709 13:06:44.551175 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:06:44.543700 17153 connection.cc:256] RPC call timeout handler was delayed by -1.5828735439999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 13:06:44.492660 17800 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:44.591884 17153 connection.cc:256] RPC call timeout handler was delayed by -1.5179035250000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26280000000000003s for a response
I20260709 13:06:44.592873 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:44.538661 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1476) took 3431 ms. Trace:
I20260709 13:06:44.595289 16485 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:44.552899 16560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1222) took 2649 ms (client timeout 2981 ms). Trace:
I20260709 13:06:44.543263 17781 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:44.543777 16565 rpcz_store.cc:269] 0709 13:06:41.086065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.823206 (+737141us) service_pool.cc:224] Handling call
0709 13:06:44.463169 (+2639963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.555361 17775 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:44.519411 16491 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:44.562546 16635 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:44.565032 16564 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:44.566560 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:44.382779 17181 rpcz_store.cc:269] 0709 13:06:41.787975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.792694 (+  4719us) service_pool.cc:224] Handling call
0709 13:06:44.382361 (+2589667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.574474 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.575467 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.556279 16604 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:44.571386 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.591518 16561 rpcz_store.cc:276] 0709 13:06:41.344346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.462192 (+3117846us) service_pool.cc:224] Handling call
0709 13:06:44.462442 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.590902 (+128460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.591089 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.552490 16563 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:44.591416 16530 leader_election.cc:403] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.683193 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.599397 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.599083 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:44.684528 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 67874.1us
I20260709 13:06:44.684752 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.684336 16389 catalog_manager.cc:5697] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.686097 16561 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:44.686333 16634 raft_consensus.cc:2410] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:44.688436 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.688901 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:44.689339 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 158410us
I20260709 13:06:44.689954 16638 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.689343 16561 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:44.692476 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.693910 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1215) took 3159 ms. Trace:
I20260709 13:06:44.694216 16561 rpcz_store.cc:276] 0709 13:06:41.534117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.693224 (+3159107us) service_pool.cc:224] Handling call
0709 13:06:44.693474 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.693625 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.693650 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.693688 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:44.693716 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.693773 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.693863 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.686522 16389 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.697001 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:44.709803 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1220) took 2807 ms. Trace:
I20260709 13:06:44.689616 16632 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:44.688405 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.710333 16561 rpcz_store.cc:276] 0709 13:06:41.902867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.709116 (+2806249us) service_pool.cc:224] Handling call
0709 13:06:44.709374 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.709524 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.709547 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.709584 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:44.709612 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.709658 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.709752 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.697649 16389 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.712296 16561 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:44.712821 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 156582us
I20260709 13:06:44.708602 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:44.711082 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.714030 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.714535 16638 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.714362 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:44.716126 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.715811 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.715843 16637 raft_consensus.cc:2368] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:44.703519 17187 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:44.716784 16565 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
W20260709 13:06:44.595943 16512 debug-util.cc:398] Leaking SignalData structure 0x7b0800385380 after lost signal to thread 16665
I20260709 13:06:44.719686 16638 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:44.717453 16562 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:44.718271 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.488751 17989 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.720162 16455 leader_election.cc:400] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
W20260709 13:06:44.716943 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 191427us
W20260709 13:06:44.595054 17184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 304) took 2802 ms (client timeout 1760 ms). Trace:
I20260709 13:06:44.677671 17984 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:44.713008 16389 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.721019 16632 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:44.722962 16455 leader_election.cc:403] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.598966 17691 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.726604 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.725510 16389 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.696887 17905 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.596580 17987 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:44.728554 17152 connection.cc:256] RPC call timeout handler was delayed by -1.5181385209999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 13:06:44.728523 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.727209 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:44.724292 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.743741 16638 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.709405 17986 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.731346 16485 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.710520 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.743675 16637 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:44.729781 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:44.760124 16632 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.732355 16389 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.697837 17982 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:44.711350 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 70) took 3364 ms. Trace:
I20260709 13:06:44.728503 16455 leader_election.cc:400] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
W20260709 13:06:44.744167 17152 connection.cc:256] RPC call timeout handler was delayed by -1.3519131399999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3163s for a response
I20260709 13:06:44.731863 17978 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.721791 17751 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.719529 17981 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.757668 16638 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.590863 17983 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:44.747536 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:44.722169 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:44.718843 17977 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.732291 17691 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.595450 16558 rpcz_store.cc:276] 0709 13:06:41.107056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.461333 (+3354277us) service_pool.cc:224] Handling call
0709 13:06:44.461650 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.538430 (+ 76780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.538614 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.724347 17184 rpcz_store.cc:269] 0709 13:06:41.788245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.791857 (+  3612us) service_pool.cc:224] Handling call
0709 13:06:44.590502 (+2798645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.756371 16564 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:44.766892 16455 leader_election.cc:403] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:44.685281 16560 rpcz_store.cc:269] 0709 13:06:41.903320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.357835 (+2454515us) service_pool.cc:224] Handling call
0709 13:06:44.552738 (+194903us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b540002bf54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:44.552847 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125647232}
I20260709 13:06:44.777096 17982 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.732602 17984 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:44.834858 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:44.766511 17152 connection.cc:256] RPC call timeout handler was delayed by -1.2349360560000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26280000000000003s for a response
I20260709 13:06:44.841984 16638 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:44.836813 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 89334.1us
I20260709 13:06:44.837548 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:44.842307 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 113913us
I20260709 13:06:44.759297 17980 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:06:44.759058 17987 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:44.838759 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 295197us
W20260709 13:06:44.830859 16512 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef340 after lost signal to thread 17212
W20260709 13:06:44.840209 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 294961us
I20260709 13:06:44.825672 17751 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:44.843146 16455 leader_election.cc:400] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:44.843302 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:44.842823 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.850620 16638 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.844225 16631 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:44.766192 16559 rpcz_store.cc:276] 0709 13:06:41.346562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.462732 (+3116170us) service_pool.cc:224] Handling call
0709 13:06:44.463017 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.596058 (+133041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.709222 (+113164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.839749 17938 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:44.845201 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:44.836592 17691 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.848366 16637 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.863704 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:44.849990 16455 leader_election.cc:403] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:44.851308 16512 debug-util.cc:398] Leaking SignalData structure 0x7b0800337280 after lost signal to thread 17213
I20260709 13:06:44.853427 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:44.853626 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.836442 16483 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:44.844535 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.899935 16489 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.841867 17981 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.841013 17989 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.885938 16640 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:44.902189 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 48821.4us
I20260709 13:06:44.852258 16530 leader_election.cc:400] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:06:44.907805 16530 leader_election.cc:403] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.896168 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.908887 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.845366 17977 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.901224 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:44.902467 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 59448.9us
I20260709 13:06:44.903460 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.856231 17751 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:44.906266 17152 leader_election.cc:336] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.878s (SENT)
I20260709 13:06:44.863234 17912 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.910882 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.910126 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:44.932853 16638 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.865284 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.935639 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.934930 16635 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:44.932449 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 80311.9us
I20260709 13:06:44.902467 17854 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.947672 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:44.952522 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:44.954205 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.863317 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 71) took 3516 ms. Trace:
W20260709 13:06:44.946686 17152 leader_election.cc:336] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.912s (SENT)
I20260709 13:06:44.948037 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.904078 17981 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.939184 17938 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:06:44.955691 16561 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.945327 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:44.924865 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:44.962815 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:44.976804 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.977218 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.977798 16564 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.963527 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:44.964368 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.936892 17912 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.969419 16635 pending_rounds.cc:85] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 2
I20260709 13:06:44.980712 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:44.910961 17985 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:44.906400 17990 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:44.986761 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:44.937037 17979 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.937848 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:44.977321 16561 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:44.952142 18004 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.124s	user 0.000s	sys 0.003s
I20260709 13:06:44.981294 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.982184 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:44.983994 16483 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:44.970947 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:44.984170 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:44.984522 17971 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.985317 17985 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:44.987499 16490 raft_consensus.cc:2368] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:44.986148 17854 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:44.991689 16564 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:44.968631 17981 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:44.993391 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55685us
W20260709 13:06:45.019248 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 74022.7us
I20260709 13:06:44.995981 17987 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:44.986044 17998 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:06:44.958096 17183 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:45.000056 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.040549 16640 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:44.996155 16635 pending_rounds.cc:107] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:06:44.983618 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:44.983898 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:45.010462 18009 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:06:45.010346 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:44.961206 16557 rpcz_store.cc:276] 0709 13:06:41.346816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.485309 (+3138493us) service_pool.cc:224] Handling call
0709 13:06:44.485631 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.485818 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:44.715145 (+229327us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.836844 (+121699us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.839592 (+  2748us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.843400 (+  3808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.848152 (+  4752us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.860609 (+ 12457us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":278082,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":3754,"raft.run_wall_time_us":3966,"spinlock_wait_cycles":12672640,"thread_start_us":313446,"threads_started":2,"wal-append.queue_time_us":123618}
I20260709 13:06:44.981694 17912 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:45.058373 18005 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:45.060163 17985 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.017082 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.068318 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.068957 16637 raft_consensus.cc:2368] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.020920 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.022153 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:44.994241 17153 leader_election.cc:336] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.091s (SENT)
I20260709 13:06:45.069410 16564 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:45.069762 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 75799.8us
W20260709 13:06:45.070611 17153 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.319s (SENT)
W20260709 13:06:45.069607 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 47531.6us
I20260709 13:06:44.992605 17979 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.063401 16558 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:45.041718 16635 raft_consensus.cc:2889] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.041967 16563 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.014742 17980 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.016459 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:45.041244 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.059243 16633 raft_consensus.cc:2368] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.021450 17971 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:45.015961 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 72) took 3651 ms. Trace:
I20260709 13:06:45.026643 16561 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.037297 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.036268 17986 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:45.090313 16564 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.091248 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.091823 16563 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.094610 17976 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.095194 17976 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.095578 17976 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.097026 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.098096 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.098680 16638 raft_consensus.cc:2368] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.064857 17179 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 LEARNER]: Advancing to term 2
I20260709 13:06:45.089421 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.103941 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 796) took 4009 ms. Trace:
I20260709 13:06:45.091257 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.105370 16564 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.104460 16486 rpcz_store.cc:276] 0709 13:06:41.094891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.525307 (+3430416us) service_pool.cc:224] Handling call
0709 13:06:44.525562 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.525907 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.525933 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.526338 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.711368 (+185030us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:44.711403 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.711462 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.103722 (+392260us) raft_consensus.cc:1685] finished
0709 13:06:45.103741 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.103881 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2081,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":184713,"threads_started":1,"wal-append.queue_time_us":205268}
I20260709 13:06:45.106540 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.108861 17182 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:45.111581 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.111819 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.112977 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.113517 16557 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.113763 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.114926 17989 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.115399 17989 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:45.116456 16484 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.006s
I20260709 13:06:45.116778 16484 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.117324 17989 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.117596 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.118678 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.119488 17881 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.076824 17979 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.120332 16485 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.123401 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.076508 17983 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.124074 16485 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:45.129290 16530 connection.cc:256] RPC call timeout handler was delayed by -2.3133976530000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 13:06:45.129670 16530 connection.cc:256] RPC call timeout handler was delayed by -2.2915643080000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:06:45.130057 16530 connection.cc:256] RPC call timeout handler was delayed by -1.9189005949999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:06:45.130342 16530 connection.cc:256] RPC call timeout handler was delayed by -1.9074976529999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2524s for a response
W20260709 13:06:45.130614 16530 connection.cc:256] RPC call timeout handler was delayed by -1.9000005950000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:06:45.090044 17980 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.090166 16566 rpcz_store.cc:276] 0709 13:06:41.364404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.491124 (+3126720us) service_pool.cc:224] Handling call
0709 13:06:44.491404 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.491718 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.491746 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.492192 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.720937 (+228745us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.003776 (+282839us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.015673 (+ 11897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.015740 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.015777 (+    37us) raft_consensus.cc:1685] finished
0709 13:06:45.015805 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.015914 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1731,"prepare.queue_time_us":43161,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":12614,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":11044,"thread_start_us":502417,"threads_started":2,"wal-append.queue_time_us":444552}
I20260709 13:06:45.134003 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:45.133076 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 196987us
I20260709 13:06:45.136479 16561 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.137986 16563 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:45.130880 16530 connection.cc:256] RPC call timeout handler was delayed by -1.8595643080000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:06:45.094667 17986 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:06:45.138789 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.079934 17987 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:45.155158 16529 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:45.156165 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.155658 16563 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.143428 16564 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.114868 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.144568 16455 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:45.160408 16455 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:45.156941 16530 connection.cc:256] RPC call timeout handler was delayed by -1.8235643079999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:06:45.161347 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:45.161695 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.112205 16488 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:45.124457 17975 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.140028 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.128671 17989 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.119990 17881 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.161408 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.168179 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.139293 17980 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.131261 17990 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.162415 17972 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.169945 16566 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:45.161408 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.128113 17984 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:45.157159 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:45.171196 16530 connection.cc:256] RPC call timeout handler was delayed by -1.7102518579999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:06:45.211439 16530 connection.cc:256] RPC call timeout handler was delayed by -1.7101643080000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 13:06:45.211810 16530 connection.cc:256] RPC call timeout handler was delayed by -1.66960059500002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:06:45.212088 16530 connection.cc:256] RPC call timeout handler was delayed by -1.5472005950000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 13:06:45.212492 16530 connection.cc:256] RPC call timeout handler was delayed by -1.5337005950000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 13:06:45.212765 16530 connection.cc:256] RPC call timeout handler was delayed by -1.3843005950000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 13:06:45.213869 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.215018 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.171883 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.160503 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.174865 16563 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.176565 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.190219 16562 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.217289 16490 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:45.216041 16564 raft_consensus.cc:2376] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3. Re-sending same reply.
I20260709 13:06:45.169639 17982 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:45.176983 17182 raft_consensus.cc:2376] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3. Re-sending same reply.
I20260709 13:06:45.219870 17938 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.226042 17938 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.238286 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.237166 16558 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:45.208109 17972 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.224833 17984 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.236387 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:45.257774 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 291537us
I20260709 13:06:45.258744 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.156899 17854 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:45.183008 17989 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.243171 17982 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.271171 16489 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:45.272853 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 104747us
I20260709 13:06:45.275965 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:45.239185 18012 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.209156 17990 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.283541 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.284204 16489 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.281437 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.253252 17972 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:45.289371 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 216872us
I20260709 13:06:45.267812 17179 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:45.302675 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 87730.8us
I20260709 13:06:45.292244 16489 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:45.183543 17971 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.270180 17984 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:45.312214 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.316751 16638 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:45.314677 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.315606 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.282996 17905 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:45.312282 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.311937 17982 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:45.267985 17978 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.313265 18012 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.276449 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.342154 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.341010 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.344806 16483 raft_consensus.cc:2368] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.345714 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.346278 16483 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:45.343663 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.348453 16637 raft_consensus.cc:2368] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:45.348861 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.331914 16490 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:45.290714 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 149567us
I20260709 13:06:45.290342 17983 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.293926 17977 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.333748 16489 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.317162 16455 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.339578 17912 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.339463 17981 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.341073 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.341284 17990 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:45.335065 17938 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:45.342152 18013 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:45.347271 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.349241 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.343585 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.346369 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.370419 16486 raft_consensus.cc:2368] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.371307 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.371979 16486 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:45.374650 16491 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.377363 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:45.346174 17881 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.380937 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.383078 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.384006 16490 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:45.316810 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.282413 16562 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.384970 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.386982 16638 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:45.381515 16634 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:45.347472 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.356262 16563 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:45.352430 17983 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:45.349471 16559 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.344376 16484 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:45.349328 17972 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.342504 17989 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.348333 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.351322 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.389010 16489 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:45.426916 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.390341 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.354564 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.430795 16635 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:45.431427 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 76928.8us
I20260709 13:06:45.335484 17905 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:45.432161 16455 leader_election.cc:400] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.432462 16455 leader_election.cc:403] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.391415 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:45.391081 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 122388us
I20260709 13:06:45.435089 16561 raft_consensus.cc:2368] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.343469 17979 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.361469 17799 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:45.437577 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1254) took 1063 ms. Trace:
I20260709 13:06:45.368042 18012 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:45.363045 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.419616 16562 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:45.420419 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.417527 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.441859 16638 raft_consensus.cc:2368] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.356986 17982 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.423306 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:45.423571 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 89303.4us
I20260709 13:06:45.389667 17717 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.389918 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:45.435786 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:45.393923 17983 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.412791 16631 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.427477 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1248) took 1049 ms. Trace:
I20260709 13:06:45.365976 17691 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.334072 17987 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:45.437970 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.438243 16489 rpcz_store.cc:276] 0709 13:06:44.373759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.436432 (+1062673us) service_pool.cc:224] Handling call
0709 13:06:45.437122 (+   690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.437278 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.437305 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.437343 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.437371 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.437437 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.437530 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897664}
I20260709 13:06:45.452193 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.453214 16562 raft_consensus.cc:2376] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3. Re-sending same reply.
I20260709 13:06:45.453495 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.430824 16490 raft_consensus.cc:2368] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.361550 17976 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.444031 16486 raft_consensus.cc:606] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:45.444505 16530 leader_election.cc:400] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.444509 16635 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:45.456317 16632 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:45.438220 17799 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:45.439705 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.457944 16530 leader_election.cc:403] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.457901 16486 raft_consensus.cc:614] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:45.455525 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1255) took 1081 ms. Trace:
I20260709 13:06:45.459583 16490 rpcz_store.cc:276] 0709 13:06:44.373994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.454814 (+1080820us) service_pool.cc:224] Handling call
0709 13:06:45.455092 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.455240 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.455279 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.455316 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.455345 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.455392 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.455478 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.444252 17978 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.461166 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1256) took 1086 ms. Trace:
I20260709 13:06:45.464195 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.449967 17900 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.465457 16639 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:45.465600 17900 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.468134 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.468711 16560 raft_consensus.cc:2376] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3. Re-sending same reply.
W20260709 13:06:45.469655 17751 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 13:06:45.470038 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.470805 17972 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:45.471074 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.471710 16561 raft_consensus.cc:2368] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.473384 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.474089 16559 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:45.476331 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.476893 16489 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:45.465008 16490 rpcz_store.cc:276] 0709 13:06:44.374239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.460474 (+1086235us) service_pool.cc:224] Handling call
0709 13:06:45.460721 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.460888 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.460913 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.460950 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.460978 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.461027 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.461119 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.478338 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.443928 18027 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.454744 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.482121 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.485146 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.485463 16530 leader_election.cc:400] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.486194 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:45.469565 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.494694 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.495210 16530 leader_election.cc:400] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.497083 16530 leader_election.cc:403] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.497118 16563 raft_consensus.cc:2376] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3. Re-sending same reply.
I20260709 13:06:45.463522 18025 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.502089 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:45.504720 17900 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:45.501945 18008 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.636s	user 0.007s	sys 0.000s
I20260709 13:06:45.505625 16483 raft_consensus.cc:2368] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.479226 17912 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.436460 17984 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.506520 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:45.508440 17881 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.508186 17799 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.508893 17881 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.509318 17799 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.510842 17881 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:45.511168 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:45.511721 17181 raft_consensus.cc:2376] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3. Re-sending same reply.
I20260709 13:06:45.504736 17179 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:45.470046 17751 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.513650 17978 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.474746 18037 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.515090 17751 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:45.515995 16636 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.450652 16482 rpcz_store.cc:276] 0709 13:06:44.372188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.530367 (+158179us) service_pool.cc:224] Handling call
0709 13:06:44.530659 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.530860 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:44.711439 (+180579us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.370678 (+659239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.387236 (+ 16558us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:45.389451 (+  2215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.413789 (+ 24338us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.421789 (+  8000us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233474,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":61445,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4154,"thread_start_us":694451,"threads_started":3,"wal-append.queue_time_us":555506}
I20260709 13:06:45.511637 16530 leader_election.cc:400] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.524034 16530 leader_election.cc:403] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.525295 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:45.518783 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 83065.4us
I20260709 13:06:45.520180 16490 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:45.514991 18037 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.526104 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:45.526535 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.525655 16485 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:45.527750 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1262) took 1152 ms. Trace:
I20260709 13:06:45.527944 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.529628 16485 rpcz_store.cc:276] 0709 13:06:44.375658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.487503 (+1111845us) service_pool.cc:224] Handling call
0709 13:06:45.525512 (+ 38009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.527529 (+  2017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.527700 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.531872 16490 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.540925 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:45.542939 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.508056 18034 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.496861 17989 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.546428 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:45.548352 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.550884 17185 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.501789 17717 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:45.557868 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:45.558660 16485 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:45.559494 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:45.558598 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 164585us
I20260709 13:06:45.516211 18025 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.562685 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.542985 17987 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.539614 16631 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:45.556205 18037 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.569818 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.571604 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.550539 16557 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:45.556373 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:45.555222 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.565055 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.561575 18025 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.574574 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.585675 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.563597 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.564917 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:45.557713 18034 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:45.585208 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1261) took 1209 ms. Trace:
I20260709 13:06:45.575986 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.585673 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.568784 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:45.587316 16454 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.645532 16634 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:45.590044 17188 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:45.645903 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 58647.6us
I20260709 13:06:45.567955 17982 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.576498 17976 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.649739 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:45.575273 18037 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.598240 16486 rpcz_store.cc:276] 0709 13:06:44.375421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.464341 (+1088920us) service_pool.cc:224] Handling call
0709 13:06:45.464577 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.464742 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:45.483391 (+ 18649us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.584983 (+101592us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.585024 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:45.585049 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.585088 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.585171 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29504,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":269,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":66,"thread_start_us":101290,"threads_started":1}
I20260709 13:06:45.577813 18028 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.592140 17978 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.656440 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.648635 17971 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.651176 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:45.654704 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 65378.8us
I20260709 13:06:45.658951 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.659449 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:45.659670 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 90953.5us
I20260709 13:06:45.639034 16559 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:45.685993 16634 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:45.660812 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.686318 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:45.650612 18030 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:45.652650 18029 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.085s	user 0.000s	sys 0.012s
I20260709 13:06:45.688985 17971 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.654438 17717 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.654012 18037 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.713501 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.719344 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:45.648167 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 72247.2us
I20260709 13:06:45.592211 16560 raft_consensus.cc:2376] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3. Re-sending same reply.
W20260709 13:06:45.687577 18032 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:06:45.686725 17694 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.686515 17180 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:45.658481 17979 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:45.697296 18043 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:06:45.721293 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:45.712814 18038 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:06:45.691974 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.848161 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:45.689695 17691 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:45.692309 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:45.867161 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 222011us
I20260709 13:06:45.774461 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.745880 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.839058 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.689365 17972 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.697288 17971 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.719703 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.687330 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:45.720748 17990 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.868901 16489 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:45.907159 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:45.871819 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 125988us
I20260709 13:06:45.741544 17694 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:45.908049 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.883303 18037 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.874243 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1252) took 1501 ms. Trace:
I20260709 13:06:45.877274 17185 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:45.885123 17881 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.918984 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:45.920023 17881 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:45.920440 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.747459 18034 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.691560 18040 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.187s
I20260709 13:06:45.886952 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:45.893567 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 206283us
I20260709 13:06:45.835153 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.774606 17978 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.725762 18041 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.724527 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:45.921186 16557 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:45.873147 17152 leader_election.cc:400] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
W20260709 13:06:45.870991 18045 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:06:45.873598 16487 consensus_meta.cc:287] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.011s
I20260709 13:06:45.869695 17938 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.692488 17980 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.916441 17979 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.917102 16484 rpcz_store.cc:276] 0709 13:06:44.373265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.437807 (+1064542us) service_pool.cc:224] Handling call
0709 13:06:45.773770 (+335963us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:06:45.836495 (+ 62725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.873898 (+ 37403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.873933 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.873986 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.874016 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.874079 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.874192 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12335488}
I20260709 13:06:45.918982 18037 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.946280 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.946919 16566 raft_consensus.cc:2376] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3. Re-sending same reply.
I20260709 13:06:45.947743 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.919234 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.948742 16489 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:45.921128 16562 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:45.874197 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:45.922434 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:45.920873 17881 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:45.923202 16560 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:45.964020 18047 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:06:45.888082 17982 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.966358 17982 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.966747 17982 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.967950 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.969012 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.887491 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1263) took 1511 ms. Trace:
I20260709 13:06:45.911114 18044 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.969982 17980 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:45.970863 16482 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.909195 16456 leader_election.cc:400] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.971561 16456 leader_election.cc:403] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.972437 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.973515 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.974227 16482 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:45.974900 16482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:45.975450 16482 raft_consensus.cc:606] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:45.930415 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.975981 16482 raft_consensus.cc:614] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:45.976161 16485 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
W20260709 13:06:45.933120 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 211874us
I20260709 13:06:45.977141 16482 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:45.910090 17694 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.978274 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.974859 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.979359 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.979717 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.980261 16562 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.980435 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.981133 16557 raft_consensus.cc:2368] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:45.981845 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.935192 17152 leader_election.cc:403] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.982810 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.927114 17691 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:45.983325 17691 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:45.938506 18041 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:45.983845 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.926676 17978 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:45.984438 16557 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:45.984583 18041 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:45.985252 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76169.6us
I20260709 13:06:45.985581 16557 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:45.985857 17979 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
W20260709 13:06:45.987260 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 64891.8us
I20260709 13:06:45.943526 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:45.955040 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:45.969465 16488 rpcz_store.cc:276] 0709 13:06:44.376798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.504033 (+1127235us) service_pool.cc:224] Handling call
0709 13:06:45.553918 (+ 49885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.566031 (+ 12113us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:45.637993 (+ 71962us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.835535 (+197542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.847985 (+ 12450us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:45.865493 (+ 17508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.870645 (+  5152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.887438 (+ 16793us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":278,"prepare.queue_time_us":16754,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":33710,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":25854,"thread_start_us":67451,"threads_started":1,"wal-append.queue_time_us":68550}
I20260709 13:06:45.959301 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:45.983050 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 110023us
I20260709 13:06:45.950344 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:45.969468 16561 raft_consensus.cc:2376] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3. Re-sending same reply.
W20260709 13:06:45.956691 18046 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:06:45.991753 16560 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:45.998404 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:45.994639 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:45.994910 16530 leader_election.cc:400] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:45.995779 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.012722 16560 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:45.946201 17800 consensus_meta.cc:287] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.262s	user 0.011s	sys 0.000s
I20260709 13:06:45.986601 17978 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.007515 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:45.996995 18028 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:46.008736 16558 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:46.005827 16559 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.005921 18044 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.012807 16530 leader_election.cc:403] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.014813 16456 leader_election.cc:400] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:46.047622 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.048568 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.004040 16562 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:45.940373 16487 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:46.021163 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.002516 17965 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.002406 18039 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:46.023240 17691 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.002213 17979 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:46.029850 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:46.031965 18028 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.019194 17800 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:45.974174 17982 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.023504 17694 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.035298 17905 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:46.037494 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1269) took 1488 ms. Trace:
I20260709 13:06:46.023955 17986 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.039116 17981 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.040251 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:46.051576 17985 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.041740 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:46.042392 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1271) took 1490 ms. Trace:
I20260709 13:06:46.052899 18053 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:46.044036 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:46.065678 17187 raft_consensus.cc:2368] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:06:46.066229 16563 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:46.043934 17983 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.003s
I20260709 13:06:46.048686 17976 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:46.049885 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 55092us
I20260709 13:06:46.050570 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.049327 16557 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.026643 16484 raft_consensus.cc:2393] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:46.022617 17854 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.019831 17980 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.012072 18037 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:06:46.046612 17972 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.057103 17184 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:46.025487 18042 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.047056 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:46.041136 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1490) took 1474 ms. Trace:
I20260709 13:06:46.051895 17965 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.054430 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:46.063556 16491 rpcz_store.cc:276] 0709 13:06:44.549154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.980429 (+431275us) service_pool.cc:224] Handling call
0709 13:06:46.039617 (+1059188us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54002e36d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:46.039728 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834657152}
I20260709 13:06:46.022950 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.069764 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:46.080302 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 57417.9us
I20260709 13:06:46.080842 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.081215 16605 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.082003 16530 leader_election.cc:400] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:46.082404 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:46.083540 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.062541 17691 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.074198 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.074815 16639 rpcz_store.cc:276] 0709 13:06:44.567204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.567330 (+   126us) service_pool.cc:224] Handling call
0709 13:06:46.040932 (+1473602us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b540015d454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:46.041057 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790321408}
I20260709 13:06:46.059298 17984 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.088222 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.083424 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.084466 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.077235 17181 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.089980 16530 leader_election.cc:400] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:46.090196 16530 leader_election.cc:403] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.087497 17740 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.070191 18025 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.092355 16530 leader_election.cc:400] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:46.094390 16530 leader_election.cc:403] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.067699 17975 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:46.091197 18034 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:46.103482 18034 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:46.104338 18034 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.096257 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.095870 17881 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:46.107702 17881 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.091073 17775 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.108008 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:46.108505 17775 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.108863 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:46.109290 17775 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.110121 17989 raft_consensus.cc:2764] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:46.110682 17989 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.088361 18058 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.098182 17740 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.088728 18053 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.087525 18033 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.076282 17981 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:46.099488 18048 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.225s	user 0.003s	sys 0.000s
I20260709 13:06:46.091609 17793 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.119314 17793 raft_consensus.cc:697] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.120189 17793 consensus_queue.cc:237] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.092330 17980 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.095646 17984 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.071230 17983 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.101055 17971 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.149214 17971 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.073853 17985 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.149857 17985 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.151643 17985 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.102857 17694 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:46.153475 18050 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 13:06:46.155423 16454 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.109869 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.059497 16483 rpcz_store.cc:276] 0709 13:06:44.548714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.507416 (+958702us) service_pool.cc:224] Handling call
0709 13:06:45.861433 (+354017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.872397 (+ 10964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.887613 (+ 15216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.906974 (+ 19361us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:45.911555 (+  4581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.921495 (+  9940us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.037314 (+115819us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54000e8650. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:46.037433 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783660288}
I20260709 13:06:46.074256 18042 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.075346 17854 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.077597 17965 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.097661 18037 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:46.112962 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:46.187870 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 74963.4us
I20260709 13:06:46.088804 17781 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:46.118023 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69507.9us
I20260709 13:06:46.190786 16456 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.073549 17972 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.097599 18025 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.099675 17982 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.137648 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 70) took 1417 ms. Trace:
I20260709 13:06:46.138362 17740 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.138784 18028 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:46.143783 17978 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.114200 18058 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.144770 18033 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:46.314471 18062 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:46.145659 17983 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:46.315207 18033 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.146212 16559 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:46.146700 17181 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:46.147131 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.072676 18044 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.154392 18039 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:46.156956 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47150.7us
I20260709 13:06:46.175077 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:46.182080 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.162768 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:46.319446 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:06:46.321569 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 158850us
I20260709 13:06:46.195362 16486 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.322324 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.199766 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:46.323479 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 123791us
I20260709 13:06:46.232463 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.258028 16485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a22c30518dd74380871bcf169099e049"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:46.324510 16485 raft_consensus.cc:606] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.260119 17986 raft_consensus.cc:1064] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:46.326195 18037 consensus_queue.cc:1059] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:46.326982 18037 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.237524 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.236554 17984 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.164379 17985 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.201436 17793 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.237447 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:46.164501 18042 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.251142 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.199313 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.158311 17990 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.275099 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:46.276494 18023 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.860s	user 0.005s	sys 0.003s
I20260709 13:06:46.277033 17972 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.277267 17965 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.278342 17184 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:46.279125 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.280191 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:46.281502 17938 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:46.284426 17182 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:46.256204 18060 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:06:46.255501 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:46.417167 16632 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:46.268508 17854 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.288050 17187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 304) took 1334 ms. Trace:
I20260709 13:06:46.338654 17793 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.300459 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:46.252950 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:46.302103 16636 rpcz_store.cc:276] 0709 13:06:44.720658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.720765 (+   107us) service_pool.cc:224] Handling call
0709 13:06:44.720996 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.516365 (+795369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.137425 (+621060us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000fd2d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:46.137588 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827878272}
I20260709 13:06:46.324927 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:46.327567 16637 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.332422 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.333132 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:46.333601 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 132249us
W20260709 13:06:46.421897 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 97031.1us
I20260709 13:06:46.335047 16454 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:46.314472 18058 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:46.382426 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 98900.8us
W20260709 13:06:46.422873 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 90524.3us
W20260709 13:06:46.423276 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 90224.9us
I20260709 13:06:46.327399 18039 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.423535 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:46.423758 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 88783.3us
I20260709 13:06:46.425163 16489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:46.425267 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.425688 16489 raft_consensus.cc:606] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:46.426080 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:46.426579 17972 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.426968 17972 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.427286 17972 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.429291 18071 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.429765 18071 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.430663 18071 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.422063 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.433012 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.433431 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:46.434175 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.418191 17938 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.338003 17799 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.337991 17984 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:46.340975 17979 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.418290 16639 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:46.419165 17187 rpcz_store.cc:276] 0709 13:06:44.952000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.952320 (+   320us) service_pool.cc:224] Handling call
0709 13:06:46.286382 (+1334062us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54005ff0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:46.286496 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558436736}
I20260709 13:06:46.235607 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.414562 16482 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:46.447270 17972 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.341737 16638 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:46.435197 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.449163 16456 leader_election.cc:400] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:46.449457 17972 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:46.450402 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.450239 17793 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.334287 18034 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:46.441179 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.441915 17751 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:46.442094 18040 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.441951 17982 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.439316 17985 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.444806 17799 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.431936 18044 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.469126 16530 leader_election.cc:400] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:46.434139 18039 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.433856 17694 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.469931 17751 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:46.472826 17982 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.472546 17984 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.473140 17972 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.473538 17985 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:46.435705 17980 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.443446 18028 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:46.479103 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 43989.3us
I20260709 13:06:46.479948 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.440374 17983 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:06:46.474395 16487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1270) took 1921 ms (client timeout 2159 ms). Trace:
I20260709 13:06:46.468153 18034 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:46.439519 18037 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:46.479143 17751 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.470134 17981 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.477553 18039 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.485028 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.477106 17965 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:46.491657 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.493327 17182 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:46.493827 16483 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.510977 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.486578 17971 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.503676 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:46.502699 17978 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.566131 17800 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:46.563680 17990 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:06:46.556097 17985 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.513145 18028 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:46.488281 16487 rpcz_store.cc:269] 0709 13:06:44.548930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.114637 (+565707us) service_pool.cc:224] Handling call
0709 13:06:46.443826 (+1329189us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54004416d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:46.469959 (+ 26133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453744384}
W20260709 13:06:46.557739 18072 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:46.496019 17972 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:46.558483 18076 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:46.508973 18044 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:46.561434 16637 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:46.512732 17989 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:46.562192 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 126695us
I20260709 13:06:46.512275 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:46.580403 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76803.7us
I20260709 13:06:46.558485 17799 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.592585 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:06:46.598425 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 148063us
W20260709 13:06:46.598526 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 86347.2us
I20260709 13:06:46.599642 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.601369 17978 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.601823 17978 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:46.589640 18041 raft_consensus.cc:2764] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:46.605075 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.591207 17955 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.585892 18042 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.613442 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:46.613833 17981 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:46.611904 17972 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:46.614923 17972 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.614812 17978 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.614463 18081 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:46.617034 17972 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:46.598297 17989 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.602126 18082 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.618144 18030 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.618974 17981 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.614430 16557 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:46.625200 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.614768 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:46.614979 18028 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.634723 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:46.634828 18028 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.635670 18080 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:46.636396 18082 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.636893 18028 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:46.637297 18082 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.629074 17981 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:46.639024 17981 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.640125 17981 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.615202 18042 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:46.631004 16565 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:46.632359 16562 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.633383 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:46.633775 17982 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.634099 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:46.630987 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:46.651074 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.654405 16560 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:46.619834 18030 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:46.655283 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.655869 18049 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.656564 18049 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.656875 17986 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.657714 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:46.643456 17799 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.592317 18034 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:46.660599 17799 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.660945 17694 consensus_queue.cc:1059] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:46.661273 18034 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.661947 17781 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.662279 17781 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.662472 17799 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.640143 17881 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.663053 17781 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.655462 16558 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:46.656587 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:46.674685 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.675386 17799 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.663170 17881 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:46.655995 17982 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:46.688068 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:46.656912 18049 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.685027 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.654139 18044 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:46.654353 17965 consensus_queue.cc:1059] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:46.653421 17751 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.675601 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:46.691975 17781 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.692355 18049 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.706112 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:46.693835 17981 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.709571 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.689039 17799 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:06:46.710486 16636 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.710711 16565 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:46.709172 16637 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.688009 17978 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:46.710964 16640 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.709246 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.714143 16639 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:46.712363 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:46.713788 16640 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.695607 17976 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:06:46.724367 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.724891 16634 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.720983 17955 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:46.723011 17983 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.716823 16558 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:46.737993 16636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35418
I20260709 13:06:46.740072 16636 raft_consensus.cc:606] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:06:46.740437 16636 raft_consensus.cc:614] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:46.748970 16565 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:46.738305 18084 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:46.736478 17955 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.736884 16640 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.732080 17971 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.732795 18042 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.724303 17881 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.759358 17881 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:46.760607 18085 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:46.764323 16640 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.769227 18058 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.771003 16565 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:46.771312 18058 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.772495 17971 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.774422 17971 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.774806 18042 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.776661 18042 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:46.778288 18090 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:46.780367 17938 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.782291 17938 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.785378 18039 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.786520 16640 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:46.787420 18039 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.749100 16631 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.711539 18030 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.738095 17983 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.818856 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:46.820640 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:46.822108 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.822666 16490 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.829254 16490 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:46.831957 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:46.833650 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 128437us
I20260709 13:06:46.836262 18101 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.836387 17775 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:06:46.835074 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 141663us
I20260709 13:06:46.738595 17982 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:46.797802 16557 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.799022 18042 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.840731 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.839524 16604 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:46.843916 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.844966 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:46.832307 17985 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.846465 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:46.849113 17188 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:46.850026 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:46.850402 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:46.851629 16486 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.854609 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.857333 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.857631 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:46.836886 18101 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.876427 18098 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.876998 16485 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:46.876904 18098 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:46.836931 17775 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:46.877841 18071 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.879199 17775 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:46.880388 18092 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:46.880666 18096 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:46.882035 16638 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:46.843809 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.887244 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.888051 16640 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:46.888128 16485 raft_consensus.cc:2410] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.888655 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:46.889931 16639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:41648
W20260709 13:06:46.890961 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.871760 17986 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:06:46.891637 18075 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.465s	user 0.006s	sys 0.003s
I20260709 13:06:46.888145 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:46.892743 16631 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.870405 18080 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.843003 18044 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:46.870572 17985 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:46.874446 17976 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.896752 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:46.953836 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:46.898142 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:46.881494 18096 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.877556 18101 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:46.883394 18098 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:46.876098 18031 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.885376 18039 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:46.963195 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 63344.1us
I20260709 13:06:46.870149 18042 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:46.954330 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 60335.1us
I20260709 13:06:46.890446 16558 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:46.964823 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:06:46.955528 18091 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:06:46.955475 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 58791.9us
I20260709 13:06:46.963953 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:46.968410 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:46.896056 16487 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.887094 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:46.974073 16639 raft_consensus.cc:606] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:46.899250 17905 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:06:46.894484 17986 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:47.046141 16634 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:47.133128 16565 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.163344 16639 raft_consensus.cc:614] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:47.076365 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:47.041458 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 76710.4us
I20260709 13:06:47.085291 16560 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.956158 16482 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:47.048328 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 82602.2us
I20260709 13:06:47.167104 16563 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:46.954068 17181 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEARNER]: Advancing to term 3
I20260709 13:06:47.168627 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:47.179036 16565 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:47.035851 18072 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:46.969471 17983 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.047288 16559 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:06:47.049453 18109 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:06:47.093102 17979 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.002s
I20260709 13:06:47.196131 17983 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.182899 16563 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:47.053282 18033 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:06:47.053731 17854 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.966724 18096 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:47.262063 17181 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:06:47.276597 17854 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:46.967381 18082 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.209s
I20260709 13:06:47.276986 17181 pending_rounds.cc:85] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 2
I20260709 13:06:47.048471 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:47.277453 17854 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.278178 16558 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.278843 17854 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.046720 18040 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.081436 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:47.176834 17985 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.068890 18108 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:47.190613 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.166196 17986 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:46.913570 17982 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.278s
I20260709 13:06:47.048520 18080 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:06:46.974210 18098 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.218s
I20260709 13:06:46.973999 18031 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:47.274863 17979 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.192052 18042 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.276090 16487 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
W20260709 13:06:47.177289 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 208955us
I20260709 13:06:47.177081 18030 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.182374 17981 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.029280 18104 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.282047 16560 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:06:47.248839 16482 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:47.283972 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 93442.2us
I20260709 13:06:47.032277 18049 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.240710 17976 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:47.283099 17983 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.332665 16558 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:47.491403 18030 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.297133 18115 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:47.493377 17975 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:47.493902 18115 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.494418 17975 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:47.495270 17975 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.495846 17985 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.490491 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 234) took 8526 ms. Trace:
I20260709 13:06:47.496212 17775 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:47.497534 17775 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:47.384332 18064 raft_consensus.cc:1027] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: attempt to promote peer 16b5b367990f4b5c862484bdec0b9226: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:06:47.495990 17981 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.475576 18097 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:47.499476 17717 raft_consensus.cc:3055] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:47.499867 17717 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:47.338781 18117 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.500644 17717 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.340346 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:47.501556 17717 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.502420 16484 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:47.503016 18120 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.503450 18120 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.462759 17694 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:06:47.504347 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 107) took 1021 ms. Trace:
I20260709 13:06:47.323163 17978 raft_consensus.cc:993] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:06:47.277431 17181 pending_rounds.cc:107] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:06:47.504957 17181 raft_consensus.cc:2889] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.505262 18120 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.334273 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.283322 16488 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:47.495234 18031 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:47.366879 16437 auto_rebalancer.cc:893] Removing replace marker failed: Replica f842280ae2ac4c68b0b7f6c093e27357 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:06:47.508924 16437 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:06:47.509052 17775 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.497124 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:47.510035 18096 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.504724 16489 rpcz_store.cc:276] 0709 13:06:46.483413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.483573 (+   160us) service_pool.cc:224] Handling call
0709 13:06:46.491592 (+  8019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.510542 (+ 18950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.510572 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.510608 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.510635 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.504161 (+993526us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5400258d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:47.504200 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.504296 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43197184}
I20260709 13:06:47.283560 18108 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.511320 18096 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.512044 16489 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.512768 18108 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:47.510727 16491 raft_consensus.cc:2410] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:47.514865 16491 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.496556 17975 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.510017 17775 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.493386 18030 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.499892 17981 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.491775 17983 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.511173 18115 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.520087 17978 raft_consensus.cc:1081] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:06:47.521040 17751 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:47.478847 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51670.3us
I20260709 13:06:47.381052 17990 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.186848 18105 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.186780 18110 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.535508 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:47.532984 16560 pending_rounds.cc:85] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 2
I20260709 13:06:47.332010 17854 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.527096 18125 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:47.300405 18122 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:47.208565 17955 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.497350 16389 rpcz_store.cc:276] 0709 13:06:38.964099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.964280 (+   181us) service_pool.cc:224] Handling call
0709 13:06:47.490407 (+8526127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:45.366227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:45.481200 (+114973us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:45.483934 (+  2734us) write_op.cc:435] Acquired schema lock
0709 13:06:45.495120 (+ 11186us) tablet.cc:662] Decoding operations
0709 13:06:45.746432 (+251312us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:45.746491 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:45.746517 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:45.940746 (+194229us) tablet.cc:701] Row locks acquired
0709 13:06:45.943146 (+  2400us) write_op.cc:260] PREPARE: finished
0709 13:06:45.985498 (+ 42352us) write_op.cc:270] Start()
0709 13:06:45.985609 (+   111us) write_op.cc:276] Timestamp: P: 1783602405985455 usec, L: 0
0709 13:06:45.985630 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:45.986229 (+   599us) log.cc:844] Serialized 4354 byte log entry
0709 13:06:46.338780 (+352551us) op_driver.cc:464] REPLICATION: finished
0709 13:06:46.602220 (+263440us) write_op.cc:301] APPLY: starting
0709 13:06:46.611574 (+  9354us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:46.616739 (+  5165us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:46.616840 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:46.618073 (+  1233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:46.618294 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:06:46.618341 (+    47us) write_op.cc:312] APPLY: finished
0709 13:06:46.618600 (+   259us) log.cc:844] Serialized 83 byte log entry
0709 13:06:46.618749 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.618874 (+   125us) write_op.cc:454] Released schema lock
0709 13:06:46.618920 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:46.624981 (+  6061us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.629653 (+  4672us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":727686,"reported_tablets":15,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":249030,"apply.run_cpu_time_us":2870,"apply.run_wall_time_us":22436,"num_ops":11,"prepare.queue_time_us":474932,"prepare.run_cpu_time_us":9482,"prepare.run_wall_time_us":724594,"raft.queue_time_us":224856,"raft.run_cpu_time_us":58502,"raft.run_wall_time_us":266276,"replication_time_us":345894,"spinlock_wait_cycles":1433856,"thread_start_us":720286,"threads_started":4,"wal-append.queue_time_us":104419}]]}
W20260709 13:06:47.414036 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.473629 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58851.9us
I20260709 13:06:47.538996 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.535956 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.500149 17986 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.503633 16484 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.669199 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:47.670142 16558 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.671597 16558 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:47.609431 16640 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.545120 17152 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:47.541271 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:47.660364 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:47.591877 16491 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.585168 16486 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:47.566958 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.544575 16636 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:47.674494 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 129442us
I20260709 13:06:47.674892 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:47.675240 16564 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.675539 16486 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:47.675657 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.664009 16560 pending_rounds.cc:107] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:06:47.592728 17694 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:06:47.665472 16559 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:47.665869 18124 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:47.632781 16386 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 2, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 2 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.404547 17800 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:47.672158 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 136703us
I20260709 13:06:47.380741 18034 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.411391 18088 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.707s	user 0.003s	sys 0.000s
I20260709 13:06:47.676807 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:47.511296 16437 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:06:47.679742 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:47.682991 16561 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.684674 16490 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.685371 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1529) took 1511 ms. Trace:
I20260709 13:06:47.667636 16557 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.540182 17180 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.540764 16483 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:06:47.659996 16638 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:47.610059 16633 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:47.628206 17985 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.541463 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:47.691557 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.690186 16386 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 2, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 2 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.649111 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:47.709206 18012 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:47.724890 17955 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:47.541810 18086 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.166s
W20260709 13:06:47.725375 18130 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:06:47.709297 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44802.8us
I20260709 13:06:47.709481 16637 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.709161 16563 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.726831 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.543641 18117 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:06:47.541848 18081 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.167s
I20260709 13:06:47.642323 18049 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.581691 17990 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.713341 16635 rpcz_store.cc:276] 0709 13:06:46.174070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.174841 (+   771us) service_pool.cc:224] Handling call
0709 13:06:47.685201 (+1510360us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54001fa4d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:47.685318 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889889664}
I20260709 13:06:47.714756 16490 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.541744 17188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a22c30518dd74380871bcf169099e049"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:06:47.688797 18116 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.716549 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.681377 17979 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.717047 16561 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.592912 17781 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:06:47.634930 18101 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:06:47.718385 17984 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:47.721277 16559 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:47.721781 18126 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:47.691172 17800 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:47.691953 17986 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.722276 18097 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:47.724560 17183 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:47.627689 18102 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:06:47.680209 18030 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:47.710698 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:47.766175 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 90587.8us
I20260709 13:06:47.729626 16456 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.730062 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.732028 17188 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:47.676965 16560 raft_consensus.cc:2889] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.766870 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.732513 16490 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.730633 16386 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 2, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 2 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.694638 16485 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:47.741916 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.769781 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.769783 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:47.743393 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:47.749003 18049 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.490512 17976 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.728200 17987 raft_consensus.cc:2764] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:47.774672 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:47.726933 17181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 331) took 1441 ms. Trace:
I20260709 13:06:47.775549 17181 rpcz_store.cc:276] 0709 13:06:46.285564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.333636 (+ 48072us) service_pool.cc:224] Handling call
0709 13:06:46.899890 (+566254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.505585 (+605695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.726729 (+221144us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54004cb150. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:47.726858 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122079104}
I20260709 13:06:47.776062 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.677809 17854 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.677691 18122 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.774776 18135 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:47.776221 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.774972 18012 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:47.777510 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.774663 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:47.777876 18135 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:47.778345 16633 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:47.778774 18135 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.780469 16633 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:47.780833 16633 pending_rounds.cc:85] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 1
I20260709 13:06:47.689029 17775 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:06:47.781283 16633 pending_rounds.cc:107] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:47.781077 16632 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:47.731564 18108 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.781607 16633 raft_consensus.cc:2889] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.781908 18108 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.782321 18108 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.782696 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.778017 18122 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.780663 17854 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:47.784693 16633 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:47.785024 16633 pending_rounds.cc:85] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 1
I20260709 13:06:47.785378 16633 pending_rounds.cc:107] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:47.785609 16633 raft_consensus.cc:2889] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.787125 16633 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:47.787423 16635 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:47.782752 16638 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:47.709641 18124 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.751094 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.734357 18114 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:47.717365 18034 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.788069 18030 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.735277 18116 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.799978 18116 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.800347 18034 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.800840 18034 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:47.790552 17978 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.806669 18096 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:47.807045 18096 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:47.808197 16565 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.810235 18030 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:47.812677 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:47.806617 17990 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:47.814706 18116 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.816699 18116 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:47.720932 16631 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.770473 16561 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.770619 17188 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.769608 16386 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 2, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 2 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.773205 16485 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.746851 17979 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.774318 17800 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.790151 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:47.750368 16566 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.791239 16484 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.753348 17984 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.792459 17981 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.793162 18012 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.842712 17188 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:47.792780 18108 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.795100 16483 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:47.797863 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:47.763762 18042 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:47.798651 18114 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:47.765240 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 73751.2us
I20260709 13:06:47.831827 16386 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 2, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 2 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.850663 16561 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:47.792830 18115 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:47.853255 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 857) took 1143 ms. Trace:
I20260709 13:06:47.853927 16638 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.824623 18096 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:47.939764 16490 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.926607 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:47.939747 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.939867 16632 rpcz_store.cc:276] 0709 13:06:46.709621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.710227 (+   606us) service_pool.cc:224] Handling call
0709 13:06:47.524137 (+813910us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:06:47.853067 (+328930us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003f1954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:47.853193 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286993664}
I20260709 13:06:47.940601 16640 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:47.942561 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 144787us
I20260709 13:06:47.943188 17188 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:47.870632 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:47.947405 16639 raft_consensus.cc:2368] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4.
I20260709 13:06:47.948081 17153 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:47.948726 17152 leader_election.cc:400] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4.
I20260709 13:06:47.957019 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1277) took 1099 ms. Trace:
I20260709 13:06:47.980712 17152 leader_election.cc:403] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:06:47.971220 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.981365 16485 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.980955 16560 rpcz_store.cc:276] 0709 13:06:46.856646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.168011 (+311365us) service_pool.cc:224] Handling call
0709 13:06:47.281224 (+113213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.767183 (+485959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.955622 (+188439us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540002d850. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:47.955744 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259783168}
I20260709 13:06:47.920778 17986 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.014207 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 333535us
I20260709 13:06:47.943758 18114 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.922358 18133 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.041424 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:47.941927 17981 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:47.944103 18116 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:47.944244 17990 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.922545 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1302) took 1030 ms. Trace:
W20260709 13:06:48.044864 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 97503.6us
I20260709 13:06:48.053113 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:48.047353 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 105569us
I20260709 13:06:48.050257 18133 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.054744 16455 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.056592 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.059190 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:48.059897 16560 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:48.059969 18102 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.060946 18133 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.061435 18133 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:48.064097 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:48.058754 16640 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:47.938688 18012 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.039958 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:48.020325 18034 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:06:47.938791 18115 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.053061 18135 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.058820 17751 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:48.071130 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:48.056726 18109 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:48.042073 17986 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.065227 18049 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.066143 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.077986 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:48.083483 16565 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:48.156944 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:48.157048 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:48.157608 16561 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:48.157764 16565 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:48.158479 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:48.158686 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:48.067865 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 85791.4us
I20260709 13:06:48.001277 18132 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
W20260709 13:06:48.193480 16529 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.4:44223 timed out after 1.520s (SENT) [suppressed 57 similar messages]
I20260709 13:06:48.198313 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:48.056099 18124 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:48.199527 16565 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:48.206964 16563 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.068069 17976 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.075578 18116 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:48.217969 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.202620 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 136547us
I20260709 13:06:48.074088 17990 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.271190 18124 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.271690 17990 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:48.205494 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:48.201943 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:48.205796 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 102529us
W20260709 13:06:48.211525 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.201150 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 130079us
I20260709 13:06:48.055862 18030 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:48.078765 16484 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.210583 17975 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.052719 18127 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 13:06:48.068794 18125 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:06:48.072641 17781 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.139s
W20260709 13:06:48.279848 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 77986us
I20260709 13:06:48.286686 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:48.282637 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.197746 17751 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:48.101789 18101 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.179s
I20260709 13:06:48.209949 17978 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.283608 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:06:48.291438 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 238389us
I20260709 13:06:48.217711 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:48.210315 17983 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:06:48.218386 17854 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 13:06:48.329757 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61740.8us
I20260709 13:06:48.337481 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.348665 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:48.272234 17990 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:48.284436 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.282841 17975 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.210052 17793 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:06:48.336200 18123 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.280836 16484 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:48.351222 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:48.279703 17775 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:06:48.285483 18064 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.280256 18147 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.346197 18134 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.293565 17985 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.271692 18124 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.197149 17981 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.329704 18117 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:48.362414 17975 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.286391 17976 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:06:48.292428 17984 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.052707 16487 rpcz_store.cc:276] 0709 13:06:46.891989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.508032 (+616043us) service_pool.cc:224] Handling call
0709 13:06:47.508303 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.593694 (+ 85391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.602779 (+  9085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.628121 (+ 25342us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:47.633464 (+  5343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.867332 (+233868us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54000e7754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:47.868055 (+   723us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.920731 (+ 52676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114800896}
I20260709 13:06:48.286548 17982 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
W20260709 13:06:48.379841 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 186391us
I20260709 13:06:48.361011 18108 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.357605 18136 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.387816 16557 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:48.380949 18064 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:48.383098 18123 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.418447 17152 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:48.390158 18134 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.436018 18049 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:48.386448 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1300) took 1499 ms. Trace:
I20260709 13:06:48.387496 17985 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.388007 18033 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.355880 17978 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:48.433460 18138 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:06:48.415000 18147 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.387575 18106 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:06:48.448745 18012 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:48.455349 18146 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:48.452384 18141 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.388s	user 0.001s	sys 0.002s
W20260709 13:06:48.458350 18144 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:06:48.458994 17990 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:48.459393 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 108228us
I20260709 13:06:48.435853 17981 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.440403 18149 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:48.452955 18140 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
I20260709 13:06:48.446233 18030 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.468190 18133 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:06:48.469465 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51088us
W20260709 13:06:48.459004 18143 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:48.437284 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:48.498446 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61227.1us
W20260709 13:06:48.461213 16529 leader_election.cc:336] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Timed out: RequestConsensusVote RPC to 127.15.6.4:44223 timed out after 1.840s (SENT)
W20260709 13:06:48.472716 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 189168us
I20260709 13:06:48.499289 16529 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:48.499542 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:48.500861 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.502596 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:48.479236 18157 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.468216 18064 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.424674 18117 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:48.482717 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 131758us
I20260709 13:06:48.440914 17751 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.471937 17987 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.485996 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:48.522459 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.497722 18030 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.486984 18115 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:48.487746 18153 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:48.472283 17986 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.476058 17985 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.491921 18162 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.439467 16484 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.505192 18159 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.503690 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:48.503722 16558 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.504066 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:48.505348 18161 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.491545 17990 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.540375 17986 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.465068 18136 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.517092 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.517817 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:48.518807 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:48.509898 16557 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.480821 18033 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.538094 16636 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:48.510432 18108 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.511461 18012 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.540760 17990 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.540822 17986 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.558034 16604 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:48.568277 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51228.5us
I20260709 13:06:48.584753 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:48.552193 18142 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:06:48.552682 18128 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.473s	user 0.000s	sys 0.002s
I20260709 13:06:48.527245 18030 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.604136 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86377.7us
I20260709 13:06:48.472191 16488 rpcz_store.cc:276] 0709 13:06:46.883364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.506422 (+623058us) service_pool.cc:224] Handling call
0709 13:06:47.506696 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.593607 (+ 86911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.602474 (+  8867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.617729 (+ 15255us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.632798 (+ 15069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.346672 (+713874us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5400400454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:48.357118 (+ 10446us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.382573 (+ 25455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104395136}
W20260709 13:06:48.583108 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.613209 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 104678us
I20260709 13:06:48.540866 18162 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:48.488529 18146 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.528074 17854 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:06:48.552616 18155 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.618553 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.643821 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:48.620939 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.554962 17781 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:06:48.552904 17793 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:06:48.588363 18012 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:48.582760 17976 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.642904 18165 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.644733 17185 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:48.610926 18071 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.660122 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.660337 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.660868 17185 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:48.588521 17982 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:48.647504 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 61017.6us
I20260709 13:06:48.582587 18097 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:06:48.649364 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 126966us
I20260709 13:06:48.654086 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.663457 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.615903 16487 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:48.639676 17987 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:48.662303 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.585459 18108 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.520830 18157 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.666118 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.663209 17186 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:48.587409 18124 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.670091 17185 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:48.588657 18110 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:06:48.674599 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:48.661027 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:48.645553 18080 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:48.708564 16486 raft_consensus.cc:606] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:06:48.708673 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45281us
I20260709 13:06:48.662559 17982 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:48.710938 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 47620.9us
I20260709 13:06:48.789466 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:48.790068 16486 raft_consensus.cc:614] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:48.673237 17781 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.798363 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:48.708001 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.709998 17978 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.662583 18159 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 13:06:48.709895 18123 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.773737 18155 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.789644 18161 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:48.798420 18149 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.798905 17982 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.772296 18158 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.814255 17990 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.836066 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:48.826893 17978 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:48.815397 18134 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:48.896606 18134 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.896155 18161 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.896970 18157 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.897015 18134 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.898496 17179 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:48.811750 17781 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.847754 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1552) took 1119 ms. Trace:
I20260709 13:06:48.896183 16487 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:48.899003 18134 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.899231 17978 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.911319 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.812276 18124 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.882597 18155 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.893260 18163 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:06:48.823632 17987 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.886133 17975 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.847339 18149 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:48.912521 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:48.815729 17854 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:06:48.888569 18123 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.904574 17986 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.789674 18162 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.893707 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.821463 18012 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:48.927186 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 138450us
W20260709 13:06:48.920905 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.970604 18134 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.900636 17781 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:49.045275 18135 consensus_meta.cc:287] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.954s	user 0.009s	sys 0.000s
I20260709 13:06:48.900759 16633 rpcz_store.cc:276] 0709 13:06:47.726542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.787720 (+ 61178us) service_pool.cc:224] Handling call
0709 13:06:47.788034 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.795379 (+  7345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.795410 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.796194 (+   784us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.044781 (+248587us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:48.048110 (+  3329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.056870 (+  8760us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.820153 (+763283us) raft_consensus.cc:1685] finished
0709 13:06:48.820177 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.845761 (+ 25584us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":287,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":204292,"threads_started":1,"wal-append.queue_time_us":585114}
W20260709 13:06:49.121124 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.122061 16531 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.025s	sys 0.022s
W20260709 13:06:49.136972 16531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.025s	sys 0.022s
I20260709 13:06:49.033974 17179 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.138649 18132 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.139590 18132 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.141821 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1539) took 1807 ms. Trace:
I20260709 13:06:49.142225 16637 rpcz_store.cc:276] 0709 13:06:47.334550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.334646 (+    96us) service_pool.cc:224] Handling call
0709 13:06:47.334920 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.727265 (+392345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.136364 (+1409099us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540015d454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:49.141584 (+  5220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824774912}
I20260709 13:06:49.143097 18132 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.040835 17182 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:49.143910 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.024940 17694 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.145090 17694 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:49.147032 17694 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.020015 17978 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:48.929827 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1299) took 1251 ms. Trace:
I20260709 13:06:49.149225 16562 rpcz_store.cc:276] 0709 13:06:47.678197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.678291 (+    94us) service_pool.cc:224] Handling call
0709 13:06:47.678516 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.795758 (+117242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.795786 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.795848 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:47.795876 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.929618 (+1133742us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002341d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:48.929660 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.929776 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269277056}
I20260709 13:06:49.029983 17985 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:49.122713 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 454937us
I20260709 13:06:49.125146 18096 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.126374 18106 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.024128 18108 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.052415 18123 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:48.927594 18124 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.154417 18106 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.155906 17979 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.156852 18124 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:49.021001 18114 consensus_meta.cc:287] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.000s
I20260709 13:06:49.157233 18106 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.157958 18114 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.051251 18117 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:49.080744 18137 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.033s	user 0.003s	sys 0.001s
I20260709 13:06:49.160746 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1286) took 1497 ms. Trace:
I20260709 13:06:49.083110 18145 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.162151 18145 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:06:49.088928 18175 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
I20260709 13:06:49.027972 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1538) took 1694 ms. Trace:
I20260709 13:06:49.164356 18145 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.030987 17975 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:49.042994 17981 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.001s
I20260709 13:06:49.075924 17982 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.168617 18123 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.169267 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1295) took 1487 ms. Trace:
I20260709 13:06:49.169760 16564 rpcz_store.cc:276] 0709 13:06:47.676210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.676314 (+   104us) service_pool.cc:224] Handling call
0709 13:06:47.676548 (+   234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.676826 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.676847 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.681697 (+  4850us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.856764 (+175067us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.856814 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.856876 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.080254 (+1223378us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:06:49.163281 (+ 83027us) raft_consensus.cc:1685] finished
0709 13:06:49.163316 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.163632 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":372,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9996,"spinlock_wait_cycles":36167424,"thread_start_us":107843,"threads_started":1,"wal-append.queue_time_us":230761}
I20260709 13:06:48.926666 17990 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.168629 17982 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.025281 18030 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.173367 18114 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.174221 18124 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.174628 18030 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.026551 18031 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.175051 18124 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.175627 18031 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:48.987118 18033 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:49.036687 18064 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.000s
I20260709 13:06:49.177222 18064 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.179381 18124 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.083470 18040 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.180104 18040 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:49.181556 18040 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.028421 18086 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.184294 18086 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:48.963111 18149 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.005050 16529 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:06:49.194732 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 189659us
I20260709 13:06:49.050223 18146 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:48.963009 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 50560.3us
I20260709 13:06:49.197175 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:48.971053 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:48.929941 18155 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:48.815850 18160 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:49.201534 18160 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.203191 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:49.017005 18166 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 13:06:48.894953 18169 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.206001 17985 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.206678 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1568) took 1105 ms. Trace:
I20260709 13:06:49.207077 16560 rpcz_store.cc:276] 0709 13:06:48.100866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.455921 (+355055us) service_pool.cc:224] Handling call
0709 13:06:48.456396 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.456693 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.456720 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.457565 (+   845us) log.cc:844] Serialized 540 byte log entry
0709 13:06:48.479904 (+ 22339us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:48.479937 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.479995 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.206219 (+726224us) raft_consensus.cc:1685] finished
0709 13:06:49.206252 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.206484 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":22062,"threads_started":1,"wal-append.queue_time_us":63601}
I20260709 13:06:49.035985 18170 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:49.043867 18171 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:06:49.211819 18064 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.031829 18173 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.212064 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.213089 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:49.016131 18174 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.016688 18176 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:06:49.017293 18179 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:49.031374 18180 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.901787 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.086612 18187 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.133540 18135 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4.
I20260709 13:06:49.139321 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.161144 16566 rpcz_store.cc:276] 0709 13:06:47.663514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.663607 (+    93us) service_pool.cc:224] Handling call
0709 13:06:47.663849 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.838725 (+174876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.160110 (+1321385us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b5400049a54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:49.160491 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198262016}
I20260709 13:06:49.052155 18136 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.167896 18145 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.186547 18086 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.164383 16631 rpcz_store.cc:276] 0709 13:06:47.334028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.336471 (+  2443us) service_pool.cc:224] Handling call
0709 13:06:47.340351 (+  3880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.827136 (+486785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.027714 (+1200578us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b540015cf54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:49.027914 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809423616}
I20260709 13:06:49.186442 16490 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.188445 18087 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.888114 18164 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.209856 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.036358 18172 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.232882 18132 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.441624 18172 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.441869 18132 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.443451 17800 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.279331 18149 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.444046 17186 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.426066 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1553) took 1681 ms. Trace:
I20260709 13:06:49.213940 18155 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.444283 18172 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:49.265504 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.347754 18030 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:06:49.369962 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.000s	sys 0.015s
I20260709 13:06:49.408473 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:49.231709 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.212613 18160 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.224416 18040 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:49.448587 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.000s	sys 0.019s
I20260709 13:06:49.290580 18134 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.311856 18124 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.216252 18169 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.219606 17983 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.444619 16638 rpcz_store.cc:276] 0709 13:06:47.745014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.788790 (+ 43776us) service_pool.cc:224] Handling call
0709 13:06:47.853601 (+ 64811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.938967 (+ 85366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.385100 (+1446133us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b54003f1950. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:49.425871 (+ 40771us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148487552}
I20260709 13:06:49.452652 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:49.226727 17990 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.363911 18186 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:49.237088 18105 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.463740 16486 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:49.269546 18064 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.460754 18169 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.471570 17717 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.472138 17717 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.472752 18031 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.473846 18031 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.476210 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.475272 18174 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:06:49.475515 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.468791 18041 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.477975 18041 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.478206 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.478355 18030 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.468581 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1314) took 1951 ms. Trace:
I20260709 13:06:49.476142 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:49.474278 18132 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.474896 17717 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:49.475482 18162 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:49.481240 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.460453 16559 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:49.213974 18173 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.479952 16491 rpcz_store.cc:276] 0709 13:06:47.516965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.868859 (+351894us) service_pool.cc:224] Handling call
0709 13:06:47.869153 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.210562 (+341409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.210592 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.210653 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:48.210685 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.468124 (+1257439us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54000cc1d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:49.468185 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.468389 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784776448}
I20260709 13:06:49.486512 17180 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.488435 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.466975 18086 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.489240 17186 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:49.467758 18169 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.495766 18041 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.502451 16565 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:49.503516 17694 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.504242 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.508610 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.505528 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:49.480412 18030 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.478206 18174 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.516392 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.516185 18180 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.516572 17990 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.517132 16491 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:49.518139 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.518416 18180 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.516327 17187 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.500986 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.523151 17990 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.523315 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.523665 18173 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.524791 16563 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:49.500882 16484 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.520004 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1564) took 1439 ms. Trace:
I20260709 13:06:49.541706 16565 rpcz_store.cc:276] 0709 13:06:48.080629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.207196 (+126567us) service_pool.cc:224] Handling call
0709 13:06:49.501473 (+1294277us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5800174c98. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:06:49.501872 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.509713 (+  7841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.519933 (+ 10220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6854016}
I20260709 13:06:49.546602 18186 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.527228 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.548311 16562 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:49.557210 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:49.515561 16559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1558) took 1432 ms (client timeout 1614 ms). Trace:
I20260709 13:06:49.495002 18105 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.541021 18187 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:49.563534 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.551226 18030 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.568028 18105 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:49.570748 18033 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.571247 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 58791us
W20260709 13:06:49.572016 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.572228 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 115) took 1803 ms. Trace:
I20260709 13:06:49.573035 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.573688 16388 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 3, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 3 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.575559 16561 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:49.575873 18064 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.521801 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:49.576759 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55258.8us
I20260709 13:06:49.577693 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.578706 18172 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.579252 18189 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.542841 17983 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.579768 18199 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.580407 18186 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.519157 18087 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:49.559846 16559 rpcz_store.cc:269] 0709 13:06:48.077617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.078757 (+  1140us) service_pool.cc:224] Handling call
0709 13:06:49.138862 (+1060105us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b5800174c98. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:06:49.508896 (+370034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20963712}
I20260709 13:06:49.581060 18159 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.581425 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.588236 18174 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.544472 18173 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:06:49.590323 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.591114 18198 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 13:06:49.591764 18149 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.592797 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.592934 17982 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:49.623967 18033 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.628034 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:49.588135 16484 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:49.558746 18164 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.604120 16485 rpcz_store.cc:276] 0709 13:06:47.662204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.869765 (+207561us) service_pool.cc:224] Handling call
0709 13:06:47.869988 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.981772 (+111784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.409098 (+1427326us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002e40d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:49.465155 (+ 56057us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255741312}
I20260709 13:06:49.608067 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.615450 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:49.620826 17181 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:49.624199 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:49.618229 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.595638 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.631521 16566 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.618628 17990 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:49.633504 16484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 116) took 1690 ms (client timeout 1848 ms). Trace:
I20260709 13:06:49.646427 16563 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:49.635093 18164 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.627754 18159 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.653790 16388 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 2, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 2 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.655035 18199 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.656872 17983 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.657215 18199 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.659041 17717 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.659580 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.660228 16489 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:49.661059 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.655055 18159 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.664662 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.669332 16565 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:49.655511 16388 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:49.629748 18030 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.679241 17990 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.681587 18164 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.682642 18169 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.683123 18033 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.683348 17781 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.684085 17781 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.686491 17781 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:49.647610 16484 rpcz_store.cc:269] 0709 13:06:47.941635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.943199 (+  1564us) service_pool.cc:224] Handling call
0709 13:06:49.499996 (+1556797us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b58006602d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f06363e70aa 00007f0636469447 00007f0636481fe7 00007f06364837de 00007f063648f27c 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c
0709 13:06:49.631594 (+131598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325394304}
I20260709 13:06:49.689392 18087 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.690536 18169 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.647643 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 317) took 1025 ms. Trace:
W20260709 13:06:49.696184 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 44208.8us
W20260709 13:06:49.676399 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61821.5us
I20260709 13:06:49.662688 18187 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.704020 18187 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.659629 17717 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.647814 18172 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.708340 16388 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 2 to 3, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:49.635293 18135 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:06:49.713129 17717 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.713512 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:49.715068 18064 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.695031 17183 rpcz_store.cc:276] 0709 13:06:48.620045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.621748 (+  1703us) service_pool.cc:224] Handling call
0709 13:06:49.408873 (+787125us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b58001e0998. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366eee 0000000000375939 00007f063b3da1e0 00007f063b4a30c4 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:06:49.645733 (+236860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5450624}
I20260709 13:06:49.706162 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:49.701120 17781 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:49.716384 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.667115 18174 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.721179 18114 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.721201 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.649739 18189 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.722046 18136 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.721376 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.743379 16490 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:49.724261 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.731578 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:49.732123 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:49.677080 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.732271 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:49.707881 17975 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 13:06:49.733028 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:49.733179 16565 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.710090 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.742702 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:49.741825 16563 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:49.764948 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1328) took 1092 ms. Trace:
I20260709 13:06:49.766898 16484 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:49.738794 18096 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.773947 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:49.773669 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 74886.1us
I20260709 13:06:49.773818 16488 rpcz_store.cc:276] 0709 13:06:48.672729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.598239 (+925510us) service_pool.cc:224] Handling call
0709 13:06:49.635732 (+ 37493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.672350 (+ 36618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.672383 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.677248 (+  4865us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:49.677284 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.764704 (+ 87420us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b54002990d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:49.764750 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.764867 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66423168}
I20260709 13:06:49.776392 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.778568 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 126) took 10668 ms. Trace:
I20260709 13:06:49.781359 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.783217 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.740770 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.768553 18064 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.791319 16484 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.785094 16563 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:49.791921 18041 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:49.770880 16388 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 3, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:49.803972 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:49.792780 18189 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.793135 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1322) took 1099 ms. Trace:
I20260709 13:06:49.793684 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.748494 18114 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.807456 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.808115 16561 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
W20260709 13:06:49.808615 18202 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:49.809078 18114 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:49.774683 18164 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.798316 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.809005 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.810388 16561 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:49.810086 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.810700 16603 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:49.810827 16564 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:49.805738 18041 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.811738 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.805495 16483 rpcz_store.cc:276] 0709 13:06:48.669694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.671303 (+  1609us) service_pool.cc:224] Handling call
0709 13:06:49.252998 (+581695us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366eee 0000000000375939 00007f063b3da1e0 00007f063b4a30c4 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:06:49.253286 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.253850 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.253881 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.254450 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.555611 (+301161us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:49.557926 (+  2315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.561235 (+  3309us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.736151 (+174916us) raft_consensus.cc:1685] finished
0709 13:06:49.737993 (+  1842us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.768908 (+ 30915us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2152,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"spinlock_wait_cycles":7598848,"thread_start_us":82934,"threads_started":1,"wal-append.queue_time_us":172157}
I20260709 13:06:49.811143 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.802006 16487 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:49.768471 18136 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.801582 17153 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:49.805462 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.815230 16563 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:49.805922 16558 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.811972 18086 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:49.814551 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.816892 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.816991 16487 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:49.786998 18170 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.814457 17185 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:49.818106 16488 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.812104 18041 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.829623 16485 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:49.824404 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:49.830910 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.796789 16559 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:49.811657 16388 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.813228 17717 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.829407 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:49.818351 18173 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:49.809607 18064 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.837651 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.839608 16561 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:49.838243 16639 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:49.806883 18096 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:49.845853 16565 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:49.832538 16557 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.834421 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 865) took 1032 ms. Trace:
I20260709 13:06:49.852406 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.855822 16563 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:49.850916 18114 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.852946 17781 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.843152 18173 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:49.860534 16388 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.867084 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.853262 18135 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:49.884873 16490 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:06:49.886865 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 860) took 1090 ms. Trace:
I20260709 13:06:49.866217 18114 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:49.889478 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1325) took 1212 ms. Trace:
I20260709 13:06:49.887203 16488 rpcz_store.cc:276] 0709 13:06:48.792307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.788975 (+996668us) service_pool.cc:224] Handling call
0709 13:06:49.814781 (+ 25806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.820601 (+  5820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.882095 (+ 61494us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b5400289450. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:49.882216 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55899008}
I20260709 13:06:49.871343 18174 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:49.892695 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 104287us
I20260709 13:06:49.890596 16486 rpcz_store.cc:276] 0709 13:06:48.671978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.552364 (+880386us) service_pool.cc:224] Handling call
0709 13:06:49.612283 (+ 59919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.776117 (+163834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.776149 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.776194 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:49.776223 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.883717 (+107494us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54002774d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:49.883757 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.883887 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364787072}
I20260709 13:06:49.900861 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:49.853526 16484 rpcz_store.cc:276] 0709 13:06:48.794671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.790783 (+996112us) service_pool.cc:224] Handling call
0709 13:06:49.791136 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.806310 (+ 15174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.827293 (+ 20983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:49.903227 16638 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:49.892351 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.882428 18172 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:49.907269 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:49.907302 17180 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:49.908007 16633 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.908679 18160 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.909042 18160 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:49.909601 18096 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:49.909966 18160 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.911414 18160 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.912246 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.913195 16388 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:49.914791 16388 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 3, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:49.780962 16386 rpcz_store.cc:276] 0709 13:06:38.975911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.978263 (+  2352us) service_pool.cc:224] Handling call
0709 13:06:49.620546 (+10642283us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:48.442941 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:48.525839 (+ 82898us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:48.528648 (+  2809us) write_op.cc:435] Acquired schema lock
0709 13:06:48.539230 (+ 10582us) tablet.cc:662] Decoding operations
0709 13:06:48.788757 (+249527us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:48.812428 (+ 23671us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:48.816164 (+  3736us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:48.963936 (+147772us) tablet.cc:701] Row locks acquired
0709 13:06:48.971898 (+  7962us) write_op.cc:260] PREPARE: finished
0709 13:06:49.036685 (+ 64787us) write_op.cc:270] Start()
0709 13:06:49.036815 (+   130us) write_op.cc:276] Timestamp: P: 1783602409014608 usec, L: 0
0709 13:06:49.036837 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.037410 (+   573us) log.cc:844] Serialized 2024 byte log entry
0709 13:06:49.080680 (+ 43270us) op_driver.cc:464] REPLICATION: finished
0709 13:06:49.087892 (+  7212us) write_op.cc:301] APPLY: starting
0709 13:06:49.087963 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:49.088067 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:49.088204 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:49.090471 (+  2267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:49.090662 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:49.090706 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:49.090966 (+   260us) log.cc:844] Serialized 47 byte log entry
0709 13:06:49.091132 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:49.091224 (+    92us) write_op.cc:454] Released schema lock
0709 13:06:49.091275 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:49.091590 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:49.091615 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111,"reported_tablets":11,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":6926,"apply.run_cpu_time_us":2243,"apply.run_wall_time_us":3682,"num_ops":5,"prepare.queue_time_us":363278,"prepare.run_cpu_time_us":12379,"prepare.run_wall_time_us":651430,"raft.queue_time_us":1956,"raft.run_cpu_time_us":7034,"raft.run_wall_time_us":7047,"replication_time_us":43714,"thread_start_us":270055,"threads_started":4,"wal-append.queue_time_us":39567}]]}
I20260709 13:06:49.918171 16489 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:49.919716 16562 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:49.906158 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.920783 16490 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:49.904709 16638 pending_rounds.cc:85] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 5
I20260709 13:06:49.920047 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1326) took 1247 ms. Trace:
I20260709 13:06:49.893088 18114 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.922910 16640 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:49.936187 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.925103 16638 pending_rounds.cc:107] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:49.936884 16638 raft_consensus.cc:2889] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.923709 16491 rpcz_store.cc:276] 0709 13:06:48.672262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.545868 (+873606us) service_pool.cc:224] Handling call
0709 13:06:49.546286 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.559936 (+ 13650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.559964 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.568533 (+  8569us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.696258 (+127725us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:49.696295 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.696355 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.919867 (+223512us) raft_consensus.cc:1685] finished
0709 13:06:49.919887 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.919999 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4650,"raft.queue_time_us":18550,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":127362,"threads_started":1,"wal-append.queue_time_us":295800}
I20260709 13:06:49.938066 16388 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:49.947954 16566 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:49.950924 16632 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:49.929801 18096 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:49.956113 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 137293us
I20260709 13:06:49.956923 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:49.892431 18105 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:06:49.958382 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.959129 16490 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:49.959887 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.961624 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.970983 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.980811 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:49.981376 16638 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:49.982656 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 93562.6us
I20260709 13:06:49.984028 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:49.984629 16564 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
W20260709 13:06:49.986529 18206 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:06:49.988518 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.990085 18173 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:49.991108 18136 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:49.969898 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.991992 16566 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.992170 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:49.992563 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:49.993384 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.992339 16566 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:49.994012 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:49.994963 16640 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.995585 16603 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:49.999912 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.004000 16632 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 2: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:49.993299 16487 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:50.011142 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.023613 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.024855 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:50.025810 16634 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.024209 16635 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:50.010314 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.022642 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:50.023842 16566 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.030285 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.031111 16632 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:50.030372 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.031929 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.037899 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:50.045848 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.423313 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1335) took 1232 ms. Trace:
I20260709 13:06:50.346276 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.342200 16638 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:50.055245 16566 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.132237 16489 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.425159 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.030527 18086 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.425743 16486 rpcz_store.cc:276] 0709 13:06:49.190899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.899610 (+708711us) service_pool.cc:224] Handling call
0709 13:06:49.931294 (+ 31684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.950852 (+ 19558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.950882 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.961503 (+ 10621us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.994322 (+ 32819us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:49.994360 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.994421 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.423077 (+428656us) raft_consensus.cc:1685] finished
0709 13:06:50.423098 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.423253 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6567,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5556,"thread_start_us":32454,"threads_started":1,"wal-append.queue_time_us":64252}
W20260709 13:06:50.303884 18220 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:06:50.464447 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 432901us
W20260709 13:06:50.071740 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.459529 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.461050 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.463511 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:50.131695 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.059104 16640 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
W20260709 13:06:50.249567 18187 consensus_meta.cc:287] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:06:50.460111 16634 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
W20260709 13:06:50.481894 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 285706us
I20260709 13:06:50.097343 18030 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.048262 18164 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.513787 16638 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:50.483841 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 266663us
I20260709 13:06:50.484258 16489 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:50.515478 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.054694 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.484423 18064 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.461418 18169 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:50.535869 18169 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.485702 18145 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.537092 18145 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.537882 18169 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:50.538396 18169 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:50.535276 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:50.538901 18145 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.539044 17180 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:50.539249 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.480999 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:50.480636 16637 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:50.123252 18136 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.037473 17990 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.513468 16491 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:50.046077 17181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 316) took 1426 ms (client timeout 1533 ms). Trace:
W20260709 13:06:50.528577 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47614.7us
I20260709 13:06:50.051537 16557 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:50.463757 18033 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.532261 16632 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:50.093847 16633 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:50.529170 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:50.530963 18164 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.299607 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1324) took 1351 ms. Trace:
I20260709 13:06:50.532748 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.561458 16486 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:50.398550 18173 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:50.315167 18160 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:50.513154 16635 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:50.562359 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.480011 18189 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:50.535200 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:50.484162 18096 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:50.037256 18135 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.448s
I20260709 13:06:50.566684 18135 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:50.567216 18135 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.541657 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:50.538867 18169 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.557116 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:50.558264 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:50.542444 16484 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:50.540558 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:50.570931 17187 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:50.573494 16489 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:50.576834 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:50.561220 16482 rpcz_store.cc:276] 0709 13:06:48.671059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.672937 (+  1878us) service_pool.cc:224] Handling call
0709 13:06:49.217809 (+544872us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366eee 0000000000375939 00007f063b3da1e0 00007f063b4a30c4 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:06:49.218140 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.218717 (+   577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.218748 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.467487 (+248739us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.613023 (+145536us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:49.616238 (+  3215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.623011 (+  6773us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.993758 (+370747us) raft_consensus.cc:1685] finished
0709 13:06:49.996879 (+  3121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.022455 (+ 25576us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1643,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"spinlock_wait_cycles":8448384,"thread_start_us":80577,"threads_started":1,"wal-append.queue_time_us":289350}
I20260709 13:06:50.575610 16529 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:50.582530 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:50.579293 16558 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.761s	user 0.006s	sys 0.002s
I20260709 13:06:50.543565 17781 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:50.576169 17185 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:50.580926 16489 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.585877 16558 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:50.580011 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.561673 18164 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.590569 16563 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:50.575160 18226 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.485s	user 0.000s	sys 0.001s
I20260709 13:06:50.589017 17188 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:50.598246 16566 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:50.599396 16566 pending_rounds.cc:85] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:06:50.603732 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:50.587149 18064 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:50.614967 18224 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:06:50.615477 18136 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.616139 16566 pending_rounds.cc:107] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:50.625831 16566 raft_consensus.cc:2889] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.595624 18030 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.564674 18033 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.605106 16490 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:50.578611 18189 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.629462 18033 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:50.599750 17990 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.595443 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1329) took 1407 ms. Trace:
I20260709 13:06:50.623070 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:50.558347 17181 rpcz_store.cc:269] 0709 13:06:48.619454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.621776 (+  2322us) service_pool.cc:224] Handling call
0709 13:06:50.031445 (+1409669us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54005082d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:50.045998 (+ 14553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733957376}
I20260709 13:06:50.635191 16635 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:50.635174 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:50.618845 18199 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:50.599647 18160 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.616011 18102 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 13:06:50.638235 18114 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.000s
I20260709 13:06:50.589046 18173 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.604326 17781 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.622037 18064 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:50.634397 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.636018 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.647734 16529 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:50.641521 18136 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:50.672492 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.672654 18169 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.673125 16638 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:50.673516 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1333) took 1483 ms. Trace:
I20260709 13:06:50.645002 18033 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.667438 18064 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.673902 16485 rpcz_store.cc:276] 0709 13:06:49.190156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.864350 (+674194us) service_pool.cc:224] Handling call
0709 13:06:49.884553 (+ 20203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.905345 (+ 20792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.905373 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.926734 (+ 21361us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.034998 (+108264us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:50.035034 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.035104 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.673321 (+638217us) raft_consensus.cc:1685] finished
0709 13:06:50.673341 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.673459 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6133,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4315,"thread_start_us":78018,"threads_started":1,"wal-append.queue_time_us":624145}
I20260709 13:06:50.646029 18199 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.676820 18136 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.709028 18189 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.665722 18114 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.723284 18136 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.710058 18033 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.725531 16638 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.726722 17781 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:50.727876 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.728093 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.728693 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.730351 18145 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:50.730779 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.738327 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.634522 16483 rpcz_store.cc:276] 0709 13:06:49.188510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.812621 (+624111us) service_pool.cc:224] Handling call
0709 13:06:49.812961 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.833120 (+ 20159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.834620 (+  1500us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.872149 (+ 37529us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.968945 (+ 96796us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:49.974654 (+  5709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.985123 (+ 10469us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.573810 (+588687us) raft_consensus.cc:1685] finished
0709 13:06:50.575283 (+  1473us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.588975 (+ 13692us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2349,"raft.queue_time_us":9597,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6290,"thread_start_us":33639,"threads_started":1,"wal-append.queue_time_us":72591}
I20260709 13:06:50.744676 18173 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.720155 18169 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:50.816375 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 174336us
I20260709 13:06:50.805233 16603 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:50.802599 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.818727 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.819573 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.820137 16640 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:50.745463 18033 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.818169 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:50.827874 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 346931us
I20260709 13:06:50.831660 16638 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:50.832947 16638 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:50.833984 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.830894 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:50.880162 16634 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:06:50.884693 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 53875.8us
I20260709 13:06:50.887693 18248 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:50.888322 18248 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:50.891182 18248 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:50.892621 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64215.3us
I20260709 13:06:50.899227 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:50.900015 18041 consensus_meta.cc:287] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.065s	user 0.010s	sys 0.000s
I20260709 13:06:50.913789 18041 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.918349 18041 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:50.899811 16636 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
W20260709 13:06:50.922860 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.928995 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.834458 18169 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.827036 18235 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:50.933077 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 47164.5us
I20260709 13:06:50.936466 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:50.946074 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 58189.5us
W20260709 13:06:50.947337 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 156666us
I20260709 13:06:50.878854 18145 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.932407 18238 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.931758 18135 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:50.944003 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.891732 18248 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:06:50.949694 16631 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:50.966661 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:50.965037 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:50.951830 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1315) took 1034 ms. Trace:
I20260709 13:06:50.949316 18232 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.939294 18169 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:50.964465 18238 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.962559 18173 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.994379 18199 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:50.995024 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:50.997555 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:50.998814 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.000416 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.004138 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.009797 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.036789 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:51.038031 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 73078.4us
W20260709 13:06:51.039494 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 79504.8us
I20260709 13:06:51.005519 18189 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.993527 18232 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:51.034789 18250 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:51.045421 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:51.034562 18227 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:06:50.957960 18240 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:06:51.050058 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.053956 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:50.982525 17717 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:06:51.027067 18238 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.035728 18135 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:50.961836 18235 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.049846 18136 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.092689 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.054441 18232 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.095187 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 52490.8us
I20260709 13:06:51.042953 17781 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:51.099725 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.099751 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.102224 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.103061 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:51.103226 16635 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:51.104597 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:06:51.102164 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58860.2us
I20260709 13:06:51.106698 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.105940 16456 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.108378 18135 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:51.111431 18246 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:06:51.112871 18135 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:51.093418 18233 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.162128 18233 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.162511 18233 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.170924 18135 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:06:51.101274 18229 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.527s	user 0.002s	sys 0.003s
I20260709 13:06:51.171481 18135 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.172971 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:51.174100 18135 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.174607 18135 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.174993 18135 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.178826 18160 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:51.180740 18105 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.181129 18105 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.182006 18105 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.183136 18105 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.094411 18136 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:51.184517 18136 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.187907 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.189163 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.190750 18135 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:51.119501 18259 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.120147 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1334) took 1929 ms. Trace:
I20260709 13:06:51.120785 18114 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:50.991667 16559 rpcz_store.cc:276] 0709 13:06:49.915153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.923544 (+  8391us) service_pool.cc:224] Handling call
0709 13:06:49.968056 (+ 44512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.022927 (+ 54871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.024226 (+  1299us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.513677 (+489451us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.892436 (+378759us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:50.920406 (+ 27970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.931938 (+ 11532us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.936229 (+  4291us) raft_consensus.cc:1685] finished
0709 13:06:50.936246 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.949646 (+ 13400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4781,"raft.queue_time_us":12532,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8050,"thread_start_us":254267,"threads_started":1,"wal-append.queue_time_us":254870}
I20260709 13:06:51.208873 16488 rpcz_store.cc:276] 0709 13:06:49.190512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.891723 (+701211us) service_pool.cc:224] Handling call
0709 13:06:49.904249 (+ 12526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.946676 (+ 42427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.946705 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.957897 (+ 11192us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.037549 (+ 79652us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:50.037584 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.037642 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.119945 (+1082303us) raft_consensus.cc:1685] finished
0709 13:06:51.119964 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.120096 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":409,"raft.queue_time_us":3867,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9385,"thread_start_us":36032,"threads_started":1,"wal-append.queue_time_us":566496}
I20260709 13:06:51.128113 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1313) took 1266 ms. Trace:
I20260709 13:06:51.131924 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 869) took 1181 ms. Trace:
I20260709 13:06:51.137732 18238 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:51.138790 18234 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:06:51.143082 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.147106 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.147516 18231 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.151539 18164 consensus_meta.cc:287] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.538s	user 0.004s	sys 0.004s
I20260709 13:06:51.053128 18255 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:06:51.153270 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1563) took 1358 ms. Trace:
I20260709 13:06:51.152747 18189 raft_consensus.cc:2955] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:51.158759 18173 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.159154 18169 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.099978 18102 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:06:51.160936 18235 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.161684 18145 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.118656 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.173008 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 102) took 1169 ms. Trace:
W20260709 13:06:51.255662 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 260681us
I20260709 13:06:51.200244 16640 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:51.203105 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:51.208694 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 121604us
W20260709 13:06:51.127363 18228 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.527s	user 0.001s	sys 0.000s
I20260709 13:06:51.230088 16563 rpcz_store.cc:276] 0709 13:06:49.861622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.861742 (+   120us) service_pool.cc:224] Handling call
0709 13:06:50.590371 (+728629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.595820 (+  5449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.127928 (+532108us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540002bf50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:51.128057 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675060608}
W20260709 13:06:51.248615 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 105604us
I20260709 13:06:51.273797 16603 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:51.250496 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 247469us
I20260709 13:06:51.231447 18259 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.251102 18231 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.255872 16561 rpcz_store.cc:276] 0709 13:06:50.004103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.011597 (+  7494us) service_pool.cc:224] Handling call
0709 13:06:50.011913 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.028967 (+ 17054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.028998 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.043855 (+ 14857us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.093838 (+ 49983us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b480005e758. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
0709 13:06:50.428919 (+335081us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:50.428959 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.429020 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.948702 (+519682us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:06:51.172822 (+224120us) raft_consensus.cc:1685] finished
0709 13:06:51.172842 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.172957 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378505,"raft.queue_time_us":12262,"raft.run_cpu_time_us":1824,"raft.run_wall_time_us":65928,"spinlock_wait_cycles":14848128,"thread_start_us":332807,"threads_started":1,"wal-append.queue_time_us":417850}
I20260709 13:06:51.292330 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.276193 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:51.294945 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.311837 17187 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:51.250917 18164 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.293979 17717 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.313683 18030 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:51.312742 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:51.251587 18260 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.298966 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.318717 17717 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.330755 17717 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.332005 17717 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.339160 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 233283us
I20260709 13:06:51.277240 18169 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.342177 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.345137 16640 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:51.295158 18187 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.348122 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.347913 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:51.348625 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.349685 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.252637 18033 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.354426 16635 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:51.355954 17185 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.326856 18030 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.356065 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:51.327596 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 130) took 1680 ms. Trace:
I20260709 13:06:51.380685 16487 rpcz_store.cc:276] 0709 13:06:49.647082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.012012 (+364930us) service_pool.cc:224] Handling call
0709 13:06:50.012365 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.012683 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.012712 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.013219 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.457729 (+444510us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:50.461913 (+  4184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.482700 (+ 20787us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.126748 (+644048us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:06:51.287407 (+160659us) raft_consensus.cc:1685] finished
0709 13:06:51.287427 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.319668 (+ 32241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1853,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5659,"spinlock_wait_cycles":5737856,"thread_start_us":118925,"threads_started":1,"wal-append.queue_time_us":527217}
W20260709 13:06:51.383278 18064 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.663s	user 0.004s	sys 0.004s
I20260709 13:06:51.383678 18064 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.385672 18064 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.390514 18136 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.391947 16489 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:51.392884 18164 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.250486 16631 rpcz_store.cc:276] 0709 13:06:49.795035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.798045 (+  3010us) service_pool.cc:224] Handling call
0709 13:06:51.153051 (+1355006us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002fd354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:51.153199 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554513664}
I20260709 13:06:51.356581 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.256201 18173 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.359261 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.397612 16563 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:51.298372 18235 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:51.360978 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.361001 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.361923 18278 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.292665 18266 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:06:51.362224 18267 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.348079 18187 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.360208 17181 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:51.362540 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.363123 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.363591 18231 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.364636 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.407147 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.365087 18259 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.365762 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.366796 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:51.367698 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:51.371321 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.372241 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.373381 18232 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.373683 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.424057 18271 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:51.374948 17990 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.375919 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.376583 18096 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.425612 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.425894 18096 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.377985 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.335520 18260 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.380021 18233 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:51.397083 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.231307 16484 rpcz_store.cc:276] 0709 13:06:49.950611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.619589 (+668978us) service_pool.cc:224] Handling call
0709 13:06:50.646185 (+ 26596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.733963 (+ 87778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.736820 (+  2857us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.744633 (+  7813us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.938415 (+193782us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:50.946905 (+  8490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.952608 (+  5703us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.131698 (+179090us) raft_consensus.cc:1685] finished
0709 13:06:51.131716 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.131862 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11066,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":188837,"threads_started":1,"wal-append.queue_time_us":301543}
I20260709 13:06:51.429675 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:51.353739 18248 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.430734 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.430979 18248 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.431416 18248 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.426208 16566 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:51.345118 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.435066 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.435585 16566 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:51.436323 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.400501 16635 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:51.437075 16566 raft_consensus.cc:2410] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:51.348287 18169 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:51.437335 18230 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.800s	user 0.005s	sys 0.000s
I20260709 13:06:51.407837 17186 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:51.402964 16565 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:51.437759 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.438377 16638 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:51.439324 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:51.405583 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.405961 18268 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.418191 16557 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:51.406427 18267 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.406526 18187 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.379071 18238 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.416864 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.439927 16564 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:51.440414 16566 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.441910 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 107428us
I20260709 13:06:51.444823 16605 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:51.466427 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:51.439044 18260 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.437665 17182 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.419720 16633 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:51.406144 18164 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:51.425539 17990 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:51.404681 18279 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:51.471334 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 188408us
I20260709 13:06:51.470569 16563 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:51.472987 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.436230 18145 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.436174 17179 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:51.445040 18169 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.472189 17181 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.483395 18145 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:51.485402 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.486047 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:51.486581 17179 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.487952 18114 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:51.490249 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:51.490617 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:51.483467 16455 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.493908 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.476712 18267 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.477295 18136 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.468012 18259 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.402806 18235 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.480165 18164 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.483525 18102 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.501888 18102 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.502247 18102 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.504186 18258 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.504606 18258 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:51.504930 18258 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.484354 18247 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.505354 18086 raft_consensus.cc:1064] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:06:51.505609 18247 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.505998 18247 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.507956 18033 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.508934 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.508953 18030 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.512609 18187 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.514146 18030 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.501463 18235 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.515054 18235 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.415210 18278 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.485354 18145 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.517527 18145 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.517684 17781 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:51.518275 18278 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.518757 17781 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.519129 17781 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.520989 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.521664 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.522797 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.522615 17781 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.496022 17185 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 4. Ops: []
I20260709 13:06:51.496610 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:51.445578 18268 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.483925 18279 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.496786 18264 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:51.500690 18096 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.498503 17717 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.511297 18164 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.495460 18276 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.542398 18276 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.542768 18276 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.544456 18260 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.544906 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.545480 16558 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 1.
I20260709 13:06:51.546238 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:51.536303 17781 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.547959 18233 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.550393 18258 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.495421 18281 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.542061 17990 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.553295 18281 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.554258 17990 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.554826 18248 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.555300 18281 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.556252 18232 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.557399 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:51.557952 17185 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.560067 17981 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.542094 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.525520 16564 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.560803 17182 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:51.560849 18040 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:51.561847 18040 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.528988 16529 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:51.562172 18040 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.563067 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:51.562973 18040 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.564070 18164 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.564689 18164 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.565001 18164 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.565336 18164 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.538657 16566 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:51.495645 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.516744 17179 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:51.521281 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:51.536345 18279 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.573905 16529 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:51.575139 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:51.577193 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:51.577163 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 81597us
W20260709 13:06:51.574138 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 234006us
I20260709 13:06:51.578612 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.546716 16558 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:51.582960 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.580519 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.587283 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:51.584173 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:51.507282 18086 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.531118 18268 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.592528 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:51.592442 16636 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:51.593851 16562 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.546442 18260 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.607393 16561 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:51.607714 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.608347 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:51.609246 18283 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.588116 17981 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.594362 18281 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.605094 18232 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.612077 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72502.6us
I20260709 13:06:51.612905 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:51.613029 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:51.615393 18271 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.529966 18247 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.595089 16558 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.555522 18276 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.593237 18238 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:51.574590 18105 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:06:51.593924 18233 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.618765 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:51.594523 18145 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.625519 16564 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:51.602392 18040 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.628794 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:51.633570 17180 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:51.634009 18173 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.634733 16631 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.639743 17185 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:51.643854 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:51.644217 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.630244 17981 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.674240 18258 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:51.674643 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 55938.8us
I20260709 13:06:51.637578 18232 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.692884 16558 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:51.643018 18233 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.626466 18189 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:51.644893 18238 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.641170 18271 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:06:51.697587 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 68864.3us
I20260709 13:06:51.675139 16633 raft_consensus.cc:2368] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:51.677646 18283 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.641465 18033 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:06:51.701961 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.702189 16558 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:51.706321 18279 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.683784 18281 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.707319 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 75732.6us
I20260709 13:06:51.711581 16603 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:51.712447 17181 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:51.712498 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:51.776330 16560 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.777148 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45365.3us
I20260709 13:06:51.778293 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.694871 16559 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.677208 18030 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:51.698225 17981 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.718883 18248 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:51.722512 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.710459 16557 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:51.700851 18235 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.710016 18233 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.710779 18289 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.733521 18164 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.645140 18145 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:51.736155 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:51.743904 18281 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:51.744367 18187 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.744436 18279 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:51.750375 18290 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:51.760335 18189 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.761816 18232 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:51.763718 18292 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:51.766465 18271 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:51.768312 18247 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:51.769030 18238 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.770488 18096 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.831610 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 132593us
I20260709 13:06:51.734697 18033 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.773631 18276 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.775481 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:51.735160 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:51.849653 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 113537us
I20260709 13:06:51.850891 16456 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.851850 18296 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.852226 18296 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.852535 18296 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.856045 18033 raft_consensus.cc:697] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.856913 18033 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:51.860133 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 125011us
I20260709 13:06:51.861027 16491 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:51.861187 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:51.861835 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 237) took 4198 ms. Trace:
I20260709 13:06:51.862200 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.862887 18259 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.863363 18259 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:51.868335 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:51.787564 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.801800 17152 leader_election.cc:400] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:51.875188 17152 leader_election.cc:403] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:51.875604 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 95445.7us
I20260709 13:06:51.772275 18169 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.805873 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:51.835088 16560 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:51.811532 16565 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:51.859241 18296 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:51.877063 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.839360 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 195566us
I20260709 13:06:51.784132 17781 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:51.926484 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:51.925207 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.784582 18283 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:51.933669 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:51.941592 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:51.789181 18030 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.836916 18235 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.839866 18189 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:51.840103 18145 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.809357 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:51.948850 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 161585us
I20260709 13:06:51.878882 18271 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.840425 18289 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.950327 16485 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.786278 18254 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.161s
I20260709 13:06:51.802750 18102 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.786788 18260 consensus_queue.cc:1059] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:06:51.968142 16562 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.953822 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:51.975451 16560 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.946350 18030 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:51.947748 18235 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.862152 16388 rpcz_store.cc:276] 0709 13:06:47.663607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.665154 (+  1547us) service_pool.cc:224] Handling call
0709 13:06:51.861764 (+4196610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.741278 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.742011 (+   733us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.742065 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:06:50.742087 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:50.743242 (+  1155us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.743361 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.743392 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:06:50.930673 (+187281us) tablet.cc:701] Row locks acquired
0709 13:06:50.930724 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:06:50.930892 (+   168us) write_op.cc:270] Start()
0709 13:06:50.931029 (+   137us) write_op.cc:276] Timestamp: P: 1783602410930836 usec, L: 0
0709 13:06:50.933551 (+  2522us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.996782 (+ 63231us) log.cc:844] Serialized 4084 byte log entry
0709 13:06:51.331474 (+334692us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b180022be80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:06:51.418519 (+ 87045us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.557533 (+139014us) write_op.cc:301] APPLY: starting
0709 13:06:51.557617 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.557866 (+   249us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.557901 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.613467 (+ 55566us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.613772 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:06:51.613838 (+    66us) write_op.cc:312] APPLY: finished
0709 13:06:51.614188 (+   350us) log.cc:844] Serialized 77 byte log entry
0709 13:06:51.614353 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.614472 (+   119us) write_op.cc:454] Released schema lock
0709 13:06:51.614542 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.614895 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.614924 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87953,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":138781,"apply.run_cpu_time_us":3608,"apply.run_wall_time_us":57341,"num_ops":10,"prepare.queue_time_us":228074,"prepare.run_cpu_time_us":39620,"prepare.run_wall_time_us":365135,"raft.queue_time_us":84576,"raft.run_cpu_time_us":32303,"raft.run_wall_time_us":65163,"replication_time_us":484799,"spinlock_wait_cycles":38264064,"thread_start_us":449217,"threads_started":4,"wal-append.queue_time_us":126314}]]}
I20260709 13:06:51.879092 18173 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:51.796175 17990 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:06:51.975521 18289 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.947297 18189 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.947310 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:51.972800 16559 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.843688 17981 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:51.947465 18248 raft_consensus.cc:2764] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:51.950028 18268 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.004393 18271 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.012794 18260 raft_consensus.cc:3055] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.016501 18296 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.019667 16631 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:51.991446 18283 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.007150 17181 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.021615 17981 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.022238 18030 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.006349 18299 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.026196 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:52.026947 18236 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.027199 17187 raft_consensus.cc:2955] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:52.028746 18102 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:06:52.004532 18064 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:52.028702 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:52.029844 18281 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:51.997534 18298 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.030812 18164 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.031203 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.003726 16557 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:52.024642 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:52.042428 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 174136us
I20260709 13:06:52.043983 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:52.006531 18265 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.115664 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.116263 16490 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.120649 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:51.962888 18259 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.047978 18299 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:52.057444 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:52.069555 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:52.071583 18233 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.072038 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:52.072829 18169 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:52.076987 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 150576us
I20260709 13:06:52.080873 18268 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.100512 18145 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.040513 18271 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:52.040797 18260 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:52.102792 18306 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:06:52.101759 18236 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.107000 18030 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.050355 18105 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:06:52.120399 18265 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:52.117646 16487 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.128824 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:52.129670 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.127059 18299 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.138621 17183 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:52.168094 18105 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.145051 18260 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.148517 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.132893 18271 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.163861 18233 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.175319 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.149145 17180 raft_consensus.cc:2368] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4.
I20260709 13:06:52.164419 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.122097 18289 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.177084 16491 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:52.177954 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.178560 16491 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:52.178707 18289 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.179246 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.171466 18105 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:52.175909 16485 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:52.179750 16491 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.181406 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.181926 16490 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:52.181984 16485 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:52.164925 17184 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:52.186044 16485 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.183086 18105 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.188951 18105 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.194356 18235 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.195393 18236 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:52.196285 18235 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.201289 18260 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.203390 18256 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.203778 18256 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:52.184067 17179 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:52.204571 18256 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.205724 18256 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.198092 16491 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:52.212329 18145 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.210954 18299 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.214850 18299 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.209368 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.219620 16484 raft_consensus.cc:2376] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3. Re-sending same reply.
I20260709 13:06:52.225095 18187 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:52.225587 18187 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.227896 18187 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:52.168318 18265 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:52.240746 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.240538 16559 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:52.254880 16487 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:52.255255 18187 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:52.293713 18187 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.272411 17181 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:52.268838 18189 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.290505 18271 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:52.337821 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.342346 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.342624 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.357172 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.347565 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.334322 18233 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.386394 16490 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.388053 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.378511 18287 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.380276 18267 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:52.382156 18248 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.391503 17990 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:06:52.382301 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 183991us
I20260709 13:06:52.379345 18276 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.399596 16565 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:52.399989 16564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.016s	sys 0.109s
I20260709 13:06:52.380060 18114 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:52.408124 16564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.016s	sys 0.109s
W20260709 13:06:52.412232 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 458481us
I20260709 13:06:52.415313 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1341) took 1029 ms. Trace:
I20260709 13:06:52.415691 16564 rpcz_store.cc:276] 0709 13:06:51.386226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.643578 (+257352us) service_pool.cc:224] Handling call
0709 13:06:51.643850 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.644024 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:51.729954 (+ 85930us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.414580 (+684626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.414714 (+   134us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:52.414838 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.414974 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.415184 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40264,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":1575,"thread_start_us":586744,"threads_started":2}
I20260709 13:06:52.425356 18189 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.426532 18187 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:52.386952 18233 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.429327 18233 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.416333 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.432082 18248 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.398896 18267 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:52.434031 18267 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.435218 18267 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.437312 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.438369 18276 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.440430 18276 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:52.446758 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 317990us
I20260709 13:06:52.448375 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.446959 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.451915 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:52.453441 16566 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:52.463987 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 351980us
I20260709 13:06:52.464700 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:52.468554 16564 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:52.462934 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:52.469702 16565 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:52.471355 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.449361 18248 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.450397 18238 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:52.496796 18331 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.496873 18238 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.497985 18311 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:52.492916 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.499415 16637 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.466348 18283 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:52.497509 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:52.493616 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.477433 18276 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.477950 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:06:52.480756 17781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.028s	sys 0.045s
I20260709 13:06:52.481259 18164 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.412828 17990 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.481426 18114 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:52.518584 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.497154 17179 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:52.520648 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:52.521723 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1340) took 1135 ms. Trace:
W20260709 13:06:52.519094 17781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.028s	sys 0.046s
I20260709 13:06:52.512344 18283 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:52.485793 18187 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:52.525331 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.542660 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.543226 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.525815 18330 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:52.528487 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 80173.3us
I20260709 13:06:52.482921 18064 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:52.525138 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.522096 16561 rpcz_store.cc:276] 0709 13:06:51.385961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.636138 (+250177us) service_pool.cc:224] Handling call
0709 13:06:51.636373 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.636527 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:51.636769 (+   242us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.521330 (+884561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.521456 (+   126us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:52.521500 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.521566 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.521674 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":404124,"prepare.queue_time_us":1089,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":2139,"raft.queue_time_us":406702,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":3605,"thread_start_us":480944,"threads_started":2,"wal-append.queue_time_us":355052}
I20260709 13:06:52.543429 16632 raft_consensus.cc:2410] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:06:52.527174 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.520479 18248 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.546928 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.554391 16635 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.555192 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.555894 16635 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:52.556591 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.517802 18164 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:52.548076 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.548200 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.558210 18164 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.558954 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.559980 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:52.560782 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.561571 18136 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.562269 18136 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:52.562605 18136 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:52.562950 18136 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.548678 16604 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:52.550918 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.523173 18268 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:52.522169 18264 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.550761 18298 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.533627 18331 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.533495 17781 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:52.535677 18283 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.565661 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.573069 16634 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:52.572667 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.553145 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.574892 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.575605 16632 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:52.552682 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.564957 16640 raft_consensus.cc:2410] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.576296 16638 raft_consensus.cc:2410] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.566973 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.569690 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:52.566699 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 89172.4us
I20260709 13:06:52.522002 18236 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:52.549147 18189 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:52.563982 18233 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.551713 18276 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.580358 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.581923 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.551373 18238 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:52.564388 18266 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.580025 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.564970 18145 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.564692 18235 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.585644 16604 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:52.587390 16454 leader_election.cc:400] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4.
I20260709 13:06:52.564376 18268 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.598392 16454 leader_election.cc:403] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.585516 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:52.590253 16634 raft_consensus.cc:2410] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.590684 18296 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:52.591400 18269 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:52.592429 18265 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:52.593061 18105 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:52.580945 18298 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:52.587877 18276 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.583321 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:52.583341 18233 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:52.585958 18248 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.567466 16631 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:52.571971 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:52.583663 18304 raft_consensus.cc:2764] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:52.598409 16484 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:52.606815 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.594934 18330 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.588729 18287 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:52.599357 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.598879 18271 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.627952 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:52.630486 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.591652 18164 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.634267 17182 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:52.609017 18328 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.634717 18328 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.627640 18233 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.635178 18328 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.636445 18266 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.614043 18236 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.637617 18236 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:52.638455 18236 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.579497 18312 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:06:52.584688 18189 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.603888 18314 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.640067 18254 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.640437 18254 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:52.641120 18254 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.598191 18114 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.612357 18238 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:52.641479 18233 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.642321 18254 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:52.611186 18327 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:52.644503 18233 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:52.644629 18287 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.646620 18287 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.647192 16637 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:52.651515 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.652725 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.653401 16489 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:52.653236 17781 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.654202 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.654754 16486 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:52.655539 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.656692 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.657505 17990 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.657656 18289 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.658124 18289 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:52.628257 18276 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.659005 18289 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.660231 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.661659 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.662168 16490 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:52.663234 18268 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.663713 18268 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.664362 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.647490 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.664604 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:52.667764 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:52.667994 18269 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.668399 18269 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.668733 18269 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.668399 16561 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:52.669930 16563 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:52.670997 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:52.671543 16560 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:52.603371 18235 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.628621 18311 raft_consensus.cc:2764] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:52.674081 18235 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.669209 16562 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:52.631194 18248 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.600780 18145 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.676192 18248 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.676433 18145 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.678234 16491 raft_consensus.cc:2368] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:06:52.629976 18279 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4.
I20260709 13:06:52.680684 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.682264 18266 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.682687 18266 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:52.683873 18238 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:52.684180 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 52379us
I20260709 13:06:52.684675 18238 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.685886 18238 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.687234 18323 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.641512 18189 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:52.656524 17981 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.687162 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.692273 16637 raft_consensus.cc:2376] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4. Re-sending same reply.
I20260709 13:06:52.688651 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.693136 16635 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:52.693562 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.693902 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.694895 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.695632 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:52.692292 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 110630us
I20260709 13:06:52.697852 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.687733 18323 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:52.700021 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.691104 16640 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:52.694149 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:52.700956 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.701334 16635 raft_consensus.cc:2410] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.702988 16491 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:52.703177 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.704097 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.704553 16486 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:52.704787 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.703097 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:52.705148 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.687906 16634 raft_consensus.cc:2955] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:52.706526 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.707037 16635 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.707821 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:52.705525 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 126024us
I20260709 13:06:52.717118 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.718648 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.698275 18173 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.693078 18248 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:52.725914 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.705804 18187 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.683414 18266 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.729539 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.706284 18279 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.705754 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.735976 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.737073 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.737317 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.737965 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:52.738320 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.738911 18296 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:52.731189 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 170459us
I20260709 13:06:52.738948 16488 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:52.710852 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.740484 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:52.744529 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.726162 18033 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.746384 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:52.726428 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.747937 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.727100 18173 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.748632 16491 raft_consensus.cc:2368] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:52.729329 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.730907 18199 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.735257 18187 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:52.726934 18335 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.760522 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.764999 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.763446 16562 raft_consensus.cc:2376] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4. Re-sending same reply.
I20260709 13:06:52.747340 18145 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.746217 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:52.748116 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:52.749246 17990 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.758190 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.740679 18248 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.761971 18187 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.740283 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:52.737895 16482 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:52.726908 18105 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:52.761649 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:52.759649 18267 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.775688 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.746815 18033 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:52.770359 18340 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.751184 18173 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.823810 18328 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.770442 18342 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.742358 18315 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:06:52.734081 18287 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.791354 16557 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:52.791679 17990 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:52.795060 17182 raft_consensus.cc:2410] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:52.796945 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.798118 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.799024 18314 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:52.750234 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.757470 16530 leader_election.cc:400] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:06:52.843192 16530 leader_election.cc:403] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.816483 16561 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:52.817217 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.803325 16558 raft_consensus.cc:2955] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:52.815423 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.825592 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:52.845266 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 87916.3us
I20260709 13:06:52.845911 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:52.829725 16635 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:52.811882 16631 raft_consensus.cc:2410] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.701928 18298 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.835002 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.835494 18328 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.836920 18276 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:52.885461 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 59939.7us
I20260709 13:06:52.886183 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:52.817946 17179 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:52.837659 18173 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.830663 18342 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:52.838651 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 224957us
I20260709 13:06:52.839640 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.763813 18199 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.826867 18033 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.815532 18267 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:52.854467 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.920850 16635 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.856236 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:52.844415 18314 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.856958 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.842162 17990 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.920037 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.919932 16456 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:52.800671 18283 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.827757 18136 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:52.857734 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.887095 18287 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:52.926506 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 100713us
I20260709 13:06:52.857470 18145 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.925225 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.928417 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:52.928993 16604 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:52.929203 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:52.887253 18340 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.918332 18264 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.904608 18164 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:52.936833 16638 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:52.941361 16635 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:52.945091 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:52.917214 18342 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.923872 18267 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.942137 16482 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:52.927726 18279 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.953661 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:52.931829 16487 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.926291 18328 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.960207 16635 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:52.801115 18323 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.935873 18145 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.924822 18102 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:06:52.934803 18296 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:06:52.955875 18315 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.973232 17152 leader_election.cc:400] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3.
I20260709 13:06:52.977032 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.979406 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.980458 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:52.982223 16560 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.981611 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:52.983134 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.992194 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.993307 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.994762 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:52.995858 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:52.996518 16488 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:52.973587 18145 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.970046 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:53.004527 16638 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:53.004544 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75632.1us
I20260709 13:06:52.983982 18114 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.974033 18328 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.006299 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:52.986524 18335 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.991622 18164 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:53.012936 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.001121 18349 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.948935 18264 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:52.995451 18235 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:53.007285 18332 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:06:53.024036 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:53.000866 18330 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:53.037406 16488 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:53.038147 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.038806 16488 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:53.029103 18328 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.030400 16560 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:53.024492 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.007874 18268 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:53.044121 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.024498 18248 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:53.047387 16636 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.009395 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:53.008657 18114 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.025269 18349 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:53.044337 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.046577 16560 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:53.045142 18164 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.036504 18236 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.051880 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:53.067215 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:53.069766 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:53.070421 16631 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:53.071302 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:53.072145 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.072702 16488 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.053047 18114 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.078614 16486 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.080389 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:53.060671 18335 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.060801 18136 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.084607 18264 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.085202 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.085774 16557 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.055501 18349 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.054142 18248 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.075614 16632 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.092706 16488 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:53.098105 18353 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.068956 18276 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.099175 16631 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.102871 18353 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:53.103864 18351 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:53.105041 18353 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.105562 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:53.106567 18283 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.106704 18164 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.107347 18164 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:53.107721 18164 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:53.108582 18187 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.108956 18164 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.110541 18187 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.111968 16640 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.106385 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.113929 18344 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.114418 18344 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.065671 18236 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:53.119500 18236 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.088532 18199 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:53.121181 16632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:53.121881 16632 raft_consensus.cc:606] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:53.122494 16632 raft_consensus.cc:614] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.130084 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:53.130694 16485 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:53.133124 18344 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.134140 18330 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.133241 17184 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.141736 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.142464 16562 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:53.143163 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:53.143390 18357 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:53.143637 16562 raft_consensus.cc:2376] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2. Re-sending same reply.
I20260709 13:06:53.144470 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.144937 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.145689 18264 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.146759 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:53.149471 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.151165 18264 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.152477 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.162662 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.144945 16562 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:53.170337 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.172187 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:53.160305 18189 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.184885 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.159765 16633 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:53.169409 18278 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.184617 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.191015 16562 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:53.175287 18264 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.197801 16634 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:53.187281 18335 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:53.202560 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.207415 16562 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:53.190725 18189 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.209903 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.213027 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.201766 18264 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.214383 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.205201 18276 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:53.205747 18331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.017s	sys 0.035s
I20260709 13:06:53.228250 17187 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:53.230938 18033 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.231784 17182 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:53.232347 18145 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.233004 18114 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.212369 18335 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:53.220939 18164 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.222899 18264 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.221908 18349 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.222754 18276 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:53.227473 18331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.017s	sys 0.035s
I20260709 13:06:53.240124 18145 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:53.254235 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.245250 18269 consensus_meta.cc:287] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.004s
I20260709 13:06:53.250541 18276 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.277594 17717 consensus_queue.cc:1059] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:53.280592 18238 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:53.285108 18326 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.490s	user 0.000s	sys 0.003s
I20260709 13:06:53.253309 18331 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:53.256668 18189 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.245831 18267 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.250120 18164 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.253800 17990 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.292209 18114 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:53.304731 18362 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:06:53.313304 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 50470.2us
I20260709 13:06:53.261884 18269 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.270572 18342 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.317826 18173 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.270269 18314 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.321336 16631 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:53.322719 16557 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:53.324106 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.324800 16557 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.326390 16635 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.323230 16559 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:53.327322 17153 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.746s (SENT) [suppressed 17 similar messages]
I20260709 13:06:53.289682 18331 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.334647 18105 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.335034 18105 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:53.337615 16557 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:53.338125 16637 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:53.332230 18366 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.062s	user 0.004s	sys 0.000s
I20260709 13:06:53.340324 16638 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.340533 16557 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.336125 18105 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.343832 18105 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.346920 18236 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.349512 16487 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:53.342499 18102 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:53.351084 18314 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:53.352885 18269 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.353691 18248 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.355372 18340 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:06:53.313975 18335 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.359056 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:53.359339 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.359644 16485 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:53.359778 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:53.362627 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.362730 16485 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.363133 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.363147 16485 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.358903 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:53.363209 16558 raft_consensus.cc:2376] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4. Re-sending same reply.
I20260709 13:06:53.369877 18342 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.369644 16485 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.370530 16485 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.370904 16562 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:53.371367 17717 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.372026 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.371841 17717 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.373215 16558 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.374449 17717 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:53.374964 18260 raft_consensus.cc:2955] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:53.376262 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:53.376892 16631 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.383289 18310 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:53.383522 18363 log.cc:927] Time spent T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:06:53.384019 16485 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:53.383311 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:53.385182 18267 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:53.384258 18367 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:53.389355 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:53.390417 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.391058 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.391059 16490 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:06:53.377631 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.392673 16529 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:53.387154 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:53.401955 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:53.403486 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:53.401978 16635 raft_consensus.cc:2368] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:53.406224 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:53.406797 16635 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.408387 16566 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.412670 16488 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.413621 16529 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:53.415422 17187 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:53.426335 16564 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:53.382426 18164 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.380208 18236 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.426522 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.428349 16529 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:53.412673 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.398273 18310 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.510778 16636 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:53.513046 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 74390.1us
I20260709 13:06:53.512673 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:53.449725 16635 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:53.415727 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:53.525403 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 99246.9us
I20260709 13:06:53.525682 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.417634 17183 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:53.528033 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 115420us
I20260709 13:06:53.528237 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.412652 18289 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:53.417836 18359 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:06:53.408775 18173 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.409483 18342 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:53.416257 17179 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.417091 18267 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.431510 18340 raft_consensus.cc:2764] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:53.416782 17981 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:53.532745 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.401319 18235 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:53.415380 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:53.420361 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:53.533037 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.432677 18281 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.413012 18033 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.512428 18268 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:53.544540 18105 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:53.416877 17184 raft_consensus.cc:2955] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:53.532672 18344 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.529613 18314 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.419010 18339 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:06:53.562032 16635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:53.559612 16563 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:53.533227 16482 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:53.513530 18199 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:53.532879 18283 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.532729 18114 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:53.533535 17180 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:53.601892 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.603169 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.573796 16635 raft_consensus.cc:606] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:53.604033 16635 raft_consensus.cc:614] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:53.576707 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 48538.9us
I20260709 13:06:53.539179 18349 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.547724 18279 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.532581 18136 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:53.549101 18289 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.563248 18269 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.613085 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.613051 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.570039 18235 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:53.605093 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:53.605664 16562 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:53.604053 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 43572.8us
I20260709 13:06:53.609539 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.609580 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:53.568465 17990 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.568765 17981 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.562935 17717 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:53.572216 18344 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.610723 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:06:53.577590 18259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.018s	sys 0.034s
W20260709 13:06:53.623195 18259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.018s	sys 0.034s
I20260709 13:06:53.572806 18030 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:53.618224 16485 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:53.623818 18344 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.624086 18030 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.624203 17981 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.626061 18030 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.619406 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:53.629822 16603 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.606853 18342 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.577271 18268 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.613248 18114 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:53.579864 18314 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.620952 18102 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.633378 18259 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.645370 18259 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.645704 18259 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.570758 18310 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.618081 18236 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:53.618177 18269 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.637634 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.655422 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.657234 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.658277 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:53.623819 18380 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.638715 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:53.639124 18283 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.665361 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:53.617676 18281 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:53.666927 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.660540 16488 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:53.637305 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:53.668694 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.669448 16561 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:53.670852 18381 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.671955 18381 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.649031 18312 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.669029 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.673310 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:53.650012 16631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:53.638276 18370 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:53.664458 18030 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:53.661293 18380 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.667900 18279 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.668042 18033 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.668514 18199 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.675020 18312 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.691540 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.682109 18236 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:53.681155 16631 raft_consensus.cc:606] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:53.683318 18279 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:53.684969 18030 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.700920 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.695722 18312 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:53.706665 18350 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.657s	user 0.000s	sys 0.005s
I20260709 13:06:53.674049 18289 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.740751 18236 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:53.712561 18269 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.713292 18381 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.675113 18235 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.717393 16633 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:53.728205 18040 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.745114 18040 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:53.745898 18040 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.746819 18040 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.744243 18030 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.749150 18381 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:53.749596 18381 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:53.681030 18283 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:53.695979 18114 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.699700 18343 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:53.721163 18314 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:53.760845 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1375) took 1743 ms. Trace:
I20260709 13:06:53.723003 17990 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.761674 17990 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:53.762506 17990 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.763464 17990 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.761917 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.765419 16489 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.725690 18264 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:53.727161 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.727481 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.728201 18086 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.729314 18268 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.729671 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:53.797423 16561 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.734012 16558 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:53.697211 18033 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.735723 18279 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.750381 18381 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.754371 18283 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:53.756362 18276 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.756708 18380 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:53.791709 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.891247 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:53.792114 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.800500 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:53.800966 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 127708us
I20260709 13:06:53.894273 16558 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:53.894856 16455 leader_election.cc:400] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:53.895180 16455 leader_election.cc:403] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.696408 18342 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.746430 18259 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.794312 18343 consensus_queue.cc:1243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:53.836838 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1603) took 1146 ms. Trace:
I20260709 13:06:53.906104 16637 rpcz_store.cc:276] 0709 13:06:52.690537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.697389 (+  6852us) service_pool.cc:224] Handling call
0709 13:06:52.796799 (+ 99410us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:06:53.836670 (+1039871us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54003a2854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:53.836788 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144948864}
I20260709 13:06:53.837890 18254 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:53.845140 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.858376 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1629) took 1037 ms. Trace:
I20260709 13:06:53.859308 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.931357 18173 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.865675 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:53.867079 16635 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:53.868449 16636 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.870529 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:53.871949 16640 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.874850 16486 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:53.877594 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:53.878682 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1620) took 1076 ms. Trace:
I20260709 13:06:53.956199 16565 rpcz_store.cc:276] 0709 13:06:52.802392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.815184 (+ 12792us) service_pool.cc:224] Handling call
0709 13:06:53.878495 (+1063311us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400210cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:53.878617 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689007360}
I20260709 13:06:53.941546 17179 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.881035 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:53.961702 16638 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:53.881880 18331 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:53.884639 18248 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:53.761229 16484 rpcz_store.cc:276] 0709 13:06:52.017830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.220292 (+202462us) service_pool.cc:224] Handling call
0709 13:06:52.567333 (+347041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.629844 (+ 62511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.760651 (+1130807us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400332cd0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:53.760790 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793592064}
I20260709 13:06:53.897614 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.834422 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1621) took 1019 ms. Trace:
W20260709 13:06:53.903596 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 111556us
I20260709 13:06:53.896562 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:53.795259 18086 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:53.905319 16558 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.744813 18236 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.939419 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.904702 18105 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.905719 18199 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 2. Current term is 3.
I20260709 13:06:53.911078 16634 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.946911 16560 raft_consensus.cc:2410] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.802141 18033 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:53.859915 16557 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.952968 18267 consensus_queue.cc:1059] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:53.937546 18335 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:53.904616 18268 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:06:53.959028 16563 raft_consensus.cc:2410] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:53.879436 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:53.905612 18287 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:06:53.908604 18283 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.968698 16491 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.952436 18235 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:06:53.969043 16564 rpcz_store.cc:276] 0709 13:06:52.815282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.842453 (+ 27171us) service_pool.cc:224] Handling call
0709 13:06:53.834250 (+991797us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540006d6d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:53.834366 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121877888}
I20260709 13:06:53.944209 18254 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:54.024438 18339 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:54.024964 18339 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.025660 18283 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:54.026461 17981 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.908511 18382 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:53.980602 16490 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.027362 18283 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.027702 18283 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:54.026921 18339 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:54.030826 18276 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.979982 18331 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.011049 18335 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.037813 18335 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.038033 18264 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:53.946389 16559 rpcz_store.cc:276] 0709 13:06:52.821062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.944821 (+123759us) service_pool.cc:224] Handling call
0709 13:06:53.858168 (+913347us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b540002ce54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:53.858317 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801639296}
I20260709 13:06:53.986244 16558 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:53.988557 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 92063.6us
I20260709 13:06:54.040921 18312 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.042843 16558 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:54.043139 16558 pending_rounds.cc:85] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 1
I20260709 13:06:54.043339 16558 pending_rounds.cc:107] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:54.043397 18312 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.003399 16488 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.935281 18378 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:54.002343 16604 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:53.957438 18173 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:54.056327 16489 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2.
I20260709 13:06:53.963899 18370 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.948712 18344 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.012975 18086 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:54.012926 18384 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:53.968961 18340 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:06:54.024869 18254 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.026819 17981 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:54.040103 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.003226 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.043951 16558 raft_consensus.cc:2889] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:54.091888 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.071323 16631 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:54.004916 18353 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:54.055320 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53056.6us
I20260709 13:06:53.968909 18248 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:53.964509 18380 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.976467 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:54.038065 18331 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.053030 18259 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:54.059293 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 134) took 1331 ms (client timeout 1625 ms). Trace:
I20260709 13:06:54.071085 16490 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:54.072033 16491 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:54.072736 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:53.979466 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.069829 18344 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:54.088856 18173 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.073802 16561 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:54.092265 16486 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.984998 16565 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:54.090736 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 453472us
I20260709 13:06:54.070261 18086 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.980775 18377 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:06:54.153465 18136 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.153805 18136 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:54.154536 18136 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.155402 18136 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.158353 18189 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.162329 18235 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.162842 18235 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.068472 18370 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.165335 18370 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.167181 16566 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:54.168444 16566 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.168535 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 111) took 1235 ms. Trace:
I20260709 13:06:54.168872 16557 rpcz_store.cc:276] 0709 13:06:52.933213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.342317 (+409104us) service_pool.cc:224] Handling call
0709 13:06:53.859734 (+517417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.002248 (+142514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.168371 (+166123us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540002ce50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:54.168486 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072253696}
I20260709 13:06:54.170382 18235 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.172199 17181 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.173593 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.174759 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:54.182204 18390 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:06:54.183245 18400 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:06:54.102733 18254 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.184500 18379 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.561s	user 0.003s	sys 0.000s
W20260709 13:06:54.188539 18391 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:54.189282 16566 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:54.189728 16566 pending_rounds.cc:85] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:06:54.111447 18331 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.194554 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.212821 16562 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:54.111557 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.213770 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:54.214713 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:54.215406 16565 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:54.111847 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 135448us
W20260709 13:06:54.216130 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.112353 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.219220 18238 consensus_queue.cc:1059] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:54.219833 16491 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:54.220198 18238 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:54.220709 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.221264 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.221728 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.222293 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.222682 16491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:54.223227 16491 raft_consensus.cc:606] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:06:54.113499 16489 rpcz_store.cc:269] 0709 13:06:52.727553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.727660 (+   107us) service_pool.cc:224] Handling call
0709 13:06:53.761793 (+1034133us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:06:54.059231 (+297438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3428096}
I20260709 13:06:54.057921 18394 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.117455 17717 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.118292 18259 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:54.224679 16489 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:54.118480 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.225310 16484 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:54.225641 16633 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.096161 18388 raft_consensus.cc:993] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:06:54.212832 18331 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.118739 18395 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:54.228250 18331 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:54.124050 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.219144 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:54.230209 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:54.230752 18238 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:54.231231 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:54.231647 18238 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.232738 18238 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.235321 16483 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:06:54.236258 18259 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.236718 18259 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.238538 18259 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:54.096714 18353 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.133136 18033 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.134773 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:54.135739 17187 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:54.069621 18279 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.145607 18310 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.147891 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.122399 16487 raft_consensus.cc:2376] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 2. Re-sending same reply.
W20260709 13:06:54.148999 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 282058us
I20260709 13:06:54.151800 18283 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.189742 16561 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:54.190263 16566 pending_rounds.cc:107] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:54.286983 16566 raft_consensus.cc:2889] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:54.192585 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69191.7us
I20260709 13:06:54.260630 18353 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.194041 16638 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.195082 16564 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:54.196421 16636 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.196534 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:54.196967 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.293800 16635 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:54.198184 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.294072 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:54.175691 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.294514 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:54.295112 16558 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:54.295579 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.147572 16486 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:54.048358 18339 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:54.209929 18105 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.210901 18370 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:54.232870 16490 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:54.299342 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.300017 16490 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
W20260709 13:06:54.300173 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 103714us
I20260709 13:06:54.300766 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.301095 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:06:54.301597 16488 raft_consensus.cc:606] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:54.301939 16490 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.300524 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.242056 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:54.245128 16483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 150) took 1421 ms (client timeout 1538 ms). Trace:
I20260709 13:06:54.126025 18164 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.240955 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:06:54.305017 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 54915.4us
I20260709 13:06:54.238473 18281 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.247337 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:54.238957 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.239022 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:54.306459 16632 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.245133 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:54.306816 16485 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:54.258994 16388 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:06:54.307715 16485 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.308245 16388 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 2 to 3, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.309806 16388 catalog_manager.cc:5697] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:06:54.138804 18248 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:54.279637 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.289713 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.314544 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.193490 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.290818 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:54.261853 18030 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.260520 18380 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.319276 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:54.320379 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:54.294610 16563 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.297580 17153 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:54.297788 16634 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:54.321833 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:54.298280 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.228299 18388 raft_consensus.cc:1081] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:06:54.303161 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:54.322492 16635 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.322633 16636 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:54.325728 16486 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.328051 16485 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:54.318228 16388 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:06:54.329828 16388 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.303516 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:54.299708 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.282908 17990 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:54.304515 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:54.306485 16640 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:06:54.307408 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62339.9us
I20260709 13:06:54.332996 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:54.314610 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.261978 16484 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.334816 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:54.315341 16562 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.313599 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:54.335767 16560 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:54.316279 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75392.7us
I20260709 13:06:54.337567 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:54.316992 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:54.299372 16565 raft_consensus.cc:2955] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:54.317047 16488 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:54.330960 16638 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:54.331709 16557 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:54.338070 16635 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:54.307456 18377 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.310887 18164 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:54.320269 18264 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.323881 18283 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.350694 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:54.317679 18254 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.348048 16486 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:54.346171 16388 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.317071 18335 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:54.279273 17981 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.373287 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:54.339259 18296 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:54.375332 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 77787.5us
I20260709 13:06:54.367523 18199 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.314282 18105 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.313166 18378 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:54.316668 18343 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:54.338924 18173 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.381409 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:54.381908 16388 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 2 to 3, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.346040 18380 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:54.323369 18381 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:54.355926 18396 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:54.385329 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46080.5us
I20260709 13:06:54.355883 18281 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.316464 18114 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:54.333719 18328 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:06:54.314199 18370 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.373391 18248 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.336686 18102 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:54.367630 18394 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.406630 18235 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:54.304997 16483 rpcz_store.cc:269] 0709 13:06:52.823528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.833968 (+ 10440us) service_pool.cc:224] Handling call
0709 13:06:53.879300 (+1045332us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:06:54.244978 (+365678us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54002995d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:54.245072 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524680832}
I20260709 13:06:54.374765 18377 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:54.338652 17990 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.388019 18264 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.386837 16484 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.380865 18136 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.401930 16388 catalog_manager.cc:5697] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:06:54.437216 16388 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:06:54.386410 18335 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.369257 18331 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.394227 18296 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:54.415467 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 112014us
I20260709 13:06:54.394749 16560 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:54.427140 16637 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:54.403833 18199 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:54.422412 18380 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.387928 18267 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.439522 16388 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.413185 18236 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.415853 18248 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:54.450058 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:54.412065 18281 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.425751 18394 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:54.453022 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:54.449833 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:54.455403 16388 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:06:54.446489 18296 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:54.515177 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 65183us
I20260709 13:06:54.437937 18235 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:54.516626 16388 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 3 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:54.530520 16388 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.517282 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:06:54.459285 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 110626us
W20260709 13:06:54.519230 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 68291us
I20260709 13:06:54.533197 16456 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:54.533281 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:54.437330 18339 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:06:54.539093 16388 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:06:54.542106 16388 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:54.454676 18236 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.543030 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 150748us
I20260709 13:06:54.613431 16560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:06:54.638345 16560 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:54.638703 16560 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.616199 18406 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:06:54.616466 18402 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:06:54.617009 18405 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 13:06:54.617599 18410 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:06:54.578466 18236 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.626509 18328 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.518188 18394 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.578207 18312 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.614362 18392 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.191s
I20260709 13:06:54.463696 18248 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.620118 18377 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.618462 18235 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.445746 18388 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:06:54.455327 18279 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:54.551261 18408 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:06:54.550853 18409 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:06:54.525055 18323 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.524742 18315 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.457094 18340 consensus_queue.cc:1059] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.202s
I20260709 13:06:54.543869 16388 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:54.662454 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 129321us
I20260709 13:06:54.664126 16632 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:54.443146 18264 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:54.668485 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.683578 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.554272 16635 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:54.703366 16637 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:54.516248 18256 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.142s
W20260709 13:06:54.784816 18393 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:54.708423 16558 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:54.712656 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 179449us
W20260709 13:06:54.717648 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 167820us
W20260709 13:06:54.724825 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.802249 16388 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.731833 18105 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.732575 17717 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.772709 18410 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:54.831970 16635 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:54.768635 18392 consensus_queue.cc:1243] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:54.796824 18328 raft_consensus.cc:993] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:06:54.819904 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:54.821477 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:54.726635 16560 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.822453 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:54.785326 18422 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.829078 17717 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.707994 18114 consensus_queue.cc:1243] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:54.830621 16486 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:54.734524 18312 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:54.818120 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:54.749852 18136 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:06:54.852286 16562 consensus_meta.cc:287] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.005s
I20260709 13:06:54.704576 18199 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.786923 18315 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.862310 16560 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:54.790251 18331 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:54.800069 18415 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.789139 18264 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:54.795166 18370 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.895886 16562 raft_consensus.cc:2410] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:54.903123 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:54.906916 16564 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:54.930878 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:54.931509 16564 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:06:54.920868 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 101056us
W20260709 13:06:54.933756 16563 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.002s
I20260709 13:06:54.934073 16563 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:54.934377 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:54.934860 16638 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.833907 18267 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:54.935144 16638 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:54.839453 17990 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:54.935684 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 133) took 1045 ms. Trace:
I20260709 13:06:54.936748 16562 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:54.840518 18340 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.937618 17717 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:54.789827 18382 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:06:54.803889 18323 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.948854 16562 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:54.942020 16639 rpcz_store.cc:276] 0709 13:06:53.890401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.893976 (+  3575us) service_pool.cc:224] Handling call
0709 13:06:53.930984 (+ 37008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.074472 (+143488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.074501 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.074944 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.303625 (+228681us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:54.303662 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.316254 (+ 12592us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b54003a2354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:54.316333 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.923142 (+606809us) raft_consensus.cc:1685] finished
0709 13:06:54.923163 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.935628 (+ 12465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14495,"raft.queue_time_us":31006,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4467,"spinlock_wait_cycles":191837056,"thread_start_us":186586,"threads_started":1,"wal-append.queue_time_us":288486}
I20260709 13:06:54.832479 18396 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:06:54.925601 18315 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.955691 16558 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.926997 18422 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:54.925182 18429 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:54.947146 16638 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:54.955090 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 153850us
I20260709 13:06:54.960139 17990 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:54.929175 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:54.941890 18339 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.922421 18173 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:06:54.945981 18276 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:54.960346 18030 consensus_meta.cc:287] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.632s	user 0.006s	sys 0.011s
I20260709 13:06:54.948360 18415 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:54.950533 18340 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.974169 18429 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:54.976848 18343 raft_consensus.cc:1081] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:06:54.954231 18427 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:54.979393 18279 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:55.002701 18420 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:06:54.992686 18276 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:54.983480 18030 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.002985 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:54.979620 16484 raft_consensus.cc:2376] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5. Re-sending same reply.
I20260709 13:06:55.002569 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.018524 17184 raft_consensus.cc:2410] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:55.018117 18422 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.019973 16491 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:55.020602 18403 log.cc:927] Time spent T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.632s	user 0.003s	sys 0.000s
W20260709 13:06:55.004012 18428 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:06:54.992972 16633 consensus_meta.cc:287] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.003s
I20260709 13:06:55.004253 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.012024 18415 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.000046 18264 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:54.980458 18339 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:54.999164 18136 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:55.015121 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.050159 18429 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:55.042958 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 134011us
I20260709 13:06:55.022526 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 160) took 1019 ms. Trace:
I20260709 13:06:55.017132 18279 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:55.051679 16491 rpcz_store.cc:276] 0709 13:06:54.003586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.311571 (+307985us) service_pool.cc:224] Handling call
0709 13:06:54.311852 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.020392 (+708540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.022307 (+  1915us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400258d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:55.022472 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628115328}
I20260709 13:06:55.044322 18433 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.073760 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.074378 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.080674 16565 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:55.074847 18369 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:55.076529 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.076596 16560 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.076536 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:55.039362 18394 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.079041 16558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:06:55.085459 16558 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:55.085788 16558 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.041460 16633 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:54.998503 18312 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.067411 18429 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.067176 17181 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 1.
I20260709 13:06:55.090266 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.017143 18267 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.115310 18298 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:55.047868 18264 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.088181 17182 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.115641 16558 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.120690 18298 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:55.116442 18429 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.122215 18264 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:55.127852 18276 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.133046 18323 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:55.123729 18440 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:06:55.086100 18382 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:55.157853 18298 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:55.147943 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65119.2us
W20260709 13:06:55.148254 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 71803.1us
I20260709 13:06:55.160274 16529 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:55.162124 16529 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:55.164496 16560 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:55.148531 16558 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.157516 18136 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.165643 16560 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.157794 18429 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:55.193281 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.083946 18433 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:55.167289 18238 consensus_meta.cc:287] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.934s	user 0.010s	sys 0.001s
I20260709 13:06:55.157447 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.217640 18438 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:55.220103 18432 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.220181 18438 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.162400 18173 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:55.169327 18264 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.163164 18427 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:55.166391 18136 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:55.168321 18114 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:55.228048 18264 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:55.140481 18279 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.161103 18315 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.230033 18173 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.225414 17181 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:55.246819 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.247478 17181 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:55.231498 18340 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.236204 18264 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:55.250490 18310 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.967s	user 0.009s	sys 0.009s
I20260709 13:06:55.258074 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:55.259052 18388 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.259416 18388 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.259712 18388 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.263286 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:55.267050 18236 consensus_meta.cc:287] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.553s	user 0.004s	sys 0.002s
I20260709 13:06:55.269703 18164 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.269837 18394 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:55.270697 18164 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.275993 16489 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:55.276742 16489 pending_rounds.cc:85] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:06:55.276974 16489 pending_rounds.cc:107] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:55.277181 16489 raft_consensus.cc:2889] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.253545 18339 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.234647 18427 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:55.287501 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.267421 18236 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.240572 18114 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.292438 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.295961 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:55.291880 18342 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.297869 18342 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:55.301939 18412 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.845s	user 0.002s	sys 0.002s
I20260709 13:06:55.303568 16482 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:55.279551 18344 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.279346 18382 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.313941 18344 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.315531 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.316162 17188 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:55.317116 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:55.276580 18369 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:06:55.316530 18382 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.319165 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.319895 18433 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:55.323612 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:55.325803 18296 consensus_meta.cc:287] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.796s	user 0.008s	sys 0.004s
I20260709 13:06:55.327910 18335 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.331509 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.332340 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.322700 18342 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.316049 18344 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:55.340270 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:55.340848 16484 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.345316 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.345877 16486 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:55.333313 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.355536 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.338923 18335 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.337960 18296 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.278975 18136 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:55.367923 18283 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.990s	user 0.009s	sys 0.009s
I20260709 13:06:55.367444 18259 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.386592 16491 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:55.374504 16482 raft_consensus.cc:2410] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:55.395933 16485 raft_consensus.cc:2955] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:06:55.404455 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.005s	sys 0.036s
W20260709 13:06:55.438055 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.036s
W20260709 13:06:55.438333 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 620249us
I20260709 13:06:55.444123 16634 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.445487 16632 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:55.453801 16566 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.374697 18335 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.454646 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:55.480129 16640 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:55.485913 16639 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.487641 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:55.437570 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.473287 18235 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.538767 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 61164.1us
I20260709 13:06:55.539484 17152 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:06:55.439208 18136 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.490921 18377 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:55.513046 18443 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.513213 18404 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:55.493068 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.513828 18447 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.514153 18312 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.491344 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:55.450310 18396 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.515673 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.512749 18341 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:06:55.512320 18283 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:06:55.545965 18173 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.452340 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1414) took 1346 ms. Trace:
I20260709 13:06:55.549453 18339 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:55.557614 18236 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:55.561573 18404 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.562055 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:55.450860 18259 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.572377 18331 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.550709 18235 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:55.654275 18415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.017s
I20260709 13:06:55.607276 18404 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.599267 16559 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:55.613639 16482 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.572814 18312 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.610307 18339 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:06:55.661922 18353 consensus_meta.cc:287] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.353s	user 0.009s	sys 0.009s
I20260709 13:06:55.555222 18431 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:06:55.638950 18114 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.583968 18396 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:55.678557 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 402608us
I20260709 13:06:55.565105 18377 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.665879 18429 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.691836 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:06:55.675554 18415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.008s	sys 0.017s
I20260709 13:06:55.682693 18387 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.695459 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:55.568951 18443 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.702673 18377 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:55.704793 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.705438 16559 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:55.706219 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:55.706916 16559 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 2: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:55.709010 17187 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.709580 16559 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.688961 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:55.708761 18199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.017s	sys 0.020s
I20260709 13:06:55.711877 16484 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:55.717157 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:55.716358 18199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.017s	sys 0.020s
I20260709 13:06:55.676493 18388 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.568487 18447 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.690773 18276 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:55.734298 16490 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:55.674084 18436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.030s
I20260709 13:06:55.703186 18387 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.751585 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.752218 16559 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:55.753326 18387 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.692360 18353 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:55.776333 16562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.013s	sys 0.033s
W20260709 13:06:55.776628 16562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.013s	sys 0.033s
I20260709 13:06:55.778915 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1423) took 1498 ms. Trace:
I20260709 13:06:55.735621 18296 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:55.757042 18436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.003s	sys 0.030s
I20260709 13:06:55.779258 16488 rpcz_store.cc:276] 0709 13:06:54.280795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.404546 (+123751us) service_pool.cc:224] Handling call
0709 13:06:54.404805 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.405125 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:54.731772 (+326647us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.288994 (+557222us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b48001a0658. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
0709 13:06:55.556824 (+267830us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b1800325540. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f06360334bc 00007f063338148b 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a
0709 13:06:55.604421 (+ 47597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.610670 (+  6249us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.610821 (+   151us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:55.610857 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.610920 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.778722 (+167802us) raft_consensus.cc:1685] finished
0709 13:06:55.778739 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.778864 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92013,"prepare.queue_time_us":372931,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":3468,"raft.queue_time_us":46175,"raft.run_cpu_time_us":8115,"raft.run_wall_time_us":888125,"spinlock_wait_cycles":58893440,"thread_start_us":386079,"threads_started":2,"wal-append.queue_time_us":442477}
W20260709 13:06:55.754834 18267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.004s	sys 0.069s
I20260709 13:06:55.772956 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.788895 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.781296 18335 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.774607 18429 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.744107 18264 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.788482 18446 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:55.823822 18267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.004s	sys 0.069s
W20260709 13:06:55.883764 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.787021 18427 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.822803 18283 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.824100 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:55.838284 18340 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.835786 18276 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.834646 18387 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.781662 18339 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.901922 16559 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:55.900391 16558 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:55.836226 16484 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:55.899463 18248 consensus_meta.cc:287] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 1.129s	user 0.011s	sys 0.000s
I20260709 13:06:55.908454 18248 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.887163 18446 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.910342 18248 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.911123 18446 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.911509 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1643) took 1005 ms. Trace:
I20260709 13:06:55.914182 16566 rpcz_store.cc:276] 0709 13:06:54.905718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.905805 (+    87us) service_pool.cc:224] Handling call
0709 13:06:54.906021 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.476304 (+570283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.911225 (+434921us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b540032aad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:55.911448 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259353856}
W20260709 13:06:55.908090 18465 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:55.901155 18283 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.918413 18283 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:55.918753 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1414) took 1015 ms. Trace:
I20260709 13:06:55.899748 18449 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.920004 18449 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:55.921871 18449 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:55.925431 18298 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.911758 18396 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:55.904567 18453 log.cc:927] Time spent T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:06:55.918315 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.919116 16561 rpcz_store.cc:276] 0709 13:06:54.903777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.903899 (+   122us) service_pool.cc:224] Handling call
0709 13:06:54.904165 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.939390 (+ 35225us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:54.960135 (+ 20745us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.251192 (+291057us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18000ed2e0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:06:55.566118 (+314926us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.566552 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.566675 (+   123us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.566875 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.567011 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.570185 (+  3174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.918561 (+348376us) raft_consensus.cc:1685] finished
0709 13:06:55.918581 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.918700 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34881,"prepare.queue_time_us":21896,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":375450,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":39015,"spinlock_wait_cycles":23464192,"thread_start_us":303365,"threads_started":1,"wal-append.queue_time_us":811197}
I20260709 13:06:55.932879 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:55.933408 16561 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.909503 18335 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:55.930851 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.888211 18259 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:55.902594 18448 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.300s	user 0.001s	sys 0.001s
I20260709 13:06:55.977192 16566 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:55.906339 18235 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:55.951959 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 245995us
I20260709 13:06:55.839402 18429 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:55.975513 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 280113us
I20260709 13:06:55.907943 18388 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:55.930051 18340 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.918432 16631 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:55.980943 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.994093 16566 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:55.994911 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:55.995393 16566 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.914614 16564 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:55.984283 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:55.996511 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:55.996542 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:55.999111 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:55.999593 16564 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.907006 18387 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:55.597931 16487 rpcz_store.cc:276] 0709 13:06:54.102919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.323682 (+220763us) service_pool.cc:224] Handling call
0709 13:06:54.355720 (+ 32038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.382035 (+ 26315us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:54.855512 (+473477us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.384306 (+528794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.385873 (+  1567us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.449120 (+ 63247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.449211 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.449345 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265,"prepare.queue_time_us":340138,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":114797,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11322,"thread_start_us":927714,"threads_started":3,"wal-append.queue_time_us":118752}
W20260709 13:06:55.983966 18466 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 13:06:55.986951 18470 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:06:55.976845 18276 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:55.981246 18312 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:56.025200 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.987671 18454 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:06:55.977232 18404 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.045737 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1411) took 1145 ms. Trace:
I20260709 13:06:55.993144 18235 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 13:06:56.034956 18424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.028s	sys 0.051s
I20260709 13:06:56.004681 18267 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.005023 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:56.030364 18468 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:56.054349 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.044149 18460 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:06:55.981815 18335 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:56.069438 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64495.9us
I20260709 13:06:56.055907 16557 rpcz_store.cc:276] 0709 13:06:54.900706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.901072 (+   366us) service_pool.cc:224] Handling call
0709 13:06:54.901413 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.938983 (+ 37570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.939010 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.946442 (+  7432us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.357612 (+411170us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:55.357649 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.357713 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.045517 (+687804us) raft_consensus.cc:1685] finished
0709 13:06:56.045538 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.045680 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42847,"raft.queue_time_us":40141,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4608,"thread_start_us":386029,"threads_started":1,"wal-append.queue_time_us":579961}
I20260709 13:06:56.045425 16566 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:56.059111 16561 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:56.060168 16564 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:56.063129 18264 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.044961 18449 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.002712 18340 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.045666 18353 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:56.067994 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:56.074131 16482 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:56.046443 18276 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.074045 18471 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.092482 18478 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.070477 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1424) took 1789 ms. Trace:
I20260709 13:06:56.093631 16485 rpcz_store.cc:276] 0709 13:06:54.281033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.404673 (+123640us) service_pool.cc:224] Handling call
0709 13:06:54.405103 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.405396 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.405420 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.259382 (+853962us) spinlock_profiling.cc:243] Waited 975 us on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:06:55.259939 (+   557us) log.cc:844] Serialized 540 byte log entry
0709 13:06:55.395804 (+135865us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:55.537291 (+141487us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.537479 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.537545 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.067108 (+529563us) raft_consensus.cc:1685] finished
0709 13:06:56.070322 (+  3214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.070426 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39295,"raft.queue_time_us":106,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":8579,"spinlock_wait_cycles":2241920,"thread_start_us":135561,"threads_started":1,"wal-append.queue_time_us":314024}
W20260709 13:06:56.069710 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.076687 18429 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.083699 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:56.100349 18463 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:06:56.100471 18298 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.100822 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:56.100968 18298 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.102574 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:56.089093 16488 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:06:56.077927 18424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.028s	sys 0.052s
W20260709 13:06:56.071487 18451 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:06:56.078850 18468 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.113243 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.070786 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:56.077692 18267 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.111323 18442 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.117818 18442 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.118204 18442 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.118515 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 136) took 1317 ms. Trace:
I20260709 13:06:56.118881 16637 rpcz_store.cc:276] 0709 13:06:54.801539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.802045 (+   506us) service_pool.cc:224] Handling call
0709 13:06:54.802323 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.835001 (+ 32678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.844406 (+  9405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.860759 (+ 16353us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.391359 (+530600us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.391404 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.391470 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.118309 (+726839us) raft_consensus.cc:1685] finished
0709 13:06:56.118328 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.118462 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28969,"raft.queue_time_us":31479,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":15589,"thread_start_us":440935,"threads_started":1,"wal-append.queue_time_us":754511}
W20260709 13:06:56.120844 18464 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:06:56.115089 18419 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:56.093037 18478 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:56.115267 18472 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:06:56.069063 18467 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.283s
I20260709 13:06:56.108314 18415 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.115453 18423 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.115489 18427 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.109383 18471 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:56.126778 18298 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.134682 18423 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:56.110414 18462 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.135354 18477 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.141774 18446 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.139302 18485 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.139729 18296 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.141498 18442 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.146649 18404 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:56.146994 18136 consensus_meta.cc:287] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.000s
W20260709 13:06:56.149060 18164 consensus_meta.cc:287] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.870s	user 0.004s	sys 0.004s
I20260709 13:06:56.149463 18312 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.149848 18388 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.150362 18328 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.125730 18468 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.123085 18267 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.090907 18449 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.153717 16565 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:06:56.184873 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.185453 16565 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:56.151991 18105 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:56.127090 16487 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:56.135951 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:56.186744 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.144964 18387 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.143044 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.150413 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:56.192436 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.193073 16565 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:06:56.152964 18427 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.143383 18445 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.178289 16557 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:56.146661 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:56.143113 18310 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.134455 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:56.161273 18477 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.154277 18462 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.179875 18459 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.154430 18423 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.172950 18340 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.143996 18235 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.181475 18328 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:56.197202 18445 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.203737 18328 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.204680 18328 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.206151 18462 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.179454 18485 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.179665 18312 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.171334 18296 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.200747 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.202572 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.215359 16557 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:56.164793 18446 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.212286 18404 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.194811 18164 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.194283 18427 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:56.219992 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 68616.4us
I20260709 13:06:56.185328 18388 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.222441 16484 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:56.199083 18136 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.222959 18276 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.202200 18310 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.224279 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:56.152678 18471 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:56.229888 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.188359 18105 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.237550 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:56.197803 17181 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:56.244556 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:56.209116 18392 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:06:56.204792 18445 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.208577 18387 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:06:56.209371 18235 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.202049 18459 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:56.294617 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.253243 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:56.436368 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.254334 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 128) took 1178 ms. Trace:
W20260709 13:06:56.551187 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 313684us
I20260709 13:06:56.213673 18423 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.553378 16562 rpcz_store.cc:276] 0709 13:06:55.076163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.084319 (+  8156us) service_pool.cc:224] Handling call
0709 13:06:55.084558 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.122440 (+ 37882us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:55.122659 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.776948 (+654289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.776994 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.777030 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.254122 (+477092us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b540006ccd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:56.254168 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.254283 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":542,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":111080,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":4714,"spinlock_wait_cycles":86632704,"thread_start_us":654027,"threads_started":1,"wal-append.queue_time_us":789766}
I20260709 13:06:56.631498 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:56.249903 18030 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.393s
I20260709 13:06:56.642966 18446 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.643217 18462 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.401243 18298 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.454285 17179 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:56.401430 18378 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:56.469098 18485 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.667721 18310 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.668053 17181 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.668874 18296 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.669569 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 412) took 1177 ms. Trace:
I20260709 13:06:56.458890 18276 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.697656 17188 rpcz_store.cc:276] 0709 13:06:55.492574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.668850 (+1176276us) service_pool.cc:224] Handling call
0709 13:06:56.669126 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.669295 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.669318 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.669354 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.669380 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.669426 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.669518 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.665611 18446 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.248517 18388 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:56.246652 18477 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.468786 18312 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.469919 18468 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.437748 18331 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:56.631881 18269 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.674259 16563 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:56.666899 18493 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.299510 18449 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.258942 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 395) took 1248 ms. Trace:
I20260709 13:06:56.383152 18033 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:56.643704 16487 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.244940 18164 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.644708 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 345) took 1155 ms. Trace:
I20260709 13:06:56.678411 17187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 352) took 1706 ms. Trace:
I20260709 13:06:56.702641 18388 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:56.683166 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 157) took 2737 ms. Trace:
I20260709 13:06:56.685321 18459 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:56.689905 18267 consensus_meta.cc:287] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.000s
I20260709 13:06:56.651153 18392 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.691375 18235 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.291628 18427 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.691958 16484 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 2: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:56.692260 18378 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.693535 17179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 346) took 1217 ms. Trace:
I20260709 13:06:56.246990 18136 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.674413 18462 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.676373 18298 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.622370 18442 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:56.697085 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.729827 16485 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:56.426012 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:56.697556 17181 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:56.706193 16563 pending_rounds.cc:85] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 2
I20260709 13:06:56.699316 18404 consensus_queue.cc:1243] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:56.680352 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:56.716403 17187 rpcz_store.cc:276] 0709 13:06:54.972645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.972788 (+   143us) service_pool.cc:224] Handling call
0709 13:06:54.973044 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.710243 (+737199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.678192 (+967949us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54005140d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:56.678358 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692197632}
I20260709 13:06:56.709264 18269 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.718501 16489 rpcz_store.cc:276] 0709 13:06:53.945492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.225311 (+279819us) service_pool.cc:224] Handling call
0709 13:06:54.225552 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.279189 (+1053637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.682920 (+1403731us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002e40d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:56.683095 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415020928}
I20260709 13:06:56.700637 18276 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.711918 18493 consensus_queue.cc:1243] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:56.701774 18446 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.727308 18105 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:56.731169 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 107709us
I20260709 13:06:56.733309 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.727176 17981 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.735044 16563 pending_rounds.cc:107] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:56.709457 18331 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.714809 18033 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:56.737344 17185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 400) took 1666 ms (client timeout 1569 ms). Trace:
I20260709 13:06:56.742408 16563 raft_consensus.cc:2889] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:56.750898 17185 rpcz_store.cc:269] 0709 13:06:55.071352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.071457 (+   105us) service_pool.cc:224] Handling call
0709 13:06:56.680207 (+1608750us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b58001e0998. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:06:56.737273 (+ 57066us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22478720}
I20260709 13:06:56.721812 18388 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.743975 18298 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.716109 17183 rpcz_store.cc:276] 0709 13:06:55.476317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.225915 (+749598us) service_pool.cc:224] Handling call
0709 13:06:56.226211 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.226393 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.226420 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.236857 (+ 10437us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.242759 (+  5902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.255849 (+ 13090us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.622117 (+366268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.742343 16485 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:56.749586 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.754391 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.754910 16485 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:56.749979 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:56.711091 17182 rpcz_store.cc:276] 0709 13:06:55.010380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.012807 (+  2427us) service_pool.cc:224] Handling call
0709 13:06:55.017897 (+  5090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.149508 (+131611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.258672 (+1109164us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b5400610dd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:56.258858 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141269888}
I20260709 13:06:56.722970 18392 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.722442 18267 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.738016 16483 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.747967 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.739645 18269 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:56.752964 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 129195us
I20260709 13:06:56.756542 17717 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.725142 17179 rpcz_store.cc:276] 0709 13:06:55.476572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.243753 (+767181us) service_pool.cc:224] Handling call
0709 13:06:56.438769 (+195016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.676543 (+237774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.693465 (+ 16922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.759389 16631 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:56.761235 16489 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:56.774971 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 170) took 1039 ms. Trace:
I20260709 13:06:56.765368 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:56.753835 18404 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.766122 17717 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:56.767019 18500 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.767213 18136 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.767720 18331 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.768088 18438 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.768244 18446 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.768419 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 397) took 1724 ms. Trace:
I20260709 13:06:56.768560 16484 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:56.793056 17184 rpcz_store.cc:276] 0709 13:06:55.044744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.046725 (+  1981us) service_pool.cc:224] Handling call
0709 13:06:55.125050 (+ 78325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.140424 (+ 15374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.146979 (+  6555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.149728 (+  2749us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:55.155747 (+  6019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.157098 (+  1351us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.768220 (+1611122us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54005843d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:56.768366 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83711872}
I20260709 13:06:56.793761 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.794368 16484 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:56.794265 18503 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.795492 17981 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.768939 18427 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.769347 18433 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.757783 18281 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.796342 18433 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.768005 18033 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.760708 16482 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:56.773818 18378 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.775691 16638 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.766970 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:56.800804 16639 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:06:56.775309 16489 rpcz_store.cc:276] 0709 13:06:55.735211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.754958 (+1019747us) service_pool.cc:224] Handling call
0709 13:06:56.761044 (+  6086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.774757 (+ 13713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.774923 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.776952 17717 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.777611 18404 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.778649 18500 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.801980 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.802521 16489 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:56.779348 18267 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.779909 18462 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.782455 16487 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:56.762136 17181 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.806648 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:56.807103 17181 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.807166 16559 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.809176 18404 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.785010 16483 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:56.805729 18189 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.812948 18189 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.813393 16483 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.813733 16483 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:56.814410 16483 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:56.814961 18479 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.744s	user 0.010s	sys 0.005s
I20260709 13:06:56.800781 18484 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.803772 18446 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:06:56.816035 16559 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:56.802750 18289 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.817523 18289 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:56.817137 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.818259 18289 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.818897 16559 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:56.820148 18433 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:56.786779 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:56.787815 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:56.790337 16634 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.795389 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.820395 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.822201 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:56.796733 18328 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 13:06:56.772681 18276 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.770234 18388 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.796691 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1430) took 1410 ms. Trace:
I20260709 13:06:56.798173 17188 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:56.799028 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.803135 18500 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:56.805122 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:56.795390 18269 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:56.784673 18392 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:56.785835 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:56.810458 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:56.815490 18484 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:56.819381 18289 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.791828 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:56.880441 18496 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.017130 18496 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:56.976595 18475 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.933s	user 0.001s	sys 0.011s
I20260709 13:06:57.017844 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:56.962239 18315 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:56.975083 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.019204 18496 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:57.019575 17185 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:57.020341 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.020269 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.021377 16483 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.868705 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.022533 18342 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.819710 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.023177 18342 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.024055 16566 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:57.024468 18478 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.025286 16487 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:57.025792 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.026322 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.026895 16637 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.009922 18462 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.027617 18462 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.029309 18443 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:57.030845 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 129) took 1865 ms. Trace:
I20260709 13:06:57.031177 16558 rpcz_store.cc:276] 0709 13:06:55.165515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.170055 (+  4540us) service_pool.cc:224] Handling call
0709 13:06:55.170383 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.904110 (+733727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.030642 (+1126532us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400411c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:57.030795 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660368128}
I20260709 13:06:57.032130 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.032299 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.033236 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.033529 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.033906 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.034070 17187 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:57.034850 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:56.868494 18267 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:57.036214 18265 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.974558 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:57.036427 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.037777 17186 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 1.
I20260709 13:06:56.819406 18268 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.037119 18265 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:57.038256 18268 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:57.039045 18268 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.034618 16639 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:57.040115 18268 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.040750 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1645) took 2133 ms. Trace:
I20260709 13:06:57.040910 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.041081 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.041931 16604 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.042068 18267 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.042734 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.043627 16558 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:57.043848 18503 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.044251 18503 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:57.044490 18323 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.044620 18503 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.046222 17981 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.046623 17981 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.036518 18447 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.036456 18033 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.048446 18033 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:57.050058 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.041118 16563 rpcz_store.cc:276] 0709 13:06:54.907418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.934628 (+ 27210us) service_pool.cc:224] Handling call
0709 13:06:54.953462 (+ 18834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.751603 (+1798141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.040535 (+288932us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400210cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:57.040675 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3935464320}
I20260709 13:06:57.051606 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.051956 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.052587 16563 raft_consensus.cc:2368] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5.
I20260709 13:06:57.052440 18450 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:57.053314 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.053237 18450 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.053540 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.043524 18189 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.054088 17187 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:57.053902 18450 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:57.054778 18450 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.055713 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 165) took 1609 ms. Trace:
I20260709 13:06:57.043483 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.057183 18238 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.057631 18238 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:57.054713 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.058341 17186 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:57.058486 18238 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.059698 18436 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.060099 18436 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:57.060461 18436 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.060652 18462 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.057730 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.056087 16488 rpcz_store.cc:276] 0709 13:06:55.446611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.804734 (+358123us) service_pool.cc:224] Handling call
0709 13:06:56.088948 (+284214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.107448 (+ 18500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.055543 (+948095us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54000e7750. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:57.055661 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652930304}
I20260709 13:06:57.062091 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.057950 18382 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:57.050733 18456 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.999s	user 0.011s	sys 0.002s
I20260709 13:06:57.053833 18323 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.064020 18342 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.065897 18323 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.065697 18415 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:57.062347 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:57.067037 17981 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.067833 18415 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:57.068236 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:57.068790 16488 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:57.069304 17981 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.023583 18500 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.069546 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:57.069880 18500 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.071987 18500 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:57.072433 16636 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:57.072603 18500 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.073102 18500 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:57.073406 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.073704 18443 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:57.074074 16637 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:57.073917 18500 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.074215 18443 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.037954 17717 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:06:57.074905 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.077319 18382 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:56.770483 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:57.077827 18382 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:57.075346 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.076246 18443 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.091849 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.097100 16563 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:06:57.085505 17180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 408) took 1920 ms. Trace:
I20260709 13:06:57.098937 16637 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:57.097577 17180 rpcz_store.cc:276] 0709 13:06:55.164956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.676542 (+511586us) service_pool.cc:224] Handling call
0709 13:06:55.728630 (+ 52088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.821880 (+ 93250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.837956 (+ 16076us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.982598 (+144642us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.170275 (+187677us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:56.195677 (+ 25402us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.206704 (+ 11027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.034697 (+827993us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18003a9a80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:06:57.084696 (+ 49999us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b18003a9a80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419
0709 13:06:57.085195 (+   499us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b54004b8f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:57.085239 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.085291 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:57.085303 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.085447 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2547,"prepare.queue_time_us":8319,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1797,"raft.queue_time_us":33852,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":12202,"spinlock_wait_cycles":139174400,"thread_start_us":99651,"threads_started":1,"wal-append.queue_time_us":193476}
I20260709 13:06:57.089608 18164 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.079730 18382 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:57.093278 16491 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.100870 16491 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:57.099082 16563 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:57.101631 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:57.084718 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 171) took 1307 ms. Trace:
I20260709 13:06:57.083760 18335 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:57.090468 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.103392 18462 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:57.103961 16639 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:57.103869 18462 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:57.104911 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.105485 16639 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:57.089730 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:57.077256 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:57.081344 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:57.101588 16491 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.106803 16564 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.106879 16482 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:57.107326 16491 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.107820 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:57.100485 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.108320 18462 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:57.108994 16633 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:57.102445 16485 rpcz_store.cc:276] 0709 13:06:55.777515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.755621 (+978106us) service_pool.cc:224] Handling call
0709 13:06:56.755945 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.757076 (+  1131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.757103 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.762395 (+  5292us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.810607 (+ 48212us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.810645 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.810707 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.084544 (+273837us) raft_consensus.cc:1685] finished
0709 13:06:57.084563 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.084671 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":802,"raft.queue_time_us":896,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":3089,"thread_start_us":11091,"threads_started":1,"wal-append.queue_time_us":303196}
I20260709 13:06:57.115482 16564 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:06:57.102676 16563 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.106005 18382 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:57.116865 16636 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.023299 16565 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:57.119272 18450 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:57.120841 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.121536 18450 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:57.044608 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:57.122218 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.122169 17717 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.122823 18265 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:57.122391 16558 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.016498 17188 pending_rounds.cc:85] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 5
I20260709 13:06:57.124219 17188 pending_rounds.cc:107] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:57.124665 17188 raft_consensus.cc:2889] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.128865 16637 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:57.129108 16491 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:57.129431 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:57.129565 17717 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.141434 17717 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.840903 16638 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
W20260709 13:06:57.129115 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 337363us
I20260709 13:06:57.130738 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:57.026198 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:57.123318 16631 raft_consensus.cc:2368] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5.
I20260709 13:06:57.146909 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:56.822130 16559 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:57.133359 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 925) took 1035 ms. Trace:
I20260709 13:06:57.133838 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.021389 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.121315 18323 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.022604 16557 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:56.822511 16484 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:57.150694 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 75846.6us
I20260709 13:06:57.151736 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.152266 16636 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:57.131399 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:57.140175 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 80572.4us
I20260709 13:06:56.929486 18344 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:56.964903 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:57.142817 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:57.146865 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.148046 16491 rpcz_store.cc:276] 0709 13:06:56.098193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.631238 (+533045us) service_pool.cc:224] Handling call
0709 13:06:57.093169 (+461931us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b54000f1020. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648ee18 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6
0709 13:06:57.133307 (+ 40138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102664448}
I20260709 13:06:57.116575 16564 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:57.166268 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:57.130156 16490 rpcz_store.cc:276] 0709 13:06:55.386491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.452749 (+ 66258us) service_pool.cc:224] Handling call
0709 13:06:55.716637 (+263888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.742045 (+ 25408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.796525 (+1054480us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003322d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:56.796642 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606257408}
I20260709 13:06:57.167178 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:57.148533 16561 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:57.132313 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.172204 16632 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:57.155687 18323 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:57.156957 16638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 936) took 2209 ms (client timeout 2117 ms). Trace:
I20260709 13:06:57.172916 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:57.173154 16638 rpcz_store.cc:269] 0709 13:06:54.933606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.934158 (+   552us) service_pool.cc:224] Handling call
0709 13:06:56.771764 (+1837606us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b58001973d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f06363e70aa 00007f0636469447 00007f0636481fe7 00007f06364837de 00007f063648f27c 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c
0709 13:06:57.143263 (+371499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4006769536}
I20260709 13:06:56.964356 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:57.157809 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.157564 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.138034 18265 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:57.159436 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.185668 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 360) took 1262 ms. Trace:
I20260709 13:06:57.142588 16487 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:57.140887 18030 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:57.159382 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.191365 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.173908 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:57.174117 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 112074us
I20260709 13:06:57.198372 17185 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:57.181511 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:06:57.231102 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 49666.3us
I20260709 13:06:57.184084 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.186115 17188 rpcz_store.cc:276] 0709 13:06:55.923172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.701208 (+778036us) service_pool.cc:224] Handling call
0709 13:06:56.704919 (+  3711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.125059 (+420140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.185432 (+ 60373us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5400593654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:57.185614 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213746944}
I20260709 13:06:57.185875 17717 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.186627 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:57.232556 16561 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.231724 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.181147 16640 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:57.234197 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:57.166512 18344 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.225445 18387 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.159957 18445 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.236145 18387 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:57.236330 18164 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:57.209739 16558 raft_consensus.cc:2410] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:57.236593 18387 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.237355 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.165869 18396 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.159996 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:06:57.212095 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 52770.5us
I20260709 13:06:57.238900 18396 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.171538 18328 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.239068 17183 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 1.
I20260709 13:06:57.239500 18503 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.240173 16565 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.240839 17717 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:57.240969 18445 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:57.232477 16564 raft_consensus.cc:2410] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:57.242863 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.200866 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.176467 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.171061 18267 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:57.226761 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 88486.9us
I20260709 13:06:57.185281 18433 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.189842 18462 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.200378 17184 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.188671 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 931) took 1084 ms. Trace:
I20260709 13:06:57.239089 18344 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:57.186141 17182 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.231334 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.422907 17185 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:57.428082 16491 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
W20260709 13:06:57.393211 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 260057us
W20260709 13:06:57.359187 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 167874us
I20260709 13:06:57.402908 16561 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:57.211329 17981 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.216540 18478 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.444933 17153 leader_election.cc:400] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5.
I20260709 13:06:57.436311 16529 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:57.445806 17153 leader_election.cc:403] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.235952 18335 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.447655 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1426) took 2100 ms. Trace:
I20260709 13:06:57.447988 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:06:57.452431 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:57.449309 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.242326 18396 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.454448 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.451606 16486 rpcz_store.cc:276] 0709 13:06:55.347540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.358884 (+ 11344us) service_pool.cc:224] Handling call
0709 13:06:55.455845 (+ 96961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.456029 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:55.456284 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.780111 (+1323827us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b180042ec80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:06:57.022328 (+242217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.022376 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:57.022415 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.022484 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.447500 (+425016us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b54002986d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:57.447607 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":121,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":76,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":274722432,"thread_start_us":241751,"threads_started":1,"wal-append.queue_time_us":1560469}
I20260709 13:06:57.241591 18503 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:57.456327 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.459420 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.490274 16632 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:57.439080 17990 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.444811 18462 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.465121 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:57.496255 16561 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:57.438853 18415 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:06:57.436339 18276 raft_consensus.cc:2764] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:06:57.456815 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.446301 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:57.391163 18164 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:57.429205 18328 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:57.538071 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.223799 18323 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.226161 16633 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:57.450043 18267 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:57.538789 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 92564.7us
I20260709 13:06:57.445477 17981 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.483390 18344 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:57.565610 18512 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:57.575655 16529 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:57.563185 18328 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.576316 18344 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:57.577591 18344 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:57.537575 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 72529.9us
I20260709 13:06:57.575919 17981 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.580041 16603 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:57.428968 16484 rpcz_store.cc:276] 0709 13:06:56.099469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.821894 (+722425us) service_pool.cc:224] Handling call
0709 13:06:56.822176 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.156497 (+334321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.184215 (+ 27718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.566401 18323 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.565423 16604 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.501928 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:57.457367 18269 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:57.453858 18335 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:57.458257 18431 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.379400 16483 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:57.231312 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.595450 16603 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:57.618321 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 116480us
I20260709 13:06:57.615929 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:57.616110 18353 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.537971 17990 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.620529 18267 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.501344 18388 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.563721 18462 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.581159 18424 raft_consensus.cc:2764] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:57.586176 18105 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:57.620429 16482 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:57.581599 18323 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.454584 17180 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
W20260709 13:06:57.687084 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 91699.8us
I20260709 13:06:57.687574 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:57.616611 18335 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.694051 16559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.016s
W20260709 13:06:57.625085 18515 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:06:57.616851 18431 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:57.455919 18478 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:57.623694 16483 pending_rounds.cc:85] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 2
W20260709 13:06:57.625509 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 177581us
W20260709 13:06:57.712301 16566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.031s	sys 0.064s
W20260709 13:06:57.727485 16566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.033s	sys 0.065s
W20260709 13:06:57.711891 18516 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.526s	user 0.001s	sys 0.000s
I20260709 13:06:57.675905 17183 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.686450 18267 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:57.718021 16559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.007s	sys 0.016s
W20260709 13:06:57.722230 16557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.015s
W20260709 13:06:57.737212 16557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.003s	sys 0.015s
I20260709 13:06:57.625595 18259 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.715687 17187 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
W20260709 13:06:57.712368 17181 consensus_meta.cc:287] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.903s	user 0.006s	sys 0.002s
I20260709 13:06:57.701320 18512 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:57.717132 18380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.014s	sys 0.010s
I20260709 13:06:57.730283 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.730953 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:57.730962 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.736379 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:57.717703 18388 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:57.731966 16483 pending_rounds.cc:107] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:57.727502 18431 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.802088 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 97255.6us
W20260709 13:06:57.809638 18523 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:57.810111 17184 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:57.812407 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:06:57.819440 18387 consensus_meta.cc:287] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.004s
I20260709 13:06:57.823439 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:57.737561 18265 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.749496 18259 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:57.827386 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 246667us
I20260709 13:06:57.737692 18524 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.749353 18267 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.801152 16637 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:57.841794 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 140393us
W20260709 13:06:57.803041 18380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.015s	sys 0.012s
I20260709 13:06:57.710412 18164 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.803071 16483 raft_consensus.cc:2889] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.760686 18512 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.819780 18387 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:57.901057 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.901237 16637 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:06:57.750435 18424 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:06:57.840736 18259 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.821273 18377 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5.
W20260709 13:06:57.901400 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 368044us
I20260709 13:06:57.843267 17181 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:57.841195 18315 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.908898 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:57.901785 16636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.009s	sys 0.001s
I20260709 13:06:57.899936 18265 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:57.909080 18436 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.843s	user 0.008s	sys 0.001s
I20260709 13:06:57.913658 18545 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:57.892035 16633 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.916357 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:57.957489 16558 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.927623 16636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.010s	sys 0.001s
I20260709 13:06:57.929924 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.931039 16486 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:57.958616 16564 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:06:57.931761 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.956399 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.962242 16564 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:57.964982 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.971728 16558 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:57.972602 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.966794 16564 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:57.930186 18315 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.979326 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:57.980010 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 934) took 1830 ms. Trace:
W20260709 13:06:57.960340 18444 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:06:57.891438 18524 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:57.905422 18512 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:57.963001 18414 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:57.990285 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:58.012144 16564 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.911936 17182 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:57.959882 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 929) took 1857 ms. Trace:
I20260709 13:06:57.973259 16558 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:58.006358 16561 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:57.914916 18533 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:06:58.006732 16488 rpcz_store.cc:276] 0709 13:06:56.149735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.115023 (+965288us) service_pool.cc:224] Handling call
0709 13:06:57.115302 (+   279us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:57.115632 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.115657 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:57.116288 (+   631us) log.cc:844] Serialized 52 byte log entry
0709 13:06:57.154121 (+ 37833us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.154401 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.202420 (+ 48019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.202494 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.973914 (+771420us) raft_consensus.cc:1685] finished
0709 13:06:57.973933 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.979958 (+  6025us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63676,"prepare.queue_time_us":21611,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5385,"raft.queue_time_us":57146,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":13159,"thread_start_us":37489,"threads_started":1,"wal-append.queue_time_us":92346}
I20260709 13:06:57.966161 17181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 347) took 2486 ms. Trace:
W20260709 13:06:58.038282 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 122833us
I20260709 13:06:57.958295 18436 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.054780 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:58.076462 16558 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:57.963156 18527 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.010536 18315 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.074028 18267 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:57.960812 18545 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.075744 17181 rpcz_store.cc:276] 0709 13:06:55.476810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.667506 (+1190696us) service_pool.cc:224] Handling call
0709 13:06:56.667918 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.929333 (+1261415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.963305 (+ 33972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.075114 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 415) took 1090 ms. Trace:
I20260709 13:06:57.928151 18388 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.084007 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:58.100096 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 373348us
I20260709 13:06:58.101073 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:58.072945 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:58.092682 16563 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:58.080596 16564 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:58.101752 16559 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 2.
I20260709 13:06:58.102072 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:58.102902 16564 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:58.081655 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:58.077195 16482 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:06:58.099133 18507 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.655s	user 0.000s	sys 0.000s
I20260709 13:06:58.089967 18552 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:58.054798 18535 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:06:58.052821 16483 rpcz_store.cc:276] 0709 13:06:56.099040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.812988 (+713948us) service_pool.cc:224] Handling call
0709 13:06:56.813277 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.915336 (+1102059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.956314 (+ 40978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.116124 18549 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:06:58.122531 18522 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:06:58.120468 18528 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:06:58.107940 18546 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:06:58.151124 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 50370.7us
I20260709 13:06:58.099486 17182 rpcz_store.cc:276] 0709 13:06:56.964562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.964671 (+   109us) service_pool.cc:224] Handling call
0709 13:06:58.054472 (+1089801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.161252 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:58.108711 18484 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.130689 17990 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:58.183717 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 127239us
I20260709 13:06:58.140296 18534 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:58.188611 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:58.163913 18387 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.129050 18552 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.196065 18478 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.180585 18546 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.198297 18546 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:06:58.200484 18539 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:06:58.201876 18529 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
W20260709 13:06:58.203104 18544 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:06:58.203759 18289 consensus_meta.cc:287] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 1.176s	user 0.004s	sys 0.005s
I20260709 13:06:58.206512 18323 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.208433 18267 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.208827 18033 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.209797 18545 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.212164 18265 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.213860 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1681) took 1073 ms. Trace:
I20260709 13:06:58.215544 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1636) took 1090 ms. Trace:
I20260709 13:06:58.216799 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 938) took 1181 ms. Trace:
I20260709 13:06:58.214293 16557 rpcz_store.cc:276] 0709 13:06:57.154595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.154971 (+   376us) service_pool.cc:224] Handling call
0709 13:06:57.155315 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:57.155856 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.155883 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:57.180947 (+ 25064us) log.cc:844] Serialized 52 byte log entry
0709 13:06:57.737552 (+556605us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:57.737589 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.737648 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.213616 (+475968us) raft_consensus.cc:1685] finished
0709 13:06:58.213649 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.213794 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":526641,"threads_started":1,"wal-append.queue_time_us":692790}
I20260709 13:06:58.199266 18335 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.215899 16636 rpcz_store.cc:276] 0709 13:06:57.125544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.161571 (+ 36027us) service_pool.cc:224] Handling call
0709 13:06:57.161822 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.174756 (+ 12934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.174785 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.175286 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.959963 (+784677us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.960026 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.960131 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.215363 (+255232us) raft_consensus.cc:1685] finished
0709 13:06:58.215381 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.215494 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":12575,"thread_start_us":729320,"threads_started":1,"wal-append.queue_time_us":734144}
I20260709 13:06:58.228039 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 928) took 2129 ms. Trace:
I20260709 13:06:58.228392 16489 rpcz_store.cc:276] 0709 13:06:56.098832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.803062 (+704230us) service_pool.cc:224] Handling call
0709 13:06:56.803342 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.803620 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.803650 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.804039 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.130964 (+326925us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.152340 (+ 21376us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.152524 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.152588 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.227860 (+1075272us) raft_consensus.cc:1685] finished
0709 13:06:58.227878 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.227989 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37741,"prepare.queue_time_us":21980,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":23262,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":21736,"spinlock_wait_cycles":11678976,"thread_start_us":315080,"threads_started":1,"wal-append.queue_time_us":410170}
I20260709 13:06:58.231771 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1675) took 1415 ms. Trace:
I20260709 13:06:58.232349 18436 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.217084 16635 rpcz_store.cc:276] 0709 13:06:57.034981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.035086 (+   105us) service_pool.cc:224] Handling call
0709 13:06:57.035376 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.035697 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:57.230096 (+194399us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.565447 (+335351us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.585965 (+ 20518us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.586103 (+   138us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.586134 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.586206 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.216665 (+630459us) raft_consensus.cc:1685] finished
0709 13:06:58.216677 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.216761 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22,"prepare.queue_time_us":408563,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1473,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":66,"thread_start_us":436004,"threads_started":2,"wal-append.queue_time_us":494725}
W20260709 13:06:58.211674 18462 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.001s
I20260709 13:06:58.232123 16566 rpcz_store.cc:276] 0709 13:06:56.816807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.024616 (+207809us) service_pool.cc:224] Handling call
0709 13:06:57.024894 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.130450 (+105556us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:57.144634 (+ 14184us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.728355 (+583721us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.798192 (+ 69837us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.798328 (+   136us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.798361 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.798430 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.231592 (+433162us) raft_consensus.cc:1685] finished
0709 13:06:58.231610 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.231719 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105210,"prepare.queue_time_us":13989,"raft.queue_time_us":177907,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":19264,"spinlock_wait_cycles":14567680,"thread_start_us":543421,"threads_started":1,"wal-append.queue_time_us":749765}
I20260709 13:06:58.235450 18547 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:58.236418 18536 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.218508 18548 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:06:58.190521 18534 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.258908 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.262851 18446 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.199672 17183 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:58.260278 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1639) took 1117 ms. Trace:
I20260709 13:06:58.293622 16638 rpcz_store.cc:276] 0709 13:06:57.143317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.259560 (+1116243us) service_pool.cc:224] Handling call
0709 13:06:58.259830 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.259993 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.260017 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.260056 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:58.260084 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.260132 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.260221 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.258335 16640 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:58.296150 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.262956 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 179) took 1130 ms. Trace:
I20260709 13:06:58.265307 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1683) took 1102 ms. Trace:
I20260709 13:06:58.300243 16565 rpcz_store.cc:276] 0709 13:06:57.162936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.163035 (+    99us) service_pool.cc:224] Handling call
0709 13:06:57.240013 (+ 76978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.240539 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.265137 (+1024598us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b54001c9650. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:58.265257 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175107968}
I20260709 13:06:58.261257 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.302220 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.257534 16639 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:58.254835 17981 consensus_meta.cc:287] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.002s
I20260709 13:06:58.255410 18524 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.253265 18553 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:58.275705 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.189419 17990 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.286325 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.265921 18335 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.291425 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1448) took 1513 ms. Trace:
W20260709 13:06:58.291906 18328 consensus_meta.cc:287] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.715s	user 0.006s	sys 0.012s
I20260709 13:06:58.291630 18392 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.290832 18030 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:58.305536 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.294799 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.316701 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.316991 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.315274 16487 rpcz_store.cc:276] 0709 13:06:56.778037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.214601 (+436564us) service_pool.cc:224] Handling call
0709 13:06:57.214845 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.215007 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:57.486626 (+271619us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.291121 (+804495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.291171 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:58.291212 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.291274 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.291377 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347468,"prepare.queue_time_us":14148,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":764762,"threads_started":2,"wal-append.queue_time_us":654503}
I20260709 13:06:58.320859 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.322028 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.320933 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:58.325105 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.326349 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.292244 18446 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:58.274529 18462 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.297560 16631 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:58.315451 18396 consensus_meta.cc:287] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.808s	user 0.005s	sys 0.004s
I20260709 13:06:58.340610 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.341331 16635 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:58.323318 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:58.342902 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 159418us
I20260709 13:06:58.343623 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:58.310446 18534 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.349306 18558 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:58.348793 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 160385us
I20260709 13:06:58.353756 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:06:58.360850 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:58.351905 18548 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:06:58.307324 18549 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:58.355017 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:58.339115 18533 raft_consensus.cc:2764] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:58.334012 18553 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:58.366016 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.366494 18265 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.366271 18553 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.367231 18558 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.367522 18545 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.368018 18545 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:58.369297 18514 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.885s	user 0.003s	sys 0.000s
I20260709 13:06:58.369917 18545 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.370836 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.371194 17180 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.371554 17180 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:58.372296 17180 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.342079 18396 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.373207 17180 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.374426 18396 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.374995 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.347949 18335 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:58.377185 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.377490 18545 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.378053 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:58.377987 18545 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.378657 17182 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.379901 18545 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.367666 18558 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.384021 18558 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:58.384510 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 886316us
I20260709 13:06:58.385135 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.385775 18289 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.386122 16456 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.386925 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.387230 18289 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.330960 18392 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.330801 18328 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.330284 18030 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.359966 17187 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.337277 18552 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.387634 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.361608 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:58.307145 17981 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.411063 16488 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.411839 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.412036 17981 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.412452 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 177) took 1285 ms. Trace:
I20260709 13:06:58.412930 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.355082 18512 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.413936 16633 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:58.387606 18289 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.415383 18289 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.415441 18512 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.308423 17990 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.433486 17990 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.309048 18259 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.435464 18259 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.332108 18436 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:58.346710 18323 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.372767 18546 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.437530 18546 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:58.437942 18546 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:58.439391 18520 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.950s	user 0.001s	sys 0.000s
I20260709 13:06:58.390645 16634 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:58.447631 16632 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:58.361716 17188 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:58.391487 16455 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 2.225s (SENT) [suppressed 21 similar messages]
W20260709 13:06:58.395723 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 88365.3us
I20260709 13:06:58.393301 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.452050 16637 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:58.452900 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.453810 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.454798 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.456067 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.377236 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1420) took 2454 ms. Trace:
I20260709 13:06:58.408349 16603 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:06:58.458068 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 49796.8us
I20260709 13:06:58.458496 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:58.352671 18431 consensus_meta.cc:287] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.004s
I20260709 13:06:58.459324 18431 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.461318 18431 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.464576 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1678) took 1647 ms. Trace:
I20260709 13:06:58.457535 16560 rpcz_store.cc:276] 0709 13:06:55.923296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.112525 (+189229us) service_pool.cc:224] Handling call
0709 13:06:56.117864 (+  5339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.121811 (+  3947us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:56.132313 (+ 10502us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.079282 (+946969us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b180033fa00. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:06:57.094942 (+ 15660us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180033fa00. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:06:57.203492 (+108550us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.205332 (+  1840us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.205444 (+   112us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:57.484428 (+278984us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.714596 (+230168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.714672 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.368832 (+654160us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:06:58.377042 (+  8210us) raft_consensus.cc:1685] finished
0709 13:06:58.377062 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.377185 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23610,"prepare.queue_time_us":523396,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":15342,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":51699,"spinlock_wait_cycles":15882752,"thread_start_us":601668,"threads_started":3,"wal-append.queue_time_us":1274212}
I20260709 13:06:58.464954 16562 rpcz_store.cc:276] 0709 13:06:56.817527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.125265 (+307738us) service_pool.cc:224] Handling call
0709 13:06:57.125531 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.125710 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.125734 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.126088 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.211158 (+ 85070us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.212022 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.212096 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.438879 (+1226783us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:06:58.464296 (+ 25417us) raft_consensus.cc:1685] finished
0709 13:06:58.464317 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.464517 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8465664,"thread_start_us":50452,"threads_started":1,"wal-append.queue_time_us":241708}
I20260709 13:06:58.466473 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.467473 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.467949 16637 raft_consensus.cc:2376] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3. Re-sending same reply.
I20260709 13:06:58.418538 18328 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.394341 18484 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:58.472681 18484 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.474002 18500 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.474512 18484 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.418912 17181 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:58.419262 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.476102 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.477144 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.478163 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.447554 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.479118 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.412787 16488 rpcz_store.cc:276] 0709 13:06:57.126956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.055503 (+928547us) service_pool.cc:224] Handling call
0709 13:06:58.055805 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.411398 (+355593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.412254 (+   856us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54002995d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:58.412406 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816617728}
I20260709 13:06:58.420058 18382 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.479627 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.480050 18382 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:58.480515 18382 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.480301 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.481277 16488 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:58.482164 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.480540 18377 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.483286 16631 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:58.484488 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.485546 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.486646 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.422184 18030 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.423339 18289 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.364439 18446 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.388392 18315 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.388144 18450 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:58.407536 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45994.3us
I20260709 13:06:58.448205 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1642) took 1291 ms. Trace:
I20260709 13:06:58.298727 16482 rpcz_store.cc:276] 0709 13:06:57.132802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.124677 (+991875us) service_pool.cc:224] Handling call
0709 13:06:58.125009 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.125226 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.125258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.125709 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.190415 (+ 64706us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.214705 (+ 24290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.225152 (+ 10447us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.234705 (+  9553us) raft_consensus.cc:1685] finished
0709 13:06:58.238160 (+  3455us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.262898 (+ 24738us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":57099,"threads_started":1,"wal-append.queue_time_us":74446}
I20260709 13:06:58.485648 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.454746 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.430015 17180 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:58.420662 18392 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.490394 17182 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:58.488883 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.387952 18449 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.480376 16635 raft_consensus.cc:2410] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:58.502226 18500 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:58.421252 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:58.492326 18546 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.601781 18446 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:58.602245 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 181187us
I20260709 13:06:58.574497 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:58.603250 17187 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.602490 16386 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:58.604135 16386 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 4, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.605510 16386 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 2 to 4, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:58.606941 16386 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 4, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.607942 18546 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.608770 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.608525 16386 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 4, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.610220 18500 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:58.610584 18500 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:58.611023 16386 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:06:58.611732 18289 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.611491 18500 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.612385 18449 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:58.612654 18521 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.926s	user 0.005s	sys 0.005s
I20260709 13:06:58.609354 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.613277 16640 raft_consensus.cc:2368] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5.
I20260709 13:06:58.614141 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 936) took 2441 ms. Trace:
I20260709 13:06:58.614254 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.574899 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:58.615480 17184 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:58.615731 18560 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.261s	user 0.003s	sys 0.007s
I20260709 13:06:58.614552 16485 rpcz_store.cc:276] 0709 13:06:56.172833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.115214 (+942381us) service_pool.cc:224] Handling call
0709 13:06:57.115473 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.128204 (+ 12731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.128230 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.141978 (+ 13748us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.388152 (+246174us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:57.430256 (+ 42104us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.263689 (+833433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.263755 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.612091 (+348336us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:06:58.613906 (+  1815us) raft_consensus.cc:1685] finished
0709 13:06:58.613991 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.614093 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":972758,"prepare.queue_time_us":55341,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":54,"raft.queue_time_us":849406,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3749,"spinlock_wait_cycles":7751936,"thread_start_us":206993,"threads_started":1,"wal-append.queue_time_us":460330}
I20260709 13:06:58.615669 18315 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.616829 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.619287 16485 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:58.619625 18450 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:58.620191 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.620539 18450 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.621346 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.621867 16485 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
W20260709 13:06:58.622463 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.624012 18392 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:58.627472 18449 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.592309 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:58.595376 18353 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:58.629484 18353 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.629886 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:58.630571 18388 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.614934 16635 raft_consensus.cc:2368] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6.
I20260709 13:06:58.629496 18527 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.567400 18555 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:58.632711 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.618366 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.618481 18550 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:58.633400 16640 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:58.622087 16634 rpcz_store.cc:276] 0709 13:06:57.156622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.225013 (+ 68391us) service_pool.cc:224] Handling call
0709 13:06:58.390176 (+1165163us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:06:58.390357 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.447949 (+ 57592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.448140 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3159424}
I20260709 13:06:58.622633 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.634289 16485 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.634485 16640 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.638128 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 224) took 5876 ms. Trace:
I20260709 13:06:58.597033 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.623817 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.624486 16631 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:58.624655 16633 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:58.574916 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:06:58.641997 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 67163.9us
I20260709 13:06:58.642100 18546 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.642513 18546 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:58.642863 18546 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.643940 16562 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:58.644559 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:58.644966 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:58.645489 16562 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.645613 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:58.645991 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:58.609721 17188 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:58.623772 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.644165 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:58.647572 16565 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:58.647508 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.649004 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.649506 18328 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.649721 16640 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:58.649904 18328 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:58.650323 18328 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.650791 17717 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:06:58.650750 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.651597 16640 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:58.651770 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.653163 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.653785 16636 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:58.654081 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.656733 18328 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.657652 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.658267 16487 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:58.658761 18328 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.659082 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.659301 18030 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.651322 16562 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:58.659869 18030 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.660115 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.660513 18030 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.612686 16386 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 2 to 4, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.664379 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 180) took 1526 ms. Trace:
I20260709 13:06:58.664872 16483 rpcz_store.cc:276] 0709 13:06:57.137840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.160652 (+1022812us) service_pool.cc:224] Handling call
0709 13:06:58.190344 (+ 29692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.384633 (+194289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.384663 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.385089 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.664037 (+278948us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.664081 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.664149 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.664195 (+    46us) raft_consensus.cc:1685] finished
0709 13:06:58.664205 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.664316 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185652,"raft.queue_time_us":188150,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"thread_start_us":278603,"threads_started":1,"wal-append.queue_time_us":275965}
I20260709 13:06:58.512833 18382 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.667047 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:58.667964 18388 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:58.668681 16484 raft_consensus.cc:1217] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Deduplicated request from leader. Original: 1.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:06:58.668859 18323 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.669302 18323 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:58.669595 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.669312 16484 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:06:58.617957 18462 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.667928 17717 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.669687 18323 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.672169 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.609532 16637 raft_consensus.cc:2368] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
W20260709 13:06:58.676927 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 285445us
I20260709 13:06:58.677105 17717 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.632853 18445 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.678208 18396 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.612777 18500 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.678680 18396 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.679401 18323 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.680584 18396 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.668668 18382 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.681718 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:58.681830 18323 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.682443 17717 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.682816 17717 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:58.683211 17717 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:58.683413 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.684706 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.688097 18392 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:58.689417 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.690037 16634 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:58.690717 17981 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.690613 18289 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.694427 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.614890 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1454) took 1540 ms. Trace:
I20260709 13:06:58.695581 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.663082 16386 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 4, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.695948 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.696687 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.697625 18484 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.731957 16386 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.699693 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:58.700711 16635 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.701201 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 181) took 1559 ms. Trace:
I20260709 13:06:58.703222 17187 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:06:58.703583 18447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.010s	sys 0.003s
W20260709 13:06:58.705724 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56412.7us
I20260709 13:06:58.735316 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:58.707845 16487 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:58.710417 18353 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.711685 18503 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.703181 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.726536 18414 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.726897 18380 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:58.714141 18315 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:58.760950 18315 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.762825 18315 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.638499 16388 rpcz_store.cc:276] 0709 13:06:52.805851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.823875 (+ 18024us) service_pool.cc:224] Handling call
0709 13:06:58.638062 (+5814187us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:55.149059 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:55.215943 (+ 66884us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:55.216768 (+   825us) write_op.cc:435] Acquired schema lock
0709 13:06:55.218783 (+  2015us) tablet.cc:662] Decoding operations
0709 13:06:55.309403 (+ 90620us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:55.309468 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:55.309497 (+    29us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:06:55.310655 (+  1158us) tablet.cc:701] Row locks acquired
0709 13:06:55.310676 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:55.310813 (+   137us) write_op.cc:270] Start()
0709 13:06:55.310930 (+   117us) write_op.cc:276] Timestamp: P: 1783602415310768 usec, L: 0
0709 13:06:55.310953 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:55.311686 (+   733us) log.cc:844] Serialized 6628 byte log entry
0709 13:06:56.143384 (+831698us) op_driver.cc:464] REPLICATION: finished
0709 13:06:56.618279 (+474895us) write_op.cc:301] APPLY: starting
0709 13:06:56.618368 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:56.618708 (+   340us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:56.618836 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:56.620515 (+  1679us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:56.620787 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:06:56.620835 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:56.621185 (+   350us) log.cc:844] Serialized 119 byte log entry
0709 13:06:56.662180 (+ 40995us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.696946 (+ 34766us) write_op.cc:454] Released schema lock
0709 13:06:56.698776 (+  1830us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:56.713188 (+ 14412us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:56.714610 (+  1422us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2702,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":474626,"apply.run_cpu_time_us":3879,"apply.run_wall_time_us":87305,"num_ops":17,"prepare.queue_time_us":271137,"prepare.run_cpu_time_us":40524,"prepare.run_wall_time_us":626688,"raft.queue_time_us":186644,"raft.run_cpu_time_us":11210,"raft.run_wall_time_us":104941,"replication_time_us":820267,"thread_start_us":721406,"threads_started":4,"wal-append.queue_time_us":613499,"wal-append.run_cpu_time_us":48764,"wal-append.run_wall_time_us":1696714}]]}
W20260709 13:06:58.717724 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 71886.4us
I20260709 13:06:58.713656 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.763613 16491 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.718281 18462 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.768462 18462 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.769328 18353 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.770346 18462 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:58.770928 18433 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.771108 18431 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:58.771801 17183 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:58.771659 18431 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.714250 18536 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:58.772625 18536 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:58.773438 18536 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.774181 18431 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.666824 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.692580 16455 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:58.770843 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.720037 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.720659 16485 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
W20260709 13:06:58.725687 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.776105 16636 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:58.778131 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.778357 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.779129 16485 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:58.779922 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.667060 18030 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.727618 16486 rpcz_store.cc:276] 0709 13:06:57.074207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.456857 (+382650us) service_pool.cc:224] Handling call
0709 13:06:57.457131 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.958487 (+501356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.614698 (+656211us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54002774d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:58.614841 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089524480}
I20260709 13:06:58.645218 16529 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:58.728081 17717 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.720678 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:06:58.781124 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 135984us
I20260709 13:06:58.731570 16633 raft_consensus.cc:2376] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5. Re-sending same reply.
W20260709 13:06:58.781787 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 89265.8us
I20260709 13:06:58.782337 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.734592 16489 rpcz_store.cc:276] 0709 13:06:57.142017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.229961 (+1087944us) service_pool.cc:224] Handling call
0709 13:06:58.230249 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.396596 (+166347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.396625 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.397038 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.697380 (+300342us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.697424 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.697935 (+   511us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.699747 (+  1812us) raft_consensus.cc:1685] finished
0709 13:06:58.699763 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.701148 (+  1385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174998,"raft.queue_time_us":176049,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":300006,"threads_started":1,"wal-append.queue_time_us":299862}
I20260709 13:06:58.719091 18267 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:58.719020 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 174) took 1613 ms. Trace:
I20260709 13:06:58.742286 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.742822 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:58.798219 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55989.6us
I20260709 13:06:58.798593 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:58.798826 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 78223.9us
I20260709 13:06:58.799693 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:58.747248 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.712807 18342 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:58.751878 16638 raft_consensus.cc:2368] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6.
I20260709 13:06:58.751155 18503 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:58.736492 17184 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:06:58.754169 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:58.831456 16635 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:58.736270 18289 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.732831 17981 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.751243 18388 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:58.732108 18449 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:58.736974 18447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.010s	sys 0.003s
I20260709 13:06:58.765024 16637 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:58.765880 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.779028 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:58.783625 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:58.784049 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:58.731616 16632 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:58.841837 16562 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.784895 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:58.841843 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62879us
I20260709 13:06:58.783599 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:06:58.842543 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.843168 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.785001 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.843658 16489 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:58.787765 16563 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.788254 16558 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.842132 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.786628 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:58.751735 18269 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:58.788909 16488 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:58.788975 16529 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:06:58.775130 16631 raft_consensus.cc:2368] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:06:58.796453 18238 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:58.796588 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.777438 18380 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:58.797207 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.774717 18414 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.789290 18328 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.801595 16530 leader_election.cc:400] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6.
I20260709 13:06:59.052356 16530 leader_election.cc:403] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.798514 16561 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:58.803759 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.824360 17717 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:58.826876 16638 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:58.757573 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.774497 18536 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.056032 17981 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:58.836882 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:58.803421 18462 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:58.840835 16634 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:58.777055 16491 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:59.057673 18289 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:06:59.058403 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.059446 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:58.843762 17187 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.060501 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.845016 16487 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.844120 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:58.844434 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:58.847764 16562 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
W20260709 13:06:58.849763 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 60846.9us
W20260709 13:06:58.850131 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 63561.9us
I20260709 13:06:59.064786 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:59.063309 16486 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:06:59.065225 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:58.849036 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:06:58.837116 18531 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:58.852910 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.780213 18546 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.869549 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:06:58.870848 18503 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:58.831101 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:58.841118 18555 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.797873 16484 rpcz_store.cc:276] 0709 13:06:57.105725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.589351 (+483626us) service_pool.cc:224] Handling call
0709 13:06:57.718109 (+128758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.670444 (+952335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.718804 (+ 48360us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540004fbd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:06:58.718967 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170147584}
W20260709 13:06:58.911520 18588 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:58.915104 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:59.088485 17179 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:58.835352 18342 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:58.851770 18553 raft_consensus.cc:2764] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:58.821372 18267 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:58.958336 18568 log.cc:927] Time spent T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:06:58.830760 18396 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:58.780572 18550 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:06:59.037457 17152 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:59.113330 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 75927.4us
I20260709 13:06:58.849824 18268 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.849464 16483 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:59.038197 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:58.853885 18436 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.044346 16485 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:58.834595 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:59.135704 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 97579.9us
I20260709 13:06:59.136132 16559 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.066269 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:59.069597 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 268113us
I20260709 13:06:59.069850 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.070576 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.072098 16491 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:06:59.073074 18030 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:59.075287 18586 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.249s	user 0.007s	sys 0.000s
I20260709 13:06:59.035307 18446 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.080667 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:06:59.143436 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 62837.8us
I20260709 13:06:59.143569 16488 raft_consensus.cc:2410] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:59.078305 18269 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:59.087107 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 250293us
I20260709 13:06:59.087424 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.040102 18484 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:59.152335 18484 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.086328 18503 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.090368 16604 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:06:59.154943 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64646.5us
I20260709 13:06:59.095167 16560 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.101126 16490 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:06:59.158200 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.159232 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:59.159931 16490 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:59.160620 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:59.074302 18583 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.226s	user 0.005s	sys 0.014s
I20260709 13:06:59.087018 18433 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:59.163151 18414 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:59.076689 18335 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.110364 18396 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:59.109241 18380 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.095118 16482 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 3: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:59.086535 18555 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.135201 17185 raft_consensus.cc:2368] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:06:59.083217 18289 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.144345 16455 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.141101 18436 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:06:59.147823 16605 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:59.147935 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:59.149230 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:59.177721 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.178511 16489 raft_consensus.cc:2410] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:59.161512 17717 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:59.162563 18312 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.154361 18328 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.156864 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:59.191087 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:59.162746 16487 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:59.134222 18549 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.146674 18500 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.195189 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:59.181529 16559 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:59.184641 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.196389 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:59.188340 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.192371 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.197332 16487 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:59.178764 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.193789 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.198894 16487 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:59.198855 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.153749 18030 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:06:59.203269 16455 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.174808 18449 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:59.182870 18436 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.204820 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:59.200155 18553 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.206080 16489 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:59.203672 16487 pending_rounds.cc:85] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 1
I20260709 13:06:59.145993 18268 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.208053 17717 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:59.226940 17717 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:59.191721 18445 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.210518 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.211123 16485 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.202488 18433 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.175786 18555 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.225026 16487 pending_rounds.cc:107] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:59.198449 18527 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:59.193034 18462 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:06:59.208956 16604 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:06:59.263437 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 54553.1us
I20260709 13:06:59.227662 17717 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.265493 17717 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.231675 16489 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.202589 17981 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.211596 18566 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.234651 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.205767 18328 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.203179 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.242270 16640 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:06:59.205826 18563 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:06:59.243211 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:59.199223 18414 consensus_queue.cc:1059] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:06:59.208418 18550 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.213032 18444 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:59.295635 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 61063.2us
I20260709 13:06:59.245759 18387 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.296408 16455 leader_election.cc:400] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5.
I20260709 13:06:59.296710 16455 leader_election.cc:403] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:59.198956 18289 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.262712 16484 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 2.
I20260709 13:06:59.212962 17183 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:59.270336 18512 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.213231 18312 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:59.212292 18500 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:59.268776 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 204196us
I20260709 13:06:59.242538 16487 raft_consensus.cc:2889] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:59.304742 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.304894 16487 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.306767 16487 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.285712 16485 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:06:59.285231 18527 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:59.313407 18500 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:59.261932 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.292956 16637 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:59.294946 16483 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:06:59.309577 18444 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5.
I20260709 13:06:59.314604 18527 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.316531 18595 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.298825 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.316828 18312 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.321892 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:59.323050 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:59.324116 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:59.269150 17981 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.214412 18269 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.326793 16485 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.331616 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:59.332002 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:59.334697 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.298323 18328 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.242259 18396 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:06:59.600353 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 462383us
I20260709 13:06:59.358428 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.603950 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:59.606129 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.606372 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.608081 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.388624 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.609261 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.610039 16560 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:59.388162 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.449841 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:59.596206 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.612350 16562 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.601918 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1472) took 1107 ms. Trace:
I20260709 13:06:59.335178 16487 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.621484 16488 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:59.622972 16488 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.623806 16562 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:06:59.388363 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.393131 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.617028 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1473) took 1120 ms. Trace:
I20260709 13:06:59.399114 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.349076 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:06:59.625876 16486 rpcz_store.cc:276] 0709 13:06:58.496410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.615757 (+1119347us) service_pool.cc:224] Handling call
0709 13:06:59.616233 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.616618 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.616645 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.616701 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:59.616726 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.616776 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.616862 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:59.346628 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.629158 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 280015us
I20260709 13:06:59.625974 16563 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:59.631114 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1466) took 1137 ms. Trace:
I20260709 13:06:59.399472 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.616314 16485 rpcz_store.cc:276] 0709 13:06:58.494759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.329187 (+834428us) service_pool.cc:224] Handling call
0709 13:06:59.600813 (+271626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.601315 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.601371 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.601442 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.601489 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.601576 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.601717 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.630024 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1470) took 1135 ms. Trace:
I20260709 13:06:59.634250 16485 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.635190 16487 rpcz_store.cc:276] 0709 13:06:58.493393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.307363 (+813970us) service_pool.cc:224] Handling call
0709 13:06:59.334882 (+ 27519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.617629 (+282747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.630680 (+ 13051us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b5400400450. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:59.630922 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62689152}
I20260709 13:06:59.633953 16482 rpcz_store.cc:276] 0709 13:06:58.494327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.623543 (+129216us) service_pool.cc:224] Handling call
0709 13:06:59.629525 (+1005982us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54000cc1d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:06:59.629843 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487927040}
I20260709 13:06:59.607590 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:59.635987 16605 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:06:59.647006 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:59.373780 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:59.603966 16559 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:06:59.649163 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:59.649874 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:59.651165 16632 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:59.347626 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:59.651643 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:06:59.653258 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:59.317816 18030 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.338s
I20260709 13:06:59.334518 17981 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.373960 18433 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.285s
I20260709 13:06:59.453249 18353 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.680301 16636 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:06:59.382637 17717 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.302s
I20260709 13:06:59.326215 18531 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.685570 18353 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.686604 18512 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:59.687327 18512 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:59.465333 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 267435us
I20260709 13:06:59.686539 18531 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:59.698179 18531 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.699460 18531 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.707908 18353 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:06:59.709244 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.709885 18566 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:59.710537 18566 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:59.710202 16564 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:59.712158 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.705768 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:06:59.462119 18592 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:59.559803 18553 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:59.409489 18590 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:06:59.539738 18598 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:06:59.367635 18585 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:06:59.366602 18593 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:06:59.308595 18550 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:06:59.562243 18596 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:06:59.496361 18597 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.731902 18602 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.336094 18267 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:59.727380 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.333787 18289 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.564885 18546 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:59.747325 18550 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.750180 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 436) took 1115 ms. Trace:
W20260709 13:06:59.751924 18335 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.002s
I20260709 13:06:59.495088 18268 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:59.743965 16559 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.756858 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:06:59.763391 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 116618us
I20260709 13:06:59.731941 18238 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.752513 18335 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6.
I20260709 13:06:59.767020 16563 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:59.764638 16634 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:06:59.770319 18259 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:06:59.772019 18447 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:59.772449 18447 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:59.773350 18267 raft_consensus.cc:2764] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:59.773824 18447 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.750698 17182 rpcz_store.cc:276] 0709 13:06:58.635067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.635253 (+   186us) service_pool.cc:224] Handling call
0709 13:06:58.635547 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.714650 (+ 79103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.714701 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.715294 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.829286 (+113992us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.829334 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.829415 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.749654 (+920239us) raft_consensus.cc:1685] finished
0709 13:06:59.749702 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.749946 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78694,"raft.queue_time_us":81346,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":104,"thread_start_us":113567,"threads_started":1,"wal-append.queue_time_us":477259}
I20260709 13:06:59.776611 18603 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.777150 18603 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:06:59.777321 16561 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.777599 18603 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.780109 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.780303 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.780515 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.781286 16561 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:06:59.478041 18555 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.783337 18597 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.792307 18597 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:06:59.793478 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.795015 18553 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:06:59.795970 16491 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.796617 18553 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.801972 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:59.802188 18553 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.803290 18392 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.803690 18392 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:06:59.804860 18392 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:59.805768 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.806025 18392 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.806742 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:06:59.807554 16636 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:59.736485 18512 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.352463 18462 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.823618 16565 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:59.775583 18447 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:59.806197 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.805689 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:06:59.832628 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.820175 16482 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:59.835131 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.728538 18566 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.841333 16640 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:06:59.835743 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.859211 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 251880us
I20260709 13:06:59.851689 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:06:59.869551 18484 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.715s	user 0.014s	sys 0.000s
I20260709 13:06:59.870044 18484 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:06:59.874171 18436 consensus_meta.cc:287] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.006s
I20260709 13:06:59.874586 18436 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.877055 16563 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.878185 16563 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.879094 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:06:59.880321 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:06:59.880839 16563 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.881193 18335 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:06:59.881708 18335 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:06:59.858242 18238 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:59.850966 18555 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:06:59.918670 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 72754us
W20260709 13:06:59.913482 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.923283 16635 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:59.927248 16633 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:59.891487 18335 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:59.943735 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:06:59.944743 17184 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:06:59.948380 18484 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:59.950766 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:06:59.953086 16530 leader_election.cc:400] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:06:59.953377 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:59.954638 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:06:59.958832 18449 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:59.960101 18414 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.960923 18449 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.961930 18289 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.962347 18289 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.962704 18289 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.943912 18436 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:06:59.953393 16530 leader_election.cc:403] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:59.955545 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:06:59.975863 16559 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
W20260709 13:06:59.950667 18536 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.881s	user 0.001s	sys 0.012s
W20260709 13:06:59.989089 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.989720 16561 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:06:59.989753 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:06:59.990399 16563 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:06:59.955472 17981 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.992115 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:06:59.992852 16482 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:06:59.993572 18105 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.993945 18105 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:06:59.995012 18105 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:06:59.932780 18238 consensus_queue.cc:1243] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:59.999224 16487 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:06:59.999693 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:00.001482 17185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 363) took 1152 ms. Trace:
I20260709 13:07:00.001911 17185 rpcz_store.cc:276] 0709 13:06:58.848726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.848824 (+    98us) service_pool.cc:224] Handling call
0709 13:07:00.000999 (+1152175us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b54006117d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:00.001246 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158886784}
I20260709 13:07:00.003571 18555 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:07:00.005976 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 53103.5us
I20260709 13:07:00.012144 16563 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:00.037235 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:00.039335 18449 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.039515 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 84061.2us
I20260709 13:07:00.040544 18105 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.040963 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:00.041916 18612 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4.
I20260709 13:07:00.043915 16489 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:00.044868 18549 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.045323 18549 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:00.045435 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.046402 18549 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.049002 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:00.049453 18549 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.052379 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.063998 18597 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.069296 18536 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.087167 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46345.9us
I20260709 13:07:00.088243 18546 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.091720 18396 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.088058 17717 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:00.100023 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:00.069474 18436 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:07:00.117578 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:00.118106 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:00.118498 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:00.119074 18380 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.095367 18603 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.119572 18380 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:00.120793 18380 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.121804 18603 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.089906 18450 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.118124 17185 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:00.088115 18312 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:00.120642 16454 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:00.130760 17183 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:00.104640 18546 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.118551 17184 raft_consensus.cc:2410] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:00.141145 16484 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.088806 18512 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:07:00.145119 18449 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.145576 18396 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:00.146203 18449 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.146603 18449 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:00.132368 17981 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.147459 18449 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.155534 16530 leader_election.cc:400] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6.
I20260709 13:07:00.145273 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:00.139238 18546 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:00.159006 18601 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.287s	user 0.003s	sys 0.000s
I20260709 13:07:00.159189 18387 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.135478 18531 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:00.159922 18238 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.160574 18536 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:00.161338 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:00.163107 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:00.163898 18550 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.173534 17981 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.173693 18449 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.174108 17981 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:00.175050 17981 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:00.164206 18632 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:07:00.165071 18613 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.170915 16454 leader_election.cc:400] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:00.191272 16454 leader_election.cc:403] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.172897 18536 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.173321 16638 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:00.177199 17717 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.192608 17717 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.181978 16483 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:00.182435 18531 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:00.198752 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.182829 18342 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:00.179931 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.154922 18436 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:00.185585 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 46097.7us
I20260709 13:07:00.164165 18616 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.157737 18450 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.192951 17717 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.170523 18238 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:00.195891 18105 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.203188 16563 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:00.208859 18377 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.209107 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:00.209805 16560 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:00.210520 18289 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.193001 18613 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:00.211915 16640 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.192397 18536 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:00.211973 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 63166.6us
I20260709 13:07:00.216207 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:00.204051 18436 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:00.197423 18599 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:00.225742 18396 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.230969 18289 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.228883 18377 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.234006 18377 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:00.234476 18238 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.235697 18238 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:00.236995 18609 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.365s	user 0.000s	sys 0.002s
I20260709 13:07:00.244187 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:00.210537 18546 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:00.245497 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.248320 18436 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:00.248993 18621 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:00.261437 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:00.249423 18623 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
W20260709 13:07:00.265120 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.264886 18387 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:00.265704 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.250309 18615 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:00.267179 16563 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:00.250650 18627 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:07:00.250831 18450 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:00.221458 18342 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:00.229456 18105 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.252272 18531 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.252902 18613 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.288188 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:00.288734 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:00.288939 17186 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:07:00.288239 16484 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:00.254081 18639 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:07:00.254290 18536 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.254642 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.255125 16566 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:00.255514 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1457) took 1793 ms. Trace:
I20260709 13:07:00.241030 17717 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:00.262172 18634 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 13:07:00.266383 18446 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.206234 18312 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:00.285403 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:00.285590 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:00.280027 18599 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.285934 16485 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:00.311209 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 56666.1us
I20260709 13:07:00.239615 18512 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:00.290392 16489 rpcz_store.cc:276] 0709 13:06:58.462019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.268328 (+806309us) service_pool.cc:224] Handling call
0709 13:06:59.294960 (+ 26632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.044350 (+749390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.255208 (+210858us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54002d7b54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:00.255442 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558093184}
I20260709 13:07:00.319500 18312 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.319936 18312 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:00.321080 18597 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.287310 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:00.275848 18377 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.321919 18597 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.322096 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.319823 16530 leader_election.cc:400] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 2 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 2. Current term is 3.
I20260709 13:07:00.322235 18377 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.271569 18555 consensus_queue.cc:1059] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:00.323132 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:00.288268 18105 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:00.323951 18555 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.324335 18555 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:00.324440 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.324852 18377 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.325327 18555 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.326095 18612 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.326711 18555 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.328426 18641 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:00.329710 18536 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.320864 18312 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.314479 18599 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.288843 18613 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.321873 17185 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:00.290544 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:00.316422 18618 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 13:07:00.297851 17180 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.335425 17717 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:00.338732 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.354490 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:00.328639 18612 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.322340 18597 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:07:00.352622 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.322530 18531 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:00.353684 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.373119 16487 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:07:00.378782 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 49551.3us
I20260709 13:07:00.379307 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:00.381460 16484 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.336190 18603 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:07:00.373112 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.386474 16529 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:00.372376 18550 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.380259 18267 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:00.425388 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.382526 18619 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:07:00.427263 18603 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:00.387540 18546 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.427719 18550 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:00.429061 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 166439us
I20260709 13:07:00.424437 18503 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:07:00.442201 16491 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 13:07:00.432075 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 141591us
I20260709 13:07:00.390522 18396 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.394945 18450 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.437865 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:00.430635 18312 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.448792 16638 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.452450 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.436275 18603 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:00.454566 16632 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:00.455201 18527 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.455726 18599 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:00.428768 18531 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.456702 16632 pending_rounds.cc:85] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 2
I20260709 13:07:00.458807 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.448609 18450 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:00.465399 16455 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.465620 18431 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.459710 16632 pending_rounds.cc:107] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:00.477849 16632 raft_consensus.cc:2889] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:00.473085 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.458693 16482 raft_consensus.cc:2410] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:00.464275 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.457947 18603 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.456080 18323 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:00.478171 18450 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.481413 18546 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:00.491129 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62501.8us
I20260709 13:07:00.498958 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.459444 18597 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.493155 17981 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.502952 18323 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.505815 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.485667 18431 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.488071 18527 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:07:00.514813 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.515391 18289 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.518249 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:00.524986 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1673) took 1204 ms. Trace:
I20260709 13:07:00.525353 16634 rpcz_store.cc:276] 0709 13:06:59.320693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.325614 (+  4921us) service_pool.cc:224] Handling call
0709 13:07:00.524794 (+1199180us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b54003269d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:00.524911 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84031744}
I20260709 13:07:00.527918 18462 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.529524 18446 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.530308 18433 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.530702 18433 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:00.531587 18433 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.532976 18433 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.533171 18661 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.533716 18661 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:00.534584 18661 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.544093 18550 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:00.546774 18611 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.711s	user 0.000s	sys 0.002s
I20260709 13:07:00.539872 18603 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:00.553015 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.547927 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.555536 16638 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:00.538671 18597 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.558504 18387 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.551420 18449 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.560304 16558 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:00.561465 18462 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.561846 18462 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:00.562203 18462 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.562016 18431 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.565264 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 959) took 1824 ms. Trace:
I20260709 13:07:00.565663 16490 rpcz_store.cc:276] 0709 13:06:58.732020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.618020 (+886000us) service_pool.cc:224] Handling call
0709 13:06:59.618614 (+   594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.619308 (+   694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.619333 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.624945 (+  5612us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.695750 (+ 70805us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.695786 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.695887 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.546116 (+850229us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:00.547587 (+  1471us) raft_consensus.cc:1685] finished
0709 13:07:00.547605 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.554439 (+  6834us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50601,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":28096,"spinlock_wait_cycles":3885824,"thread_start_us":70390,"threads_started":1,"wal-append.queue_time_us":110981}
I20260709 13:07:00.570701 18431 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.571211 18431 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.573699 18531 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.573920 18431 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.574613 16484 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
W20260709 13:07:00.575204 18649 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:00.576120 16560 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:00.577304 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:00.577888 16558 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:00.563939 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.581355 18449 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:00.581147 18323 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:00.587352 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 108213us
I20260709 13:07:00.588267 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:00.592522 17717 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.593683 16560 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:00.594431 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.595213 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.595497 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.595914 16639 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
W20260709 13:07:00.598369 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 59615.9us
I20260709 13:07:00.595990 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:00.582952 18433 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.623925 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:00.623690 17717 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.626328 16559 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
W20260709 13:07:00.622048 18640 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.356s	user 0.000s	sys 0.002s
W20260709 13:07:00.631278 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.632005 18603 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:00.632560 18637 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.475s	user 0.000s	sys 0.002s
I20260709 13:07:00.631274 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:00.631713 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.634402 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:00.634771 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 70925.7us
I20260709 13:07:00.635936 17717 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:00.634825 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 44200.7us
I20260709 13:07:00.702867 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:00.702956 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 67431.8us
I20260709 13:07:00.702229 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.703714 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.705400 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:00.708743 18396 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.637872 18433 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.709424 18396 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.711084 16637 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:00.713136 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:00.713629 17180 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:00.714320 17186 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:00.714720 18662 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:07:00.713898 17187 raft_consensus.cc:2410] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:00.711308 18396 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.724406 17179 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:00.724745 18664 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.762509 16558 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:00.766113 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 62444.9us
I20260709 13:07:00.764791 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:00.771468 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:00.774173 16490 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:00.775075 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.775725 16489 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
W20260709 13:07:00.776309 18635 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.617s	user 0.000s	sys 0.008s
I20260709 13:07:00.742390 18446 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.776500 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:00.767688 18484 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.777319 18484 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.779333 18484 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.728217 18289 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.771413 16632 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
W20260709 13:07:00.773363 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 139072us
I20260709 13:07:00.743076 18603 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.792167 16566 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:00.764441 18659 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:00.794795 18659 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:00.794643 18661 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:00.795814 18659 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:00.797183 18666 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:07:00.797672 18661 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.793956 18603 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:00.798360 18603 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.798277 18661 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.800511 18661 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:00.801546 18661 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.801352 18450 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.802024 18661 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.744383 18377 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:00.803553 18377 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.803954 18661 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:00.805508 18377 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.805904 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.806497 16486 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:00.796258 17179 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:00.806813 18323 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.807865 18531 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.808350 18531 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.809346 18289 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.811034 18289 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:00.812280 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.812899 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.814219 18597 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:00.814934 18597 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.815867 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.819355 18449 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.819785 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.792953 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:00.820185 18449 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.820633 16489 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:00.820921 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.821429 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.822211 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.822655 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:00.817225 18597 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:00.823096 18595 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.822858 18462 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:00.823469 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.824553 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:00.825769 16488 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:00.826052 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:00.819617 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.826738 18503 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.827195 18503 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:00.827618 18503 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.827047 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:00.812886 16486 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:07:00.849843 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:00.820698 16558 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:00.865474 16487 raft_consensus.cc:2410] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:00.865559 17717 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.866169 17717 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.866518 17717 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.867882 16639 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:00.868223 16639 pending_rounds.cc:85] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 2
I20260709 13:07:00.868445 16639 pending_rounds.cc:107] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:00.868726 16639 raft_consensus.cc:2889] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.829603 18289 raft_consensus.cc:2764] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:00.870281 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.852833 18612 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.852599 18342 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.873876 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:00.881587 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.882196 16486 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:00.871358 16604 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:00.876237 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:00.872931 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.886358 18665 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:00.866209 18396 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.891336 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64361.2us
I20260709 13:07:00.887553 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.888579 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:00.894445 16560 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:00.871590 18595 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.896551 16634 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:00.899484 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.852679 18446 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.905131 16488 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:00.870916 18613 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:07:00.888053 18612 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:00.891705 18342 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:00.893508 18661 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:00.923835 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:00.927187 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:00.928712 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.914620 18323 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.932613 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:00.912686 18531 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.933811 17717 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.921598 17981 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.909287 18484 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:00.920725 18597 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.940861 16636 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:00.906926 18396 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:00.938179 18661 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:00.944504 18669 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:07:00.944181 18342 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:00.948278 18612 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:00.949052 18663 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:07:00.949781 18676 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.954594 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.938952 18323 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.942768 18484 consensus_queue.cc:1243] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:07:00.987752 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.988796 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:00.944067 18595 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.004833 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:01.005678 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 85412.2us
I20260709 13:07:01.006296 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:01.006636 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.013221 16639 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:01.007853 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:00.999222 18609 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:01.017482 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:00.940129 18603 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.020450 16489 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.020941 17152 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:01.023111 17717 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.003391 18323 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.018253 18377 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:01.049932 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.019205 18664 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:01.072428 16557 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
W20260709 13:07:01.072963 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45088.2us
I20260709 13:07:01.073647 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:01.061069 18603 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:00.985260 17981 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.042097 18677 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.062242 18462 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:01.036865 18431 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.065199 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:01.050015 18449 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:07:01.063503 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:01.069515 18665 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.061517 16559 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.039172 18414 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:01.082276 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.098770 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.082875 18323 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.025933 18555 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.100095 18555 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.100937 18323 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.006687 18676 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.054793 18377 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.040505 18595 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:01.053447 18450 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:01.093562 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 105083us
I20260709 13:07:01.091240 18664 raft_consensus.cc:2764] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:07:01.097628 18629 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:07:01.107072 18628 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.071s	user 0.000s	sys 0.006s
I20260709 13:07:01.106590 18446 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.109119 16489 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:01.089907 18431 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.102093 18555 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:01.111559 18377 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.114789 18613 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.105418 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:01.138293 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 82926.4us
I20260709 13:07:01.141059 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:01.114293 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:01.153842 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 45877.8us
I20260709 13:07:01.154289 16489 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:01.139650 18431 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.115218 18315 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:01.150692 18661 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.156414 18664 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.156561 18665 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.166359 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.169207 18661 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:01.157742 18616 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:07:01.176457 18661 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.178627 18661 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:01.178905 18622 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.170s	user 0.002s	sys 0.008s
W20260709 13:07:01.179862 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 74563.3us
I20260709 13:07:01.182010 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.167475 18664 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:01.169034 18665 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:01.210112 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.185436 18396 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:01.211699 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 45384.4us
I20260709 13:07:01.160566 18595 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.220002 18484 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.220422 18484 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.220746 18484 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.195757 18664 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.183350 18677 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:07:01.228193 18603 raft_consensus.cc:2764] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:07:01.232419 18685 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:07:01.233227 18686 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:01.233840 17981 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:01.234073 18682 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:07:01.197415 18612 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:01.210505 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.198004 18665 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.233917 18687 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:01.240343 18414 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.241720 18431 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.243242 17181 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:07:01.219672 17179 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:01.254880 17181 pending_rounds.cc:85] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 5
W20260709 13:07:01.247706 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48926.7us
W20260709 13:07:01.252362 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 96218.1us
I20260709 13:07:01.255903 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.256217 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:01.237998 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:01.260015 18323 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:01.260841 18431 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.261240 18687 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.263468 18687 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:01.254657 18683 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:07:01.270790 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.274062 18503 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.254742 18414 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.274947 17183 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:01.259598 18694 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:07:01.279167 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.284812 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:01.255288 17181 pending_rounds.cc:107] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:07:01.295249 16487 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.240083 18484 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:01.292107 18693 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:01.292559 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:01.294139 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:01.284317 18446 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.289462 18676 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:01.302505 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:01.296201 17181 raft_consensus.cc:2889] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.296936 18377 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.312450 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.313504 18377 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.313645 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.314749 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:01.317552 18377 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:01.318061 18377 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.319900 18377 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.307495 18446 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:01.321779 18446 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.309247 17981 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:01.307586 18690 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.303992 17179 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:01.324805 18690 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.325193 18690 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.327719 16454 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:01.330149 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:01.330699 18380 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:01.330978 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:01.331548 16490 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.328433 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:01.334744 18594 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.330709 16635 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.335412 17981 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.336683 18612 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.334975 16634 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:01.338452 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.340482 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:01.344111 18676 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.344485 18676 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.344790 18676 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.344892 18484 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.334856 18414 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.346354 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 449) took 1016 ms. Trace:
I20260709 13:07:01.330641 18603 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.349200 16487 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:01.347937 17186 rpcz_store.cc:276] 0709 13:07:00.330064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.337252 (+  7188us) service_pool.cc:224] Handling call
0709 13:07:00.714135 (+376883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.714664 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.346172 (+631508us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54005082d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:01.346292 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810785152}
I20260709 13:07:01.340430 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:01.355464 17152 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:01.357769 18599 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.358254 18599 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:01.359036 18599 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.361662 18431 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:01.362083 18431 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:01.362426 18431 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.363785 16490 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:01.371335 18503 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.349157 18377 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.337944 17981 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:01.354390 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.389945 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75257.4us
I20260709 13:07:01.402885 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.407301 18431 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:01.407348 18695 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:01.411012 18664 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.411846 18431 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.412869 18664 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.414630 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 450) took 1084 ms. Trace:
I20260709 13:07:01.414875 16635 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:01.406152 18603 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.417318 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:01.406348 18665 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.415165 18594 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.425011 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:01.425750 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 377) took 1150 ms. Trace:
I20260709 13:07:01.427207 16634 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:01.438480 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:01.440156 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:01.426136 17182 rpcz_store.cc:276] 0709 13:07:00.275658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.280100 (+  4442us) service_pool.cc:224] Handling call
0709 13:07:00.286513 (+  6413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.385790 (+ 99277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.387625 (+  1835us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.451412 (+ 63787us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.491991 (+ 40579us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:00.492047 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.423285 (+931238us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b5400415ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:01.423333 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.423375 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:01.423389 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.425645 (+  2256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15057,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8865,"spinlock_wait_cycles":102903552,"thread_start_us":27389,"threads_started":1,"wal-append.queue_time_us":90176}
I20260709 13:07:01.416056 17188 rpcz_store.cc:276] 0709 13:07:00.330393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.338300 (+  7907us) service_pool.cc:224] Handling call
0709 13:07:00.338634 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.484737 (+146103us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:00.494709 (+  9972us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.527014 (+ 32305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.527061 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:00.527119 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.414338 (+887219us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54004f24d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:01.414379 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.414485 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9543,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":109,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":326552192,"thread_start_us":24770,"threads_started":1,"wal-append.queue_time_us":97400}
I20260709 13:07:01.439837 18377 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:01.446622 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.442533 18603 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:07:01.447474 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:01.448227 18259 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:01.450615 18665 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.451179 18259 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:01.451741 18610 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.450s	user 0.000s	sys 0.008s
I20260709 13:07:01.454664 18690 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.456677 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:01.457108 18690 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:01.457463 17179 raft_consensus.cc:2393] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:01.456956 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:01.456460 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:01.463164 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:01.463760 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:01.464309 17183 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.464566 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1469) took 2970 ms. Trace:
I20260709 13:07:01.464991 16483 rpcz_store.cc:276] 0709 13:06:58.494096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.315018 (+820922us) service_pool.cc:224] Handling call
0709 13:06:59.315281 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.205937 (+890656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.464275 (+1258338us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b5400259754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:01.464487 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806502656}
I20260709 13:07:01.442689 18664 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:07:01.462471 17181 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:01.443202 18594 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.453415 18676 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:01.658545 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.674111 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 234014us
I20260709 13:07:01.595144 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 167) took 1001 ms. Trace:
W20260709 13:07:01.515419 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.442800 18704 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.677436 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:01.678592 16634 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
W20260709 13:07:01.473376 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.677845 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:01.680169 16635 pending_rounds.cc:85] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 1
I20260709 13:07:01.680516 16635 pending_rounds.cc:107] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:01.680796 16635 raft_consensus.cc:2889] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:01.501686 18702 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:01.676885 16632 rpcz_store.cc:276] 0709 13:07:00.594083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.594188 (+   105us) service_pool.cc:224] Handling call
0709 13:07:01.594971 (+1000783us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54000fc8d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:01.595081 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405321984}
W20260709 13:07:01.507983 18701 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:07:01.728308 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:01.594686 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.720428 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:01.730825 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:01.733781 16632 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:07:01.671772 18353 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.478368 18594 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:01.733788 16634 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:01.556365 18691 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.536151 18603 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:01.507606 18664 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:01.681150 18512 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:07:01.536158 18595 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.472813 18377 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:01.734637 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:01.737126 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54960.4us
I20260709 13:07:01.748011 16639 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:01.729482 18704 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:01.506965 17183 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:01.741019 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1490) took 1466 ms. Trace:
I20260709 13:07:01.733234 18531 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.741953 16633 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:01.727516 18677 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:01.743503 16632 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:01.636345 18450 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:01.748451 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:01.662464 18503 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:01.728958 18335 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:07:01.740832 18594 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:01.758291 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.755033 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:01.753190 16491 rpcz_store.cc:276] 0709 13:07:00.269883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.269991 (+   108us) service_pool.cc:224] Handling call
0709 13:07:00.271479 (+  1488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:00.442613 (+171134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.734876 (+1292263us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400177854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:01.736426 (+  1550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392015104}
I20260709 13:07:01.766033 18267 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.766469 18267 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.754412 18595 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.767450 18380 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.767872 18380 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.768195 18380 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.768272 18595 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:01.769100 18436 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.761711 18531 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.740702 18353 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.766822 18267 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.774544 18353 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.776489 18531 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:01.745240 18691 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.749038 18664 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.752313 18603 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.766796 18377 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.771698 18599 raft_consensus.cc:2764] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:01.765196 18503 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.764581 18677 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.777597 18450 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:01.834758 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 168) took 1240 ms. Trace:
I20260709 13:07:01.835175 16637 rpcz_store.cc:276] 0709 13:07:00.594356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.595210 (+   854us) service_pool.cc:224] Handling call
0709 13:07:01.834569 (+1239359us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003d2054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:01.834692 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264268544}
I20260709 13:07:01.830699 18594 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:01.828991 17182 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:07:01.841956 18603 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:01.854060 16565 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:01.864939 18677 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:01.869266 18450 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:01.829656 18704 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:01.905104 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.961841 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.024300 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 296584us
W20260709 13:07:02.044111 18708 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:07:02.045248 18484 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.100507 18315 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.091342 18484 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.064284 18449 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:02.108151 18449 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:02.109000 18449 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.109925 18449 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:02.125082 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.838575 18267 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.160833 18484 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:02.168056 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.171972 18713 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.098248 18380 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.138962 18664 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.177407 18713 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.176970 18436 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:02.180208 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 425176us
I20260709 13:07:02.180794 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 165) took 1583 ms. Trace:
I20260709 13:07:02.179240 18436 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.181165 16638 rpcz_store.cc:276] 0709 13:07:00.592730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.592855 (+   125us) service_pool.cc:224] Handling call
0709 13:07:00.593126 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.625353 (+ 32227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.625382 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.875956 (+1250574us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b2c00128e18. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:07:01.876357 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.097066 (+220709us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:02.097109 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.097209 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.173303 (+ 76094us) raft_consensus.cc:1685] finished
0709 13:07:02.173324 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.176041 (+  2717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43500,"raft.queue_time_us":32023,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":9927552,"thread_start_us":220224,"threads_started":1,"wal-append.queue_time_us":267717}
W20260709 13:07:02.184352 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 456103us
I20260709 13:07:02.172396 18594 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:02.185103 17153 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.597s (SENT)
I20260709 13:07:02.191206 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:02.180269 18612 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.180043 18335 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:02.184511 18691 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.194139 18717 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.200547 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:02.202565 16639 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:02.202952 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:02.203476 16637 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
W20260709 13:07:02.209019 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.195525 18677 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:02.196985 18687 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:07:02.206041 18713 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.201376 18717 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:02.208714 18267 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.215406 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1700) took 1364 ms. Trace:
I20260709 13:07:02.218487 16557 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.217271 16636 rpcz_store.cc:276] 0709 13:07:00.851063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.851978 (+   915us) service_pool.cc:224] Handling call
0709 13:07:02.215223 (+1363245us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b54003d0754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:02.215350 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153916288}
I20260709 13:07:02.208762 18436 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.198302 18612 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.200201 18335 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.223313 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:02.231704 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.232303 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:02.231354 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:02.217012 18717 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.223729 17981 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:02.241623 16559 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:02.246065 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.246697 16563 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:02.247953 16560 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 4. Ops: [2.4-2.4]
I20260709 13:07:02.248416 16557 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:02.249318 16566 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:02.250320 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:02.250541 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.252128 16561 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:02.258294 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:02.258874 17188 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.220504 18450 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:02.231618 18377 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:02.236846 18713 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.264667 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.265221 16559 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:02.265273 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 60839.5us
I20260709 13:07:02.242938 17981 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:02.259624 18267 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.267872 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.269608 16483 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:02.270424 16491 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:02.271124 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.272286 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.272846 16561 raft_consensus.cc:2410] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:02.276105 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.275339 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:02.264134 18713 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:02.304292 16559 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:02.306342 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.273949 18691 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.309070 18335 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:02.309516 18680 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 1.200s	user 0.009s	sys 0.007s
W20260709 13:07:02.312354 18672 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.448s	user 0.011s	sys 0.022s
I20260709 13:07:02.287273 18713 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.284107 18677 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.317395 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:02.265357 18377 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.273381 18267 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.324121 16638 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:02.321619 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1485) took 1759 ms. Trace:
I20260709 13:07:02.326146 16565 rpcz_store.cc:276] 0709 13:07:00.557792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.557929 (+   137us) service_pool.cc:224] Handling call
0709 13:07:00.559673 (+  1744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.854503 (+1294830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.317139 (+462636us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540007e4d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:02.317298 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2976077568}
I20260709 13:07:02.329164 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.329764 16559 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
W20260709 13:07:02.334849 17153 leader_election.cc:336] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.733s (SENT)
I20260709 13:07:02.335124 18700 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.336634 18315 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:02.337066 18315 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.339116 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.341248 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:02.339632 16561 raft_consensus.cc:2376] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4. Re-sending same reply.
I20260709 13:07:02.348232 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.348914 16560 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:02.351356 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.333644 18353 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.351285 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.323984 18553 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:02.352394 16564 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:02.352221 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.337170 18289 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.354427 18289 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.332197 18387 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.356405 18289 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.356782 18387 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.357618 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:02.358393 16638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:02.359058 16638 raft_consensus.cc:606] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:02.331151 17981 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.359390 16638 raft_consensus.cc:614] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:02.327700 18723 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.330624 18450 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.353098 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.360601 18450 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.361016 16566 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:02.350591 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:02.362607 18450 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.364231 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1505) took 1591 ms. Trace:
I20260709 13:07:02.365001 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.365707 16561 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:02.366010 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.366365 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.366883 16558 raft_consensus.cc:2410] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:02.367640 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.332608 18677 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.368320 16558 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 3: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:02.368769 18377 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.367055 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.369405 18269 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:02.330811 18724 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.363680 18723 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.369853 16557 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:02.327144 18691 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.370160 18723 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.368702 18267 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.372202 17981 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:02.373796 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.375784 18724 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.376173 18724 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.377501 18335 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.377761 18267 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:02.378006 18335 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.378307 18267 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.379222 18668 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.335562 18700 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.379930 18335 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.380218 18668 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:02.381181 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.381400 18700 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:02.364641 16482 rpcz_store.cc:276] 0709 13:07:00.773180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.773943 (+   763us) service_pool.cc:224] Handling call
0709 13:07:00.774264 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.794732 (+ 20468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.794765 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.795229 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.876056 (+ 80827us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:00.884115 (+  8059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.894061 (+  9946us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.277251 (+1383190us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:02.363943 (+ 86692us) raft_consensus.cc:1685] finished
0709 13:07:02.363966 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.364163 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17362,"raft.queue_time_us":22264,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":14960384,"thread_start_us":74582,"threads_started":1,"wal-append.queue_time_us":68923}
I20260709 13:07:02.352149 18353 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.383128 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.384231 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:02.366886 16561 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:02.392373 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.384699 16529 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:02.395517 16558 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.400507 18335 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.401062 18335 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:02.400683 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.365970 18717 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.475952 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:02.562836 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.401345 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.549789 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.401947 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:02.612928 16559 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:02.612272 16490 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.437649 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:02.550727 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 132832us
I20260709 13:07:02.381589 18668 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:02.623736 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.573029 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.380179 18267 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:02.734658 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 399810us
I20260709 13:07:02.473903 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:02.736231 16558 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:02.414135 18512 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.369642 18677 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.358819 18387 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:02.731159 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.742208 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:02.600258 18289 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:02.749475 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.747040 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:02.747685 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.736276 17188 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:02.496980 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.745795 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.753273 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.494405 18725 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.437965 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:02.732343 18449 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.812068 18449 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.814095 18449 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.600000 18687 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.814803 18687 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.816769 18687 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.757611 18512 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:02.823987 16485 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.786634 18677 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.825062 18677 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.414367 18436 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.494211 18710 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.570937 18446 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.739302 18668 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:02.791055 16561 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.742388 18716 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.747608 18450 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.805847 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.796809 18289 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.758949 18353 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:02.809736 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1703) took 1957 ms. Trace:
I20260709 13:07:02.756016 18691 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.827492 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:02.826926 18677 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.807665 16489 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:02.496677 18335 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.824152 18512 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.835163 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:02.838912 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:02.805188 18536 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.839476 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:02.803553 16490 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
W20260709 13:07:02.785167 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.844046 18315 consensus_meta.cc:287] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.005s
I20260709 13:07:02.798991 18713 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.846062 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:02.863384 16638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:02.863999 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.865917 16638 raft_consensus.cc:606] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:02.866282 16638 raft_consensus.cc:614] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:02.827013 18725 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.869180 16485 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:02.872200 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:02.874218 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:02.869807 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.877118 18599 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.877525 18599 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.877867 18599 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.880084 18731 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.880520 18731 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:02.880853 18731 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.886888 18599 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.888155 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:02.889139 18553 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.892172 17180 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.894129 17180 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:02.895610 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:02.897646 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:02.898968 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:02.900058 18691 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:02.900576 18691 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.902580 18691 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:02.903750 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:02.905313 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:02.907618 18599 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.849113 18377 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.831926 18436 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.844657 18450 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.833670 18710 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.843387 18730 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:07:02.870910 18677 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.838145 18716 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.833087 18446 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.840204 18723 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.876355 18431 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.938437 16486 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
W20260709 13:07:02.942466 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 136356us
I20260709 13:07:02.868913 18315 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:02.964407 16638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:02.965065 16638 raft_consensus.cc:606] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:02.841221 16631 rpcz_store.cc:276] 0709 13:07:00.851850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.861918 (+ 10068us) service_pool.cc:224] Handling call
0709 13:07:01.842245 (+980327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.842693 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.842725 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.843189 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.139108 (+295919us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:02.141145 (+  2037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.154434 (+ 13289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.164961 (+ 10527us) raft_consensus.cc:1685] finished
0709 13:07:02.164983 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.809478 (+644495us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54003d2050. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:02.809669 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":2154468608,"thread_start_us":254561,"threads_started":1,"wal-append.queue_time_us":300312}
I20260709 13:07:02.970130 18710 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.970842 16631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:02.971422 16631 raft_consensus.cc:606] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:02.971740 16631 raft_consensus.cc:614] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:02.972441 18728 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:07:02.972736 17981 consensus_meta.cc:287] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.000s
I20260709 13:07:02.973896 16482 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:02.974064 16484 raft_consensus.cc:2410] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:02.968601 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:02.979653 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 468) took 1391 ms. Trace:
I20260709 13:07:02.980042 17186 rpcz_store.cc:276] 0709 13:07:01.588195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.588332 (+   137us) service_pool.cc:224] Handling call
0709 13:07:01.728650 (+140318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.860785 (+132135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.860818 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.401926 (+541108us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b2c000077c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:07:02.472403 (+ 70477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.949785 (+477382us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:02.949821 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.949884 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.974800 (+ 24916us) raft_consensus.cc:1685] finished
0709 13:07:02.974818 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.979599 (+  4781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8334,"raft.queue_time_us":11522,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":4175,"spinlock_wait_cycles":605192960,"thread_start_us":599178,"threads_started":2,"wal-append.queue_time_us":499572}
I20260709 13:07:02.981725 16483 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:02.979296 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:02.976401 18717 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.988095 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:02.994902 16639 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:02.988690 16635 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.994953 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:02.916340 18668 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:02.996758 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:03.000593 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.000527 16640 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:02.993605 18377 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:02.990839 18735 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.046193 18735 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:02.986443 18269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.016s	sys 0.032s
I20260709 13:07:03.040566 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:02.985988 18431 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.041841 18715 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.051013 18668 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.055327 16637 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:03.055557 18289 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.056090 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:03.056540 18446 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:03.057108 18713 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:03.058502 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 61828.7us
I20260709 13:07:03.064831 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:03.002349 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:03.045780 18377 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:03.061378 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:03.062870 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:03.065928 16638 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:03.051635 18335 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.069543 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:02.988018 18736 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:03.071348 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:03.072227 18737 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:03.072870 18267 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.074388 18377 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:03.075662 18315 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:03.076491 18436 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:02.994195 17981 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:03.069890 18380 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:03.079370 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 91557us
I20260709 13:07:02.992213 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.063539 18431 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:03.111089 16561 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:03.082444 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.083256 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.083302 18736 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:03.059805 18269 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:03.088090 18725 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.088259 18450 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:03.078307 18729 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:07:03.090845 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:03.063964 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.120729 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.121515 16638 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 3: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:03.120728 18269 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:03.122627 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.123284 16491 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:03.123970 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.124524 16491 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:03.125240 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.126032 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:03.126163 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:03.126585 16562 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:03.127979 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:03.128542 16562 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:03.129298 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:03.130429 16562 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.130707 16562 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:03.131034 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:03.131624 16483 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:03.082396 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.132967 16640 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:03.114090 18431 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.133301 18612 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.114749 18736 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.115007 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:03.115358 18749 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:07:03.115653 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:03.137663 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:03.138425 16559 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.131412 16562 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:03.117344 18753 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:03.117749 17184 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:03.118319 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.118860 18315 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:03.126974 16631 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:03.127126 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:03.105337 18723 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:03.104722 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:03.148164 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 43514us
I20260709 13:07:03.134912 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:03.107487 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.136111 16486 raft_consensus.cc:2368] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:03.149343 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:03.135712 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.150540 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:03.150620 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:03.127864 16482 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:03.091418 18335 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:03.138001 18744 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.120396 18716 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.151494 16483 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:03.155938 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:03.152758 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.154223 16635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:03.151852 16562 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.144654 18503 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:03.151714 18676 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:03.154458 18732 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.155084 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.158447 16635 raft_consensus.cc:606] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:07:03.164947 16635 raft_consensus.cc:614] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:03.112684 17981 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:03.171675 16636 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:03.172705 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:03.173323 16635 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
W20260709 13:07:03.154835 18724 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.778s	user 0.001s	sys 0.008s
I20260709 13:07:03.188205 18724 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:03.189512 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:03.190230 18724 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.191691 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.191987 16490 raft_consensus.cc:2368] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:03.176059 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:03.182221 18716 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:03.152165 18735 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:03.152477 18731 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:03.163436 18744 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.154843 18715 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.186242 18512 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:03.186771 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:03.423367 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.265900 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.154884 18267 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.431363 18267 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.265451 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:03.431762 18267 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.432122 16563 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:03.432950 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:03.152038 18612 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.433750 16557 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:03.433933 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:03.434585 16636 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
W20260709 13:07:03.249544 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.192548 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:03.315631 16639 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:03.366712 16562 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:03.355047 16559 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:03.440115 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:03.440654 16559 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.439273 16562 pending_rounds.cc:85] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 1
I20260709 13:07:03.443275 16562 pending_rounds.cc:107] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:03.443454 16562 raft_consensus.cc:2889] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:03.194211 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.162510 18732 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:03.404999 18749 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:03.471490 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:03.162158 18335 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.481585 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:03.428972 18315 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.387560 18436 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:03.512961 16637 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:03.188669 17981 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.513214 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:03.485397 18732 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.433200 18731 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:03.518507 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:03.519157 16491 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:03.508533 16563 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:03.966950 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1511) took 1494 ms. Trace:
I20260709 13:07:04.022817 16635 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.024886 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.435717 18744 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.043717 17185 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:03.520442 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:04.046729 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:03.729626 16559 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
W20260709 13:07:04.005666 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.911195 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.047808 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:03.889907 16640 consensus_meta.cc:287] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.003s
I20260709 13:07:04.052282 16640 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
W20260709 13:07:03.967162 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 495722us
I20260709 13:07:04.056932 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:04.022822 18759 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:04.048813 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:03.953771 16455 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.636s (SENT) [suppressed 14 similar messages]
I20260709 13:07:03.452813 18715 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:03.966781 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1516) took 1106 ms. Trace:
W20260709 13:07:04.042477 16561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.008s	sys 0.022s
W20260709 13:07:04.062352 16561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.009s	sys 0.023s
W20260709 13:07:03.971927 18722 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 1.697s	user 0.013s	sys 0.030s
I20260709 13:07:04.050364 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:03.512743 18536 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.047283 16491 raft_consensus.cc:2376] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4. Re-sending same reply.
W20260709 13:07:04.051503 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.045728 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:03.541324 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:03.512806 18335 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.515069 18436 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.053704 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.054263 18531 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.016558 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.054466 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:03.456730 18716 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:03.686702 17981 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.042224 16565 rpcz_store.cc:276] 0709 13:07:02.472987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.863111 (+390124us) service_pool.cc:224] Handling call
0709 13:07:02.863439 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:02.863750 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.863778 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:02.864302 (+   524us) log.cc:844] Serialized 52 byte log entry
0709 13:07:02.947569 (+ 83267us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:02.947896 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.948105 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.948175 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.075818 (+127643us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b480005e758. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
0709 13:07:03.114807 (+ 38989us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:03.966740 (+851933us) raft_consensus.cc:1685] finished
0709 13:07:03.966760 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.966897 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":961,"raft.run_cpu_time_us":1219,"raft.run_wall_time_us":207883,"spinlock_wait_cycles":89664640,"thread_start_us":8328,"threads_started":1,"wal-append.queue_time_us":123168}
I20260709 13:07:04.057699 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:04.078972 18536 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.079355 18536 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.065600 18723 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:07:04.079669 18536 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.862586 18267 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.085193 17981 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.036588 18431 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.060838 16483 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.057717 17179 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:03.539019 18315 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.064445 16632 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
W20260709 13:07:04.055785 16456 connection.cc:256] RPC call timeout handler was delayed by -1.0108201199998348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
I20260709 13:07:04.052886 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.062232 16560 rpcz_store.cc:276] 0709 13:07:02.860010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.183564 (+323554us) service_pool.cc:224] Handling call
0709 13:07:03.183838 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.184169 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:03.184198 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.184632 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.403901 (+219269us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:03.403944 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.404015 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.966546 (+562531us) raft_consensus.cc:1685] finished
0709 13:07:03.966567 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.966724 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1042,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":218864,"threads_started":1,"wal-append.queue_time_us":332564}
I20260709 13:07:04.067178 18715 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.068120 18512 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:04.067993 18335 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.069188 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.065852 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.065424 16635 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
W20260709 13:07:04.102761 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.103137 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.072685 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:03.868263 18724 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.076218 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:04.087275 16530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.009s	sys 0.040s
W20260709 13:07:04.104233 16530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.009s	sys 0.041s
I20260709 13:07:04.104562 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.104820 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.105463 16636 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:04.105885 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.095700 16559 raft_consensus.cc:2376] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6. Re-sending same reply.
I20260709 13:07:04.064705 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.096503 16562 raft_consensus.cc:2368] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:04.098290 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:04.099661 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.101053 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.086848 18269 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.107064 16632 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.107918 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.108949 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.109302 16565 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:04.104024 16563 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.108309 16635 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:04.111007 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.123394 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.125537 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.127149 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:04.099645 17179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 392) took 1607 ms (client timeout 2115 ms). Trace:
I20260709 13:07:04.108296 18612 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:04.085834 18531 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.132292 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.109879 18724 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.131767 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 989) took 1069 ms. Trace:
I20260709 13:07:04.141080 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.145612 16491 rpcz_store.cc:276] 0709 13:07:03.062403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.110778 (+1048375us) service_pool.cc:224] Handling call
0709 13:07:04.131712 (+ 20934us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.142349 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.137744 16563 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:04.143182 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.147166 16560 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:04.140543 18549 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.091960 18431 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.149793 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.142300 18267 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.123219 18712 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.146840 16634 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 2.
I20260709 13:07:04.152400 16559 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:04.133903 16483 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:04.166280 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.164855 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:04.170943 16640 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:04.171588 17185 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:04.143882 18716 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.108899 18269 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.143951 18436 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.173530 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.174405 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.174304 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.179895 16560 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:07:04.149451 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.152302 18723 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.164048 18433 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.165377 18549 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.189930 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:04.148517 18612 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.191162 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1534) took 1428 ms. Trace:
I20260709 13:07:04.142902 18536 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.194276 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.180301 18716 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:04.193899 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86052.1us
I20260709 13:07:04.193919 16487 rpcz_store.cc:276] 0709 13:07:02.762655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.762851 (+   196us) service_pool.cc:224] Handling call
0709 13:07:02.763139 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.849393 (+ 86254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.849426 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.849467 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:02.849497 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.190947 (+1341450us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b54004416d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:04.190997 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.191109 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197924736}
I20260709 13:07:04.169368 18267 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:07:04.205997 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:04.195719 16634 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:04.198665 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:04.196571 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 169968us
W20260709 13:07:04.132658 17179 rpcz_store.cc:269] 0709 13:07:02.492017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.494497 (+  2480us) service_pool.cc:224] Handling call
0709 13:07:04.056782 (+1562285us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b58001e0998. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:04.097530 (+ 40748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6958848}
I20260709 13:07:04.198001 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 401) took 1016 ms. Trace:
I20260709 13:07:04.185556 18436 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.195200 18531 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.195886 18433 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:04.191313 18723 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.205744 17183 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.192075 18768 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:04.218705 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.220721 18762 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:04.221269 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.221622 18549 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.222880 18315 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.169688 18712 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:04.226029 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 272286us
W20260709 13:07:04.226795 18732 consensus_meta.cc:287] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.710s	user 0.003s	sys 0.003s
I20260709 13:07:04.232890 18724 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.232735 18732 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.227633 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.234797 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1005) took 1168 ms. Trace:
I20260709 13:07:04.211594 17186 rpcz_store.cc:276] 0709 13:07:03.181667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.187565 (+  5898us) service_pool.cc:224] Handling call
0709 13:07:03.187925 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.188099 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:03.472309 (+284210us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.197686 (+725377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.197736 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.197780 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.197837 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.197953 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149406,"prepare.queue_time_us":898736,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":1324,"raft.queue_time_us":151067,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":3128,"spinlock_wait_cycles":2432,"thread_start_us":859441,"threads_started":3,"wal-append.queue_time_us":625199}
I20260709 13:07:04.231401 16632 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:04.233711 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.238701 16559 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:04.235167 16637 rpcz_store.cc:276] 0709 13:07:03.066413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.066697 (+   284us) service_pool.cc:224] Handling call
0709 13:07:03.082721 (+ 16024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.521244 (+438523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.234600 (+713356us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54003d1154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:04.234745 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982534400}
W20260709 13:07:04.221221 18764 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:07:04.239732 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:04.239935 18269 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.240244 16637 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.240500 18771 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.242734 18335 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.237562 18768 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:04.244174 18766 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:07:04.244865 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.245182 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1513) took 1505 ms. Trace:
I20260709 13:07:04.245532 16561 rpcz_store.cc:276] 0709 13:07:02.739989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.140696 (+400707us) service_pool.cc:224] Handling call
0709 13:07:03.151282 (+ 10586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.154903 (+  3621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.154994 (+    91us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.174476 (+ 19482us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.062709 (+888233us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:04.062745 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.062807 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.244996 (+182189us) raft_consensus.cc:1685] finished
0709 13:07:04.245015 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.245133 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2851,"raft.queue_time_us":3263,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":3269,"thread_start_us":674012,"threads_started":1,"wal-append.queue_time_us":794239}
I20260709 13:07:04.247108 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.247623 16561 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:07:04.247910 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:04.218104 18765 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:04.248523 18765 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:04.248414 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.249214 16561 raft_consensus.cc:2376] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4. Re-sending same reply.
I20260709 13:07:04.249415 18765 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.250074 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.250751 16561 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:07:04.251642 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.252398 16561 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:04.252316 18768 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.253221 18712 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.228646 18433 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.255437 18433 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:04.255594 16637 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:04.255983 18775 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.256501 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.257201 16637 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:04.253252 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.258865 16561 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
W20260709 13:07:04.228544 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 103080us
I20260709 13:07:04.255873 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.238833 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:04.243857 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.248131 16482 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.260851 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.264451 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.266609 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.267489 18776 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.266628 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.268646 18436 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.267683 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:04.270284 18436 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:04.273804 18768 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:04.274163 18768 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:04.274561 18768 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.274968 18436 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.276643 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:04.277383 18436 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.277841 18436 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:04.277665 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:04.278980 18436 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.281040 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.261044 16456 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.285131 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.285662 16561 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:04.220283 18531 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:04.286698 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 80782.5us
I20260709 13:07:04.278545 18776 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.291775 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:04.293416 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:04.294173 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.250603 18765 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.294870 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.256503 18775 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.296015 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.250635 18536 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.280555 18724 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.285080 18335 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.303959 18342 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.282063 18716 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.308410 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.299103 18267 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.298696 18731 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.296025 18776 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:04.309544 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.300845 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:04.316395 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.316936 16566 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:04.320427 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 59211.2us
I20260709 13:07:04.321678 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.237582 18762 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.310257 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 976) took 1310 ms. Trace:
I20260709 13:07:04.328033 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.331938 16559 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.311142 18342 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.308264 18773 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.331431 17187 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.339349 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.339943 18335 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.340559 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:04.313244 18712 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.298993 18531 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.314687 18267 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:04.310981 18768 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.315025 18770 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:04.356773 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.369707 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.369875 16635 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:04.364006 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:04.366683 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 973) took 1370 ms. Trace:
I20260709 13:07:04.325068 18612 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.324047 18776 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:04.370317 16564 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:04.342201 18342 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.375506 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:04.375649 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 114667us
I20260709 13:07:04.376354 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.375957 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1734) took 1061 ms. Trace:
I20260709 13:07:04.357260 18335 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:04.382813 16485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1532) took 1922 ms (client timeout 2496 ms). Trace:
I20260709 13:07:04.383117 18335 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.383742 18612 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.384205 18612 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.380566 18716 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.382190 17981 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.382368 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.377203 16562 rpcz_store.cc:276] 0709 13:07:03.315012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.481347 (+166335us) service_pool.cc:224] Handling call
0709 13:07:04.375764 (+894417us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54001c8254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:04.375908 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412448640}
I20260709 13:07:04.385532 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:04.368642 18267 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.385010 16487 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:07:04.383263 16485 rpcz_store.cc:269] 0709 13:07:02.460059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.735863 (+275804us) service_pool.cc:224] Handling call
0709 13:07:04.382634 (+1646771us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54002990d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:04.382731 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86677376}
I20260709 13:07:04.392773 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:04.343923 18763 consensus_queue.cc:1059] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:04.389817 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:04.385808 16456 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.396310 16635 raft_consensus.cc:2376] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5. Re-sending same reply.
I20260709 13:07:04.394105 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:04.397959 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.398527 16635 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:04.382766 18732 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:04.331199 16482 rpcz_store.cc:276] 0709 13:07:02.997095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.219444 (+1222349us) service_pool.cc:224] Handling call
0709 13:07:04.247933 (+ 28489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.292189 (+ 44256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.307564 (+ 15375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.382120 18762 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.399741 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.413233 16635 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:04.414006 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:04.414531 16635 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.400858 16559 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:04.416405 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.399682 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:04.401793 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.386139 18770 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:04.402688 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.420526 16564 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:04.402650 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.421430 16485 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:04.390770 18716 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.404438 18531 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.404901 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.406281 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.408082 18431 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:04.408610 18783 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:04.397127 18786 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:04.408635 16490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1538) took 1540 ms (client timeout 1679 ms). Trace:
I20260709 13:07:04.409081 18771 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.408032 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.410246 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.444088 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.444517 16563 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:04.444623 16559 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.445307 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.446257 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.446688 16563 raft_consensus.cc:2376] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5. Re-sending same reply.
I20260709 13:07:04.447350 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.410965 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 970) took 2028 ms. Trace:
I20260709 13:07:04.412240 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1517) took 1503 ms. Trace:
I20260709 13:07:04.447947 16484 rpcz_store.cc:276] 0709 13:07:02.382790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.400462 (+ 17672us) service_pool.cc:224] Handling call
0709 13:07:04.410791 (+2010329us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54002d7b54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:04.410913 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313832192}
I20260709 13:07:04.448027 16557 rpcz_store.cc:276] 0709 13:07:02.908994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.190131 (+281137us) service_pool.cc:224] Handling call
0709 13:07:03.190391 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.434201 (+243810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.412043 (+977842us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540002d854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:04.412184 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559284992}
I20260709 13:07:04.373121 18668 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:07:04.417641 17981 raft_consensus.cc:2764] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:04.449352 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.449880 16557 raft_consensus.cc:2376] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6. Re-sending same reply.
I20260709 13:07:04.368361 18741 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:07:04.426159 16490 rpcz_store.cc:269] 0709 13:07:02.868717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.869586 (+   869us) service_pool.cc:224] Handling call
0709 13:07:04.408461 (+1538875us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54002d6754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:04.408583 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724699904}
W20260709 13:07:04.412254 18779 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:04.429957 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.410287 16482 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:04.430640 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:04.431075 18776 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.432888 18775 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.437080 18770 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.424690 18716 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.386623 18777 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:07:04.396960 18723 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:04.430644 18778 log.cc:927] Time spent T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:07:04.430680 18793 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:04.454097 16529 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:04.457312 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.457396 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1014) took 1089 ms. Trace:
I20260709 13:07:04.457984 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.464636 16561 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:04.465965 16490 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:04.466025 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.467391 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.468502 16485 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.480216 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 985) took 1424 ms. Trace:
I20260709 13:07:04.477670 17981 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.468935 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.478739 16633 rpcz_store.cc:276] 0709 13:07:03.367844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.368066 (+   222us) service_pool.cc:224] Handling call
0709 13:07:04.407898 (+1039832us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:04.457336 (+ 49438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7456000}
I20260709 13:07:04.480844 17981 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.480671 16485 rpcz_store.cc:276] 0709 13:07:03.055457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.468079 (+1412622us) service_pool.cc:224] Handling call
0709 13:07:04.468351 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.480024 (+ 11673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.480172 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:04.482493 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.482839 17981 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.481156 16563 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:04.479318 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 984) took 1428 ms. Trace:
I20260709 13:07:04.483925 16633 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:04.483983 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.478667 16557 raft_consensus.cc:2376] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5. Re-sending same reply.
I20260709 13:07:04.484825 16563 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:04.485270 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.485471 16633 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.470621 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:04.470028 16635 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:04.485882 16563 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:04.472278 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:04.478036 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.487541 18723 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:04.487673 16454 connection.cc:256] RPC call timeout handler was delayed by -1.076570519000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 13:07:04.487993 18723 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:04.488376 18723 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.488446 18788 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.488933 18788 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.489634 17981 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.490072 17981 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.487131 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:04.491605 18431 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.491998 18431 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.486907 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1520) took 1508 ms. Trace:
I20260709 13:07:04.492341 18431 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.487232 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1519) took 1528 ms. Trace:
I20260709 13:07:04.493093 16563 rpcz_store.cc:276] 0709 13:07:02.958626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.485395 (+1526769us) service_pool.cc:224] Handling call
0709 13:07:04.485620 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.487042 (+  1422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.487186 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.475039 16566 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:04.476758 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:04.494812 16564 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.494968 16559 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:04.483870 16490 rpcz_store.cc:276] 0709 13:07:03.051342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.451201 (+1399859us) service_pool.cc:224] Handling call
0709 13:07:04.465681 (+ 14480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.479075 (+ 13394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.479259 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.500453 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.500711 16633 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.492727 16557 rpcz_store.cc:276] 0709 13:07:02.978337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.486248 (+1507911us) service_pool.cc:224] Handling call
0709 13:07:04.486506 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.486647 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.486669 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.486708 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:04.486736 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.486780 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.486864 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.492358 17981 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:04.499312 18431 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.504148 18431 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.505817 16636 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:04.506337 16566 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:04.506927 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1731) took 1352 ms. Trace:
I20260709 13:07:04.472045 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.504355 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.507843 16490 raft_consensus.cc:2410] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:07:04.475382 18733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.390s	user 0.006s	sys 0.025s
W20260709 13:07:04.520784 18733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.446s	user 0.006s	sys 0.025s
I20260709 13:07:04.507320 16566 rpcz_store.cc:276] 0709 13:07:03.154627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.505043 (+1350416us) service_pool.cc:224] Handling call
0709 13:07:04.506078 (+  1035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.506712 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.506876 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.522224 16564 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:04.466187 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 981) took 1425 ms. Trace:
I20260709 13:07:04.475530 18712 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.477321 18797 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
W20260709 13:07:04.671875 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.540081 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1544) took 1561 ms. Trace:
I20260709 13:07:04.579073 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 990) took 1513 ms. Trace:
I20260709 13:07:04.691803 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:04.624289 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1521) took 1631 ms. Trace:
I20260709 13:07:04.646466 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:04.711362 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.712652 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1013) took 1401 ms. Trace:
I20260709 13:07:04.711200 16485 rpcz_store.cc:276] 0709 13:07:03.065218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.481891 (+1416673us) service_pool.cc:224] Handling call
0709 13:07:04.482147 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.482319 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:04.482578 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.578755 (+ 96177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.578804 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.578861 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.578919 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.579022 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":861,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":330,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":95420,"threads_started":1}
I20260709 13:07:04.711727 16562 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:04.711938 16563 rpcz_store.cc:276] 0709 13:07:02.992494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.508193 (+1515699us) service_pool.cc:224] Handling call
0709 13:07:04.623778 (+115585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.623984 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.624008 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.624047 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:04.624086 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.624133 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.624234 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.714123 16638 rpcz_store.cc:276] 0709 13:07:03.311627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.312332 (+   705us) service_pool.cc:224] Handling call
0709 13:07:04.691646 (+1379314us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:04.712589 (+ 20943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17135360}
I20260709 13:07:04.716956 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1739) took 1296 ms. Trace:
W20260709 13:07:04.689699 18744 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.003s
I20260709 13:07:04.717659 16563 rpcz_store.cc:276] 0709 13:07:03.420328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.716236 (+1295908us) service_pool.cc:224] Handling call
0709 13:07:04.716496 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.716657 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.716695 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.716732 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.716769 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.716818 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.716909 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.711544 16488 rpcz_store.cc:276] 0709 13:07:02.978999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.979783 (+   784us) service_pool.cc:224] Handling call
0709 13:07:04.384074 (+1404291us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:04.384240 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.384428 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:04.491626 (+107198us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.539756 (+ 48130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.539818 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.539863 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.539923 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.540026 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19374,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":860,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":7743872,"thread_start_us":153667,"threads_started":2}
I20260709 13:07:04.588491 18786 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.718321 18744 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.651484 18788 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.613963 18775 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.710827 18797 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.625560 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1540) took 1686 ms. Trace:
I20260709 13:07:04.757041 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.720981 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.721195 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1740) took 1285 ms. Trace:
I20260709 13:07:04.536726 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:04.618510 18716 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.647346 18335 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.536578 16564 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:04.371135 16483 rpcz_store.cc:276] 0709 13:07:02.996407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.166379 (+1169972us) service_pool.cc:224] Handling call
0709 13:07:04.166664 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.166849 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:04.297134 (+130285us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.366392 (+ 69258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.366439 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.366482 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.366538 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.366635 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"thread_start_us":140562,"threads_started":2}
I20260709 13:07:04.798733 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.799067 16454 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.799654 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1735) took 1479 ms. Trace:
I20260709 13:07:04.797868 16561 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:04.800320 16454 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:04.646893 18777 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.788815 18786 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.742125 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1004) took 1684 ms. Trace:
I20260709 13:07:04.790385 16563 rpcz_store.cc:276] 0709 13:07:03.435607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.719225 (+1283618us) service_pool.cc:224] Handling call
0709 13:07:04.719943 (+   718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.720102 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.720124 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.720160 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.720196 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.721047 (+   851us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.721150 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.788409 16489 rpcz_store.cc:276] 0709 13:07:02.938868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.938990 (+   122us) service_pool.cc:224] Handling call
0709 13:07:02.939281 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.967383 (+ 28102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.967415 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.967454 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:02.967484 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.527333 (+1559849us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54002ac6d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:04.527380 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.625507 (+ 98127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64212224}
I20260709 13:07:04.804999 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.622712 18723 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.711061 18793 consensus_queue.cc:1243] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:04.746469 18342 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.675174 16482 rpcz_store.cc:276] 0709 13:07:03.040736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.409714 (+1368978us) service_pool.cc:224] Handling call
0709 13:07:04.410070 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.465909 (+ 55839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.466133 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.716488 18712 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.737021 18612 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.803284 16631 raft_consensus.cc:2368] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:04.803478 18335 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.810225 18786 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.741626 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 393) took 2207 ms. Trace:
I20260709 13:07:04.803942 18776 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.814559 17184 rpcz_store.cc:276] 0709 13:07:02.534638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.540427 (+  5789us) service_pool.cc:224] Handling call
0709 13:07:03.074036 (+533609us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b58001e0998. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:03.074206 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.147127 (+ 72921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.741387 (+1594260us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b54000a46d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:04.741546 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93964032}
I20260709 13:07:04.814896 16485 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:04.736138 18797 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.740458 18267 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:04.739465 18746 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.667s	user 0.013s	sys 0.018s
I20260709 13:07:04.805737 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:04.625293 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:04.806587 16483 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:04.800089 16564 rpcz_store.cc:276] 0709 13:07:03.320251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.535925 (+1215674us) service_pool.cc:224] Handling call
0709 13:07:04.536385 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.799344 (+262959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.799599 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.804790 16639 rpcz_store.cc:276] 0709 13:07:03.058039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.058160 (+   121us) service_pool.cc:224] Handling call
0709 13:07:03.132544 (+ 74384us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:03.132701 (+   157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.438866 (+306165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.741915 (+1303049us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003d0754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:04.742073 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423781888}
I20260709 13:07:04.807540 16488 raft_consensus.cc:2368] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:04.809355 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:04.807998 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 336019us
I20260709 13:07:04.792129 18744 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:04.826313 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:04.829691 16483 raft_consensus.cc:2376] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5. Re-sending same reply.
W20260709 13:07:04.832127 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.833544 16491 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.833933 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 972) took 1838 ms. Trace:
I20260709 13:07:04.834107 16491 rpcz_store.cc:276] 0709 13:07:02.995751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.146719 (+1150968us) service_pool.cc:224] Handling call
0709 13:07:04.833308 (+686589us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:04.833434 (+   126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.833789 (+   355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.833896 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6158080}
I20260709 13:07:04.837028 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1546) took 1684 ms. Trace:
I20260709 13:07:04.810856 16563 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.811359 18716 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.793078 18775 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.820385 16561 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:04.840554 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1742) took 1325 ms. Trace:
I20260709 13:07:04.840797 16561 rpcz_store.cc:276] 0709 13:07:03.515507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.806196 (+1290689us) service_pool.cc:224] Handling call
0709 13:07:04.820102 (+ 13906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.840385 (+ 20283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.840518 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.821153 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1728) took 1732 ms. Trace:
I20260709 13:07:04.822202 16566 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.825840 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.826546 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:04.844795 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.844997 16489 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.826982 18788 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.827354 18484 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.843259 16559 rpcz_store.cc:276] 0709 13:07:03.089171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.499235 (+1410064us) service_pool.cc:224] Handling call
0709 13:07:04.499493 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.499670 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:04.635375 (+135705us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.820813 (+185438us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.820859 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.820903 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.820964 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.821062 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":173120,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":168,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2624,"thread_start_us":311369,"threads_started":2,"wal-append.queue_time_us":191282}
I20260709 13:07:04.878151 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 209) took 1690 ms. Trace:
I20260709 13:07:04.878496 16489 rpcz_store.cc:276] 0709 13:07:03.188145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.844640 (+1656495us) service_pool.cc:224] Handling call
0709 13:07:04.844851 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.846815 (+  1964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.878104 (+ 31289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.879474 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:04.878587 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.880365 17187 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.838147 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1743) took 1044 ms. Trace:
I20260709 13:07:04.881023 16563 rpcz_store.cc:276] 0709 13:07:03.794192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.809332 (+1015140us) service_pool.cc:224] Handling call
0709 13:07:04.809600 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.837919 (+ 28319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.838097 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.881809 16563 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:04.882035 16563 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:04.837440 16483 rpcz_store.cc:276] 0709 13:07:03.152678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.836346 (+1683668us) service_pool.cc:224] Handling call
0709 13:07:04.836588 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.836751 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.836776 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.836815 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:04.836849 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.836897 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.836980 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.826131 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:04.883421 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57525.9us
I20260709 13:07:04.884111 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.887848 17981 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.889536 16561 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.891299 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 212) took 1694 ms. Trace:
I20260709 13:07:04.891690 16483 rpcz_store.cc:276] 0709 13:07:03.189328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.883064 (+1693736us) service_pool.cc:224] Handling call
0709 13:07:04.883271 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.883382 (+   111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.883397 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.883421 (+    24us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.883437 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.883468 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.883529 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.828873 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:04.900997 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 446941us
I20260709 13:07:04.835325 18335 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:04.882527 16563 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:04.867841 18612 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:04.894572 18803 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.105s	user 0.000s	sys 0.003s
I20260709 13:07:04.887899 18716 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.877960 18531 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:04.911599 16563 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.825012 18797 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.913371 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.887424 18484 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:04.894166 18342 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:04.903172 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:04.939409 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:04.914146 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:04.893482 18793 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.952359 16561 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:04.958464 16563 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:04.958873 16563 pending_rounds.cc:85] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:07:04.959085 16563 pending_rounds.cc:107] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:04.959381 16563 raft_consensus.cc:2889] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.926542 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:04.912499 16482 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.998088 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1509) took 2573 ms. Trace:
I20260709 13:07:04.968581 16563 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:07:04.988085 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 74009us
I20260709 13:07:04.933893 18808 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.000247 16558 rpcz_store.cc:276] 0709 13:07:02.396761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.756285 (+359524us) service_pool.cc:224] Handling call
0709 13:07:02.784171 (+ 27886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.791922 (+  7751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.791954 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.830877 (+ 38923us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.975273 (+144396us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:02.986170 (+ 10897us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.986381 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.986446 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.181758 (+195312us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b18003f0880. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:04.738992 (+1557234us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:04.969717 (+230725us) raft_consensus.cc:1685] finished
0709 13:07:04.969738 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.969854 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19036,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3527,"raft.queue_time_us":9535,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":28742,"spinlock_wait_cycles":21181952,"thread_start_us":127966,"threads_started":1,"wal-append.queue_time_us":212705}
I20260709 13:07:05.002544 16558 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:05.002888 16558 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:05.008874 18808 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.009413 18808 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.011508 18808 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.003821 16558 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.014401 16558 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.912465 18335 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:04.951965 18793 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.997562 18342 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.946317 18484 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.023958 18770 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.021647 18777 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.027088 16558 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:05.049505 16558 pending_rounds.cc:85] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 2
I20260709 13:07:05.049733 16558 pending_rounds.cc:107] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:05.049954 16558 raft_consensus.cc:2889] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.001011 16563 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:05.028362 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:05.028813 17981 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:05.030821 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:05.036460 18801 log.cc:927] Time spent T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:07:05.037115 18811 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:07:05.037297 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 975) took 2040 ms. Trace:
I20260709 13:07:04.968056 18612 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:07:04.942301 18531 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.038635 18267 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.039171 18723 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:05.056388 18770 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.068837 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:05.070168 18770 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:05.044281 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1545) took 1892 ms. Trace:
I20260709 13:07:05.047624 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1547) took 1894 ms. Trace:
I20260709 13:07:04.987066 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:05.028215 18814 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:05.055935 17981 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:04.943418 18807 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
W20260709 13:07:05.078557 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 165252us
I20260709 13:07:05.058739 16487 rpcz_store.cc:276] 0709 13:07:02.996870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.207138 (+1210268us) service_pool.cc:224] Handling call
0709 13:07:04.384815 (+177677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.392172 (+  7357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.037099 (+644927us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002990d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:05.037231 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407961344}
W20260709 13:07:05.037846 18806 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:07:05.036329 18786 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:05.044420 18793 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.064582 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 982) took 2017 ms. Trace:
I20260709 13:07:05.073050 16488 rpcz_store.cc:276] 0709 13:07:03.152341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.830281 (+1677940us) service_pool.cc:224] Handling call
0709 13:07:04.879557 (+ 49276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.879736 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:04.910226 (+ 30490us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.044045 (+133819us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.044094 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.044129 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.044170 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.044241 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1587,"prepare.queue_time_us":31262,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":83,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":7399,"thread_start_us":133423,"threads_started":1}
I20260709 13:07:05.076673 17981 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:05.074280 16491 rpcz_store.cc:276] 0709 13:07:03.152948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.834634 (+1681686us) service_pool.cc:224] Handling call
0709 13:07:04.834819 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.834947 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:04.850145 (+ 15198us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.025241 (+175096us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.047295 (+ 22054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.047353 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.047399 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.047461 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.047571 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54626,"prepare.queue_time_us":25925,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":55586,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":84643,"threads_started":1}
I20260709 13:07:05.079731 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:05.081843 16484 rpcz_store.cc:276] 0709 13:07:03.047510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.448934 (+1401424us) service_pool.cc:224] Handling call
0709 13:07:04.449207 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.449520 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.449544 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.449965 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.538784 (+ 88819us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:04.596590 (+ 57806us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.596784 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.596854 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.064372 (+467518us) raft_consensus.cc:1685] finished
0709 13:07:05.064392 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.064525 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74970,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":386,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":157,"thread_start_us":88485,"threads_started":1,"wal-append.queue_time_us":370926}
I20260709 13:07:05.084769 17981 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.083623 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.085786 17981 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.086149 16484 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:05.083600 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:05.091156 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:05.092373 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.093056 16484 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:07:05.101030 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:05.105865 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.093931 18431 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:07:05.107846 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:05.118008 18342 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.118402 18431 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:05.118542 18342 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.120568 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1736) took 1721 ms. Trace:
I20260709 13:07:05.120954 16562 rpcz_store.cc:276] 0709 13:07:03.398852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.714821 (+1315969us) service_pool.cc:224] Handling call
0709 13:07:04.715104 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.808545 (+ 93441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.808575 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.808614 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:04.808649 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.120348 (+311699us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b5400018954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:05.120394 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.120512 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214472960}
I20260709 13:07:05.122747 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1733) took 1811 ms. Trace:
I20260709 13:07:05.123108 16566 rpcz_store.cc:276] 0709 13:07:03.311553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.535866 (+1224313us) service_pool.cc:224] Handling call
0709 13:07:04.671810 (+135944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.844074 (+172264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.122535 (+278461us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540006c7d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:05.122685 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345478912}
I20260709 13:07:05.160221 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.094108 18723 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:05.113809 17183 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:05.091918 18770 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.175261 16488 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:05.178892 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.178745 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1730) took 2031 ms. Trace:
W20260709 13:07:05.168417 18353 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.096s	user 0.018s	sys 0.035s
I20260709 13:07:05.170137 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1728) took 1099 ms. Trace:
I20260709 13:07:05.180521 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.175868 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.176365 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.185231 16562 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:05.186309 16488 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:05.183450 16640 rpcz_store.cc:276] 0709 13:07:04.070271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.258572 (+188301us) service_pool.cc:224] Handling call
0709 13:07:04.258808 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.258981 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:04.304579 (+ 45598us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.364818 (+ 60239us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.132567 (+767749us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b180038c140. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f0636483060 00007f0636495716 00007f06364a6287 00007f06364a6208
0709 13:07:05.169461 (+ 36894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.169621 (+   160us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.169749 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.169955 (+   206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.170077 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":824914,"prepare.queue_time_us":201832,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":847284,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":9812,"spinlock_wait_cycles":10157312,"thread_start_us":70855,"threads_started":2,"wal-append.queue_time_us":133158}
I20260709 13:07:05.187666 16560 raft_consensus.cc:2368] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:05.181306 16557 rpcz_store.cc:276] 0709 13:07:03.147758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.501865 (+1354107us) service_pool.cc:224] Handling call
0709 13:07:04.502160 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.502367 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.502392 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.502920 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.800832 (+297912us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:04.800867 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.800927 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.178562 (+377635us) raft_consensus.cc:1685] finished
0709 13:07:05.178581 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.178691 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":297510,"threads_started":1,"wal-append.queue_time_us":332525}
I20260709 13:07:05.192876 18668 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:05.193270 18668 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.193997 18668 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.195077 18668 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.196055 18741 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:05.196414 18741 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.197114 18741 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.198172 18741 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.183010 18781 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.201332 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.201927 16484 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:05.177786 18775 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:05.201256 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 728995us
I20260709 13:07:05.204953 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1729) took 1134 ms. Trace:
I20260709 13:07:05.204059 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.204949 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:05.207371 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:05.188481 18353 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.116s	user 0.018s	sys 0.035s
W20260709 13:07:05.203707 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.205476 16634 rpcz_store.cc:276] 0709 13:07:04.070494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.260084 (+189590us) service_pool.cc:224] Handling call
0709 13:07:04.292201 (+ 32117us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:04.297353 (+  5152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.297382 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:04.298612 (+  1230us) log.cc:844] Serialized 52 byte log entry
0709 13:07:04.374345 (+ 75733us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:04.573156 (+198811us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.204671 (+631515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.204736 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.204779 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:05.204790 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.204903 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":641250,"prepare.queue_time_us":52041,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":4867,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10217,"thread_start_us":210827,"threads_started":2,"wal-append.queue_time_us":139746}
I20260709 13:07:05.204365 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.206391 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:05.211445 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:05.212448 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.208317 16604 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:05.202706 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.214807 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.212973 16639 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:05.217103 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:05.218295 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.219573 16638 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:05.218266 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:05.220593 16640 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:05.189613 18612 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.224517 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:05.230243 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 122509us
I20260709 13:07:05.233634 16564 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:05.202191 18781 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:05.240738 18816 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:05.241139 18797 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.243427 16490 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:05.244141 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:05.246143 16482 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:05.251639 16640 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:07:05.223752 18775 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.262878 16637 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:05.260965 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:05.280764 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 190871us
I20260709 13:07:05.245071 18781 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.238884 18770 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:05.295845 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 211690us
I20260709 13:07:05.297559 18775 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:05.302722 18775 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.262658 18712 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:05.310019 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 946016us
I20260709 13:07:05.312054 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.312768 16562 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:05.257198 18619 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:05.314303 17185 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:05.314901 17185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 480) took 1131 ms. Trace:
I20260709 13:07:05.315178 17185 rpcz_store.cc:276] 0709 13:07:04.183417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.183704 (+   287us) service_pool.cc:224] Handling call
0709 13:07:05.313933 (+1130229us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b58001e0998. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:05.314119 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.314672 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.314849 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12258048}
I20260709 13:07:05.272611 18723 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:05.300791 18770 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:05.319079 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.303998 18732 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:05.319944 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.321208 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.321472 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:05.324048 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:05.334148 16560 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:05.324697 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.308947 18819 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:07:05.254086 18612 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.309336 18335 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.327615 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.319917 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.339823 16562 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:05.333686 16558 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:05.339738 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:05.299413 18781 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.309449 18531 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:05.312618 18820 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:05.342787 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:05.328331 18712 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:07:05.375346 16560 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:05.344056 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:05.361941 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:05.376916 16482 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:05.377532 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:05.347839 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.364960 16530 leader_election.cc:400] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:05.380945 16530 leader_election.cc:403] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.361128 18732 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.384478 18700 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.385020 18732 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.386308 18771 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:05.386791 18771 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.365541 18335 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:05.388350 18335 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:05.365381 18712 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.389071 18335 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.389575 18712 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:05.389974 18712 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.390188 18335 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:05.391839 18825 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:07:05.393603 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:05.395047 18817 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:05.384342 18824 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:05.395614 18818 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.398826 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.341188 18619 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.383116 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:05.401036 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 214) took 2210 ms. Trace:
W20260709 13:07:05.402724 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.406412 16640 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:05.407716 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:05.409777 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1526) took 1378 ms. Trace:
I20260709 13:07:05.410349 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:05.410629 16559 rpcz_store.cc:276] 0709 13:07:04.031462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.885412 (+853950us) service_pool.cc:224] Handling call
0709 13:07:04.909048 (+ 23636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.072649 (+163601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.072677 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.073055 (+   378us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.297767 (+224712us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.404092 (+106325us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.408895 (+  4803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.409133 (+   238us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.409267 (+   134us) raft_consensus.cc:1685] finished
0709 13:07:05.409280 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.409642 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28552,"raft.queue_time_us":77186,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":38969,"thread_start_us":448719,"threads_started":3,"wal-append.queue_time_us":248898}
I20260709 13:07:05.405397 16487 rpcz_store.cc:276] 0709 13:07:03.191031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.087956 (+1896925us) service_pool.cc:224] Handling call
0709 13:07:05.395245 (+307289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.395418 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.395442 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.395494 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.395524 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.395575 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.400909 (+  5334us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54002e40d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:05.400990 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705998080}
I20260709 13:07:05.414734 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.415556 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:05.414209 18763 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:05.417032 16483 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:05.418251 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:05.420589 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.422842 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:05.433224 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.433871 16487 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.399266 18818 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.434294 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.441530 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:05.358264 18827 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:07:05.365774 18531 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:05.342954 18830 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:07:05.454895 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 113337us
I20260709 13:07:05.450686 16455 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:05.456578 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:05.448805 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 191814us
I20260709 13:07:05.456779 17981 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.457584 17981 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.457880 17981 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.448424 18715 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.440069 18797 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.452343 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:05.459774 18733 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:05.432300 18700 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.419696 18776 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.494465 18782 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:05.494877 18782 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.495944 16484 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:05.495698 18782 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.497014 16485 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.364046 18820 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.395022 18781 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.455761 18817 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.453455 18818 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.344446 18770 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.387612 18771 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.470458 18809 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.475659 17981 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.476788 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:05.477638 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:05.387949 18723 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.488154 17185 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.439900 18668 consensus_queue.cc:1059] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:05.529260 17153 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:05.490231 18837 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:07:05.490963 18828 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:07:05.491673 16631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1022) took 1423 ms (client timeout 1794 ms). Trace:
I20260709 13:07:05.492626 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1744) took 1632 ms. Trace:
I20260709 13:07:05.492401 18619 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.448355 18763 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:05.469478 18832 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:05.503407 18776 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.533679 18770 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.456099 18788 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.449153 18768 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:05.512166 17981 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:05.512117 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 53619.3us
W20260709 13:07:05.513624 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 61358.8us
I20260709 13:07:05.477017 18797 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:05.571130 18797 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.454859 18353 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:07:05.572211 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.494503 18342 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.510360 16485 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:05.469760 18807 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:07:05.545680 16564 rpcz_store.cc:276] 0709 13:07:03.860259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.824054 (+963795us) service_pool.cc:224] Handling call
0709 13:07:04.835961 (+ 11907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.233994 (+398033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.492416 (+258422us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b540040e054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:05.492577 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914188544}
W20260709 13:07:05.513928 18829 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:07:05.548923 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.507879 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:05.559438 18531 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.533365 18808 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:05.532853 18765 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:05.531062 18715 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.573277 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.594285 16562 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:05.573897 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:05.574486 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.595155 16485 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.575775 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 210) took 2387 ms. Trace:
I20260709 13:07:05.595767 16489 rpcz_store.cc:276] 0709 13:07:03.188463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.879227 (+1690764us) service_pool.cc:224] Handling call
0709 13:07:05.124889 (+245662us) spinlock_profiling.cc:243] Waited 924 us on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366eee 0000000000375939 00007f063b3da1e0 00007f063b4a30c4 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:05.125035 (+   146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.168925 (+ 43890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.168955 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.177903 (+  8948us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.306028 (+128125us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:05.306066 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.306126 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.561641 (+255515us) raft_consensus.cc:1685] finished
0709 13:07:05.561660 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.575715 (+ 14055us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41446,"raft.queue_time_us":43336,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":2124672,"thread_start_us":113796,"threads_started":1,"wal-append.queue_time_us":210723}
I20260709 13:07:05.592376 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1552) took 1083 ms. Trace:
I20260709 13:07:05.599476 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 191) took 1304 ms. Trace:
I20260709 13:07:05.599851 16635 rpcz_store.cc:276] 0709 13:07:04.295360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.486305 (+190945us) service_pool.cc:224] Handling call
0709 13:07:04.486543 (+   238us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:05.200144 (+713601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.200173 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:05.200742 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:07:05.308922 (+108180us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.308963 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.309024 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.599285 (+290261us) raft_consensus.cc:1685] finished
0709 13:07:05.599303 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.599427 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713212,"raft.queue_time_us":714343,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":85,"thread_start_us":107786,"threads_started":1,"wal-append.queue_time_us":180587}
I20260709 13:07:05.598518 16488 rpcz_store.cc:276] 0709 13:07:04.508946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.256043 (+747097us) service_pool.cc:224] Handling call
0709 13:07:05.283369 (+ 27326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.283740 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.283767 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.284214 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.339217 (+ 55003us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:05.339280 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.339372 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.592176 (+252804us) raft_consensus.cc:1685] finished
0709 13:07:05.592194 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.592325 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1777,"thread_start_us":26668,"threads_started":1,"wal-append.queue_time_us":116255}
W20260709 13:07:05.575814 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 117673us
I20260709 13:07:05.571833 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.605937 16565 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:07:05.559911 18830 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:05.606683 18830 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:05.607082 18830 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.533020 18700 consensus_queue.cc:1059] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:07:05.567452 18820 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.590545 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1554) took 1081 ms. Trace:
I20260709 13:07:05.589278 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.584059 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:05.584292 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:05.583897 18788 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:05.613950 16558 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:07:05.615320 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.613101 16490 rpcz_store.cc:276] 0709 13:07:04.509385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.393766 (+884381us) service_pool.cc:224] Handling call
0709 13:07:05.394069 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.394367 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.394396 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.394808 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.418273 (+ 23465us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:05.418312 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.418411 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.590350 (+171939us) raft_consensus.cc:1685] finished
0709 13:07:05.590370 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.590489 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2125,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9988,"thread_start_us":23088,"threads_started":1,"wal-append.queue_time_us":103418}
I20260709 13:07:05.619768 16558 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
W20260709 13:07:05.633761 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 49763.3us
I20260709 13:07:05.565424 18776 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:05.546463 16631 rpcz_store.cc:269] 0709 13:07:04.068732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.068946 (+   214us) service_pool.cc:224] Handling call
0709 13:07:05.491483 (+1422537us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54003264d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:05.491617 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489394048}
W20260709 13:07:05.761270 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 247715us
I20260709 13:07:05.762127 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:05.763067 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:05.763890 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:05.578442 18315 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:07:05.633668 18808 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:05.636472 18741 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:05.673508 17179 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:05.637879 18668 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.641709 18817 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.808877 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:05.779454 18436 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:05.842345 18436 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:05.792629 18531 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:05.844772 18531 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.845136 18531 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.815909 18817 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.806500 18762 raft_consensus.cc:3055] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:05.819427 18431 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:05.824631 17185 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.826944 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:05.828428 17186 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:05.830140 17180 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:05.832101 18788 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.836256 18781 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:05.837810 18776 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.838320 18839 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.839092 18668 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.805089 18741 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.668268 18765 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:07:05.667728 18820 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.144s
W20260709 13:07:05.842056 18793 consensus_meta.cc:287] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.001s
W20260709 13:07:05.853235 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 290775us
I20260709 13:07:05.855734 18817 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.853294 18762 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:05.805583 18775 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.634042 18715 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:05.864431 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 393919us
I20260709 13:07:05.856138 18431 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:05.896000 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:05.844157 18834 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:05.855948 18269 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:05.899163 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:05.905493 18269 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.907670 18269 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:05.887694 18484 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:07:05.904644 18834 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:05.908536 18712 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
W20260709 13:07:05.909289 18840 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.363s	user 0.004s	sys 0.003s
I20260709 13:07:05.909646 18834 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.910244 18834 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.910291 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1031) took 1541 ms. Trace:
I20260709 13:07:05.910743 16633 rpcz_store.cc:276] 0709 13:07:04.369022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.501516 (+132494us) service_pool.cc:224] Handling call
0709 13:07:04.501868 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.201570 (+699702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.201597 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.202008 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.384095 (+182087us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.384137 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.407854 (+ 23717us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.908767 (+500913us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:05.910025 (+  1258us) raft_consensus.cc:1685] finished
0709 13:07:05.910046 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.910230 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713351,"raft.queue_time_us":702358,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":3235,"spinlock_wait_cycles":3005056,"thread_start_us":181745,"threads_started":1,"wal-append.queue_time_us":268845}
I20260709 13:07:05.911753 18484 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:05.912247 18484 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:05.913039 18484 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.914101 18484 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.914776 18775 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:05.793147 18763 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:05.910324 16455 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:05.917048 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:05.917801 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:05.901387 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 213) took 2711 ms. Trace:
I20260709 13:07:05.918396 16483 rpcz_store.cc:276] 0709 13:07:03.189611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.892649 (+1703038us) service_pool.cc:224] Handling call
0709 13:07:05.403744 (+511095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.431949 (+ 28205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.901211 (+469262us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54000e8650. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:05.901335 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174604544}
I20260709 13:07:05.905531 18762 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:05.950160 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 379705us
I20260709 13:07:05.908926 18712 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:05.946638 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.961373 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 43634.8us
I20260709 13:07:05.961988 17981 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:05.969404 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.970039 16565 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:07:05.970986 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.971308 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:05.971768 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.969931 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:05.972394 16566 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:05.973639 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:05.974212 16564 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.976478 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:05.972937 16563 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:05.910535 18668 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:05.922701 18431 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.980466 16566 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:05.984127 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:05.984903 16635 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.942821 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1556) took 1433 ms. Trace:
I20260709 13:07:05.911885 18744 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:05.949394 18768 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.920296 18827 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:05.898645 18839 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:05.910611 18834 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:05.962947 18775 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.002431 18762 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.964599 18342 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.003424 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:06.024616 16559 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:06.001467 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:05.980088 18813 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.893967 18793 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.010854 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.013325 16487 rpcz_store.cc:276] 0709 13:07:04.509795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.448312 (+938517us) service_pool.cc:224] Handling call
0709 13:07:05.455057 (+  6745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.501582 (+ 46525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.501612 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.501653 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.501693 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.942592 (+440899us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b5400178c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:05.942637 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.942763 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106546432}
I20260709 13:07:05.979329 18846 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:07:06.020588 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.889813 18844 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
W20260709 13:07:06.033324 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 392361us
I20260709 13:07:06.027240 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:05.995756 16564 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:05.991122 18814 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:07:06.045487 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 65547.1us
I20260709 13:07:06.023046 18834 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.047173 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:06.018854 16483 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:05.931116 18808 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.980340 18741 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:05.966342 18830 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.097759 16491 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:06.104874 16559 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:06.045328 17183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.005s	sys 0.008s
W20260709 13:07:06.123911 17183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.005s	sys 0.008s
I20260709 13:07:06.124837 16559 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:06.125806 18715 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:06.107124 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 85759.7us
I20260709 13:07:06.108383 16566 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:07:06.104863 18335 consensus_meta.cc:287] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.004s
I20260709 13:07:06.130246 18830 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:06.131640 18835 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.630s	user 0.003s	sys 0.006s
I20260709 13:07:06.131969 18732 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.132364 18732 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:06.133100 18732 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.134196 18732 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.047657 18807 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:06.118443 18267 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.109081 18733 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:06.121191 18851 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:07:06.123131 18531 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:06.135538 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.181493 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.052320 18853 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:06.119565 18770 consensus_meta.cc:287] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.000s
W20260709 13:07:06.141894 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 378066us
I20260709 13:07:06.026641 18827 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.182461 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:06.152684 18793 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:06.156652 18852 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:06.202899 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1548) took 3049 ms. Trace:
I20260709 13:07:06.158499 18817 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.159492 18839 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.160018 18838 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:06.161281 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.042260 18744 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.136224 18776 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:06.186066 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:06.190958 18855 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:06.153497 18775 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.192744 18861 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.194412 18853 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.195228 18762 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:06.195950 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.176035 18830 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:07:06.095703 18813 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.201159 18531 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.183238 18668 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.202646 18712 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.156540 18807 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.203311 16486 rpcz_store.cc:276] 0709 13:07:03.154190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.835515 (+1681325us) service_pool.cc:224] Handling call
0709 13:07:04.885028 (+ 49513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.952452 (+ 67424us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:05.023494 (+ 71042us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.168864 (+145370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.168913 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:05.168955 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.941527 (+772572us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b1800219400. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419
0709 13:07:06.202676 (+261149us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b5400259254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:06.202722 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.202832 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16967,"prepare.queue_time_us":67650,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2234,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":2655,"spinlock_wait_cycles":156467712,"thread_start_us":142856,"threads_started":1,"wal-append.queue_time_us":213514}
I20260709 13:07:06.154910 18267 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:07:06.217597 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.215106 16633 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:06.224026 17180 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.236409 17981 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:06.236522 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 50532.8us
I20260709 13:07:06.229182 18853 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:06.230757 18797 consensus_meta.cc:287] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.000s
I20260709 13:07:06.232918 18817 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.236320 18668 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.255163 18797 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.255759 18847 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:06.235179 18861 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.257064 18668 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.233821 18855 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:06.257789 18861 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.258119 18855 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.245599 17981 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:06.261421 18818 consensus_meta.cc:287] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.000s
I20260709 13:07:06.262053 16565 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:06.181531 18733 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.248302 18827 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.249011 18433 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:06.218305 18776 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.251051 18744 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.206660 18838 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:06.257202 18847 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:06.273224 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.246130 18813 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:06.263355 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.261829 18818 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.278671 16491 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:06.279506 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.273741 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.280081 16483 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:06.274349 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.274189 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.281021 16635 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:06.276247 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:06.275161 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.266992 18763 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.284155 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.287544 16639 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:06.304768 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:06.220140 18762 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.220115 18775 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.314838 18531 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.315289 18531 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:06.315657 18531 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.317227 18818 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.318209 16557 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:06.319738 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.274171 18484 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:06.273511 18847 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:06.322326 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:06.320423 16640 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
W20260709 13:07:06.322508 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 84089.1us
I20260709 13:07:06.254953 18834 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.282886 18763 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:06.281855 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:06.364530 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:06.367901 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.369014 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:07:06.369175 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 94099.5us
W20260709 13:07:06.370015 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45833.7us
I20260709 13:07:06.370465 16456 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.374159 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:06.375154 17981 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.375478 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.362157 18744 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.372617 16631 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:05.451610 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:06.367350 18763 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.373445 18861 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:06.387516 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.323498 18839 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:06.385171 18834 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.390007 18854 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.392798 18807 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.392814 18854 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:06.393414 18854 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.323813 18849 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:06.324119 18267 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.395375 18849 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:06.391834 18797 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.395767 18849 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:06.396158 18267 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.380759 18824 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:06.390427 18868 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.397571 18733 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.364023 18484 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.388048 17179 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.386319 18744 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.417315 18744 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.418484 18776 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.380182 18872 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.419420 18872 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:06.419862 18872 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.423377 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:06.424507 16386 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 127) took 12076 ms (client timeout 15000 ms). Trace:
I20260709 13:07:06.388209 18858 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.428213 18858 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:06.428634 18858 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.404441 18762 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:06.424925 16386 rpcz_store.cc:269] 0709 13:06:54.380694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.391149 (+ 10455us) service_pool.cc:224] Handling call
0709 13:07:06.424322 (+12033173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:59.102815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:59.269398 (+166583us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:59.270308 (+   910us) write_op.cc:435] Acquired schema lock
0709 13:06:59.285072 (+ 14764us) tablet.cc:662] Decoding operations
0709 13:06:59.483460 (+198388us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:59.487723 (+  4263us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:59.488839 (+  1116us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:06:59.556068 (+ 67229us) tablet.cc:701] Row locks acquired
0709 13:06:59.556087 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:59.556232 (+   145us) write_op.cc:270] Start()
0709 13:06:59.556357 (+   125us) write_op.cc:276] Timestamp: P: 1783602419556187 usec, L: 0
0709 13:06:59.556376 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:59.566756 (+ 10380us) log.cc:844] Serialized 3640 byte log entry
0709 13:07:00.205781 (+639025us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:00.455564 (+249783us) op_driver.cc:464] REPLICATION: finished
0709 13:07:00.625216 (+169652us) write_op.cc:301] APPLY: starting
0709 13:07:00.633451 (+  8235us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:00.633729 (+   278us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:00.633766 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:00.822260 (+188494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:00.822589 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:07:00.858418 (+ 35829us) write_op.cc:312] APPLY: finished
0709 13:07:00.928665 (+ 70247us) log.cc:844] Serialized 71 byte log entry
0709 13:07:00.928843 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.929011 (+   168us) write_op.cc:454] Released schema lock
0709 13:07:00.929064 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:00.929494 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.929520 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1036097,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":129528,"apply.run_cpu_time_us":4532,"apply.run_wall_time_us":336337,"num_ops":9,"prepare.queue_time_us":318050,"prepare.run_cpu_time_us":9899,"prepare.run_wall_time_us":674205,"raft.queue_time_us":187241,"raft.run_cpu_time_us":13443,"raft.run_wall_time_us":95227,"replication_time_us":869182,"spinlock_wait_cycles":54369664,"thread_start_us":361821,"threads_started":4,"wal-append.queue_time_us":245750,"wal-append.run_cpu_time_us":65288,"wal-append.run_wall_time_us":2224762}]]}
I20260709 13:07:06.375074 17180 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:06.404384 18484 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:06.444595 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75860.5us
I20260709 13:07:06.446280 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:06.454145 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:06.457949 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:06.459697 18887 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:06.460402 18870 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:06.386474 18838 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.464543 18612 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.461974 18775 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.465214 18814 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:06.462761 18883 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:06.396606 18849 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.466526 18849 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.441362 18776 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.456741 18786 raft_consensus.cc:2764] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:06.445029 18531 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.470260 18531 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.470261 18782 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.464349 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:06.391093 18847 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.471858 18786 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.456941 18484 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:06.475894 18838 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.477521 18763 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.478701 16635 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.471774 18436 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.480758 18436 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.482308 17180 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:06.483961 18786 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:06.491108 18786 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.491345 18872 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.492312 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:06.493047 18269 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:06.493404 18269 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.493716 18269 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.494786 18872 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.496024 18881 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:06.496801 18781 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.497212 18781 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.497558 18781 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:06.491226 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 45035.3us
I20260709 13:07:06.453474 18431 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.504190 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.504812 16489 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:06.507907 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.495190 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:06.511811 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.514045 16489 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.515674 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.517511 16491 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.520964 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.521905 17185 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.522115 16482 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:06.521435 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.517923 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:06.524376 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:06.521260 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.525633 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.526618 18762 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:06.527735 18868 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:06.529140 18860 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.529572 18860 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.529874 18860 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.527117 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.530859 18858 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.532406 16456 leader_election.cc:400] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:06.532691 16456 leader_election.cc:403] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:06.526866 18872 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:06.534344 18870 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.530874 18849 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.534968 18858 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.542021 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:06.549682 16482 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:06.552814 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:06.555266 16605 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:06.556695 16456 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.556772 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:06.559012 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.520004 17179 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:06.564328 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.566890 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:06.532680 18763 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.528244 18762 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.529157 18868 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:06.516780 18484 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:07:06.566008 18855 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.564321 18788 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.632192 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:06.564867 17180 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.562836 18433 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.565719 18846 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.583411 18868 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:06.633548 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 69911.8us
I20260709 13:07:06.585134 18484 consensus_queue.cc:1243] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:06.583246 18762 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:06.565797 18732 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:06.565636 18771 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:06.642050 16632 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:06.577852 18768 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:06.561591 18744 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 13:07:06.632710 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.586500 18872 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:06.685997 17981 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:06.695988 17981 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.585049 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:06.641844 18775 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.641291 18855 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:06.689248 18762 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.689299 18874 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.693077 18771 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:06.762748 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 194609us
I20260709 13:07:06.699910 18732 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:06.717564 18873 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
W20260709 13:07:06.724395 18892 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:07:06.724824 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.730034 18781 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.731495 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1776) took 1161 ms. Trace:
I20260709 13:07:06.664682 18854 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.732069 16564 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:07:06.736052 18868 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.736996 18431 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.668702 18788 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:06.700434 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.771808 16557 rpcz_store.cc:276] 0709 13:07:05.569657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.571983 (+  2326us) service_pool.cc:224] Handling call
0709 13:07:06.731278 (+1159295us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540032a0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:06.731415 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713868032}
I20260709 13:07:06.779690 17981 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.735491 18786 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.700251 18855 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.689363 18824 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:07:06.701215 18872 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:06.772068 18870 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:06.784701 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:06.702492 18775 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.785761 18786 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.786906 18775 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.774545 18826 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.769040 18762 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.790205 18762 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.799448 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:06.800216 17184 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:06.828147 18854 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.830591 18860 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.832190 18872 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.825425 18868 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.768980 18874 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:06.849043 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 78838.1us
I20260709 13:07:06.845922 17179 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:06.871506 17981 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.872005 17981 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.852232 18732 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.877393 18269 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.879418 18269 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:06.883762 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 110287us
I20260709 13:07:06.892503 17981 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:06.868667 18896 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:06.894295 18849 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.894654 18771 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.896137 18874 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:06.896843 18890 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:06.882869 18827 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:07:06.898741 16389 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 2 to 4, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.890201 18269 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:07:06.906327 18847 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.901348 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.906375 18855 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.894699 18849 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:06.910909 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.912143 16636 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.912886 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.913566 16634 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:06.914328 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.915717 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:06.919888 18781 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:06.920109 18830 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.920473 18830 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:06.920797 18849 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:06.921245 18830 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:06.921777 18849 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.936139 16389 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 3, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.937819 16389 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 2 to 3, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 3 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
W20260709 13:07:06.938522 18893 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 13:07:06.910072 18860 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:06.920838 18827 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.939756 18827 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:06.942620 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.943719 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 842950us
W20260709 13:07:06.969285 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 784155us
W20260709 13:07:06.974634 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.985241 16529 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:06.968454 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.985558 17186 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:06.968885 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:06.980399 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1543) took 1003 ms. Trace:
I20260709 13:07:06.988371 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.991062 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1542) took 1014 ms. Trace:
I20260709 13:07:06.991142 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.992691 16636 raft_consensus.cc:2368] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:06.987931 16561 rpcz_store.cc:276] 0709 13:07:05.976659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.976768 (+   109us) service_pool.cc:224] Handling call
0709 13:07:05.999677 (+ 22909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.999888 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:06.164064 (+164176us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.980097 (+816033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.980142 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:06.980185 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.980244 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.980349 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":786199,"prepare.queue_time_us":111458,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":766308,"thread_start_us":193373,"threads_started":2,"wal-append.queue_time_us":109046}
I20260709 13:07:06.994240 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.991452 16562 rpcz_store.cc:276] 0709 13:07:05.976407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.977210 (+   803us) service_pool.cc:224] Handling call
0709 13:07:05.977480 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.977661 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:05.988675 (+ 11014us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.990749 (+1002074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.990793 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.990830 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.990899 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.991013 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728491,"prepare.queue_time_us":25748,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":721915,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"thread_start_us":280264,"threads_started":1,"wal-append.queue_time_us":424982}
I20260709 13:07:06.996769 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:06.996958 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:06.997426 16634 raft_consensus.cc:2368] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:06.940593 18827 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.003305 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.000454 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.003937 16640 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:06.973428 18269 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.001395 16482 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:07.002400 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:06.974157 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:07.014253 18269 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:07.014914 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:06.995611 18870 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:07.009765 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.006119 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.105505 17185 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.018889 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.073361 16634 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:07.076332 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 91163.3us
I20260709 13:07:07.104228 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.116930 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.082765 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:07.073284 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1766) took 1089 ms. Trace:
I20260709 13:07:07.078754 16389 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 2 to 4, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.017549 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.119910 16488 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.117395 16529 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.017925 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.122390 16491 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.118598 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.118811 16633 rpcz_store.cc:276] 0709 13:07:05.983728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.983893 (+   165us) service_pool.cc:224] Handling call
0709 13:07:07.073125 (+1089232us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54002099d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:07.073229 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468720512}
I20260709 13:07:07.126080 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:07.056058 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.128470 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.018548 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.129557 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.131080 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.132843 16640 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:07.134100 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.132017 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.135689 16636 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:07.138106 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:07.137178 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:06.992581 18781 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:07.138535 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.140873 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.143316 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:07.018232 18782 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.076679 18715 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.064481 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:07.074877 18809 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:07.078326 18788 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.146850 16484 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:07.077723 18853 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.127737 18906 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.137049 18335 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:07.128108 18768 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.999909 18830 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:07.149113 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.076584 18909 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:07.069716 18855 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:07.140802 18844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.001s	sys 0.006s
I20260709 13:07:07.137494 18612 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.128861 18870 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.150732 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.151738 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.137217 18765 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.127899 18267 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.045275 18762 consensus_queue.cc:1059] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:07:07.083750 18872 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:07:07.186425 16634 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:07.281294 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 128325us
I20260709 13:07:07.195096 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:07.446696 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 251647us
I20260709 13:07:07.136498 17184 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.144620 18849 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.260061 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:07.454046 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 302353us
W20260709 13:07:07.445312 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.454766 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.454727 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.447237 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:07.373732 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1547) took 1376 ms. Trace:
I20260709 13:07:07.268110 16389 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.382882 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 196) took 1110 ms. Trace:
I20260709 13:07:07.457227 16632 rpcz_store.cc:276] 0709 13:07:06.272900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.273010 (+   110us) service_pool.cc:224] Handling call
0709 13:07:07.374624 (+1101614us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54000cba54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:07.382821 (+  8197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846768896}
I20260709 13:07:07.383351 16636 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:07.379042 16487 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:07.314503 16491 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:07.456502 16564 rpcz_store.cc:276] 0709 13:07:05.997651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.101630 (+103979us) service_pool.cc:224] Handling call
0709 13:07:06.731843 (+630213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.772839 (+ 40996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.373516 (+600677us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540032a0d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:07.373663 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448585088}
I20260709 13:07:07.459180 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.460713 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.146638 18777 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.463027 16488 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:07.463913 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.143500 18781 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:07.150302 18797 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.462175 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.148586 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:07.460002 18909 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.521967 18909 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.186219 18820 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.522550 18820 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.461942 18906 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.524360 18820 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.525473 18906 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.464183 18813 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.530107 16633 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:07.530959 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.531419 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.293701 17183 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:07.472852 16563 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:07.545938 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.546423 16563 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.471534 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.473843 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.547851 16558 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.153007 18845 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.490868 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:07.212563 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.463483 18826 consensus_queue.cc:1059] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:07.492311 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.492491 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.152623 18715 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.493148 16389 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 3 to 4, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.493410 18781 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.215039 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:07.494297 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.495343 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.151051 18782 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.496703 16557 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.193146 18269 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.214675 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:07.498387 18619 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:07.557734 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:07.498675 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.465548 18335 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.460227 18849 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:07.454828 18765 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.150044 18814 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.349s
W20260709 13:07:07.461354 18844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.002s	sys 0.010s
W20260709 13:07:07.501073 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.501863 16482 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.500322 18762 raft_consensus.cc:3055] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:07.193377 18818 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.578722 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:07.505885 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.193008 18809 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:07.513141 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.579181 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:07.516512 18910 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:07.185868 18807 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.357s
I20260709 13:07:07.531701 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.532456 18853 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.452889 18858 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.455519 18768 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.533615 18777 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.533784 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.310525 18788 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.224s
I20260709 13:07:07.470791 18612 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.602095 18335 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.602912 18612 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.465039 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.536164 18808 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:07.538583 18712 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.539000 18436 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.539721 16640 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:07.531455 16633 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:07.548316 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.548925 16566 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.553807 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.609902 16564 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:07.610172 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 56439.7us
I20260709 13:07:07.610687 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.579036 18762 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:07.555249 18845 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.570396 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:07.605113 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.577025 16603 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:07.581995 16563 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:07.567963 18906 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.584157 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.585238 16637 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:07.588220 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:07.625658 16491 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:07.588662 17182 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:07.595546 18909 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.600019 16482 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:07.584936 18818 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.573478 18619 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.585130 18853 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.574086 18849 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.573657 18781 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.607273 16561 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
W20260709 13:07:07.568953 17183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 498) took 1308 ms (client timeout 1665 ms). Trace:
I20260709 13:07:07.554384 16639 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:07.650913 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.556931 16559 raft_consensus.cc:2410] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:07.613867 18712 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.610949 16530 leader_election.cc:400] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:07.652781 16530 leader_election.cc:400] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:07.653085 16530 leader_election.cc:403] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:07.656457 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.657212 16639 raft_consensus.cc:2410] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:07.620788 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.620844 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.592693 18768 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.577603 16558 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:07.628562 16564 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:07.629065 16566 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:07.632937 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.662653 16563 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:07.641688 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:07.643021 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 66072.8us
I20260709 13:07:07.641216 18775 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.647642 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.614483 18777 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.651290 16489 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.630085 18612 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:07.636471 18909 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:07.664963 16632 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:07.665562 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:07.613516 18436 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.672968 18913 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.648388 18512 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.687929 16557 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
W20260709 13:07:07.671576 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 219772us
I20260709 13:07:07.660185 18817 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.665143 18335 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:07.641383 18906 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.714010 16488 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.701653 18913 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:07.722151 16632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:07.723317 16632 raft_consensus.cc:606] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:07.723635 16632 raft_consensus.cc:614] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:07.722642 16564 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:07.726269 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.726792 16564 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:07.727169 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.714491 18733 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.735760 16564 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:07.736718 16566 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.736863 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.742149 16558 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:07.743040 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.743575 16558 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:07.744298 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.744588 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.745177 16566 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:07.746158 16566 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:07.652204 17183 rpcz_store.cc:269] 0709 13:07:06.260772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.266662 (+  5890us) service_pool.cc:224] Handling call
0709 13:07:07.064332 (+797670us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b58001e0998. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:07.564724 (+500392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19959552}
I20260709 13:07:07.682248 18612 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.744800 16558 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.678053 18775 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.724838 18777 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.738565 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.765976 16559 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:07.684978 18900 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:07.685113 18315 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:07:07.721755 18732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.012s	sys 0.013s
I20260709 13:07:07.708374 18855 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:07.721048 18808 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:07.767591 16566 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:07.770931 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.700748 18762 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.792273 16559 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:07.753500 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:07.840443 16558 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:07.848783 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.849068 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.849344 16566 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:07.849921 16558 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:07.850179 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.850848 16566 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:07.856516 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.856591 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.858686 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.859844 16559 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:07.858217 16558 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:07.860852 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.725960 18909 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.861903 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.770154 18765 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.753556 18782 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.865176 16558 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:07.865453 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.863448 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:07.797022 18915 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:07:07.867504 18712 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:07.806244 18847 consensus_meta.cc:287] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.899s	user 0.006s	sys 0.005s
W20260709 13:07:07.791534 18732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.012s	sys 0.013s
W20260709 13:07:07.796622 18916 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:07:07.866101 16559 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:07.866360 16566 raft_consensus.cc:2410] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:07.856160 18436 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.858767 18906 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.804553 18612 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:07.805076 18914 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:07.870724 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.790639 18715 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.804394 18512 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.894702 18512 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:07.807092 18267 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:07.873684 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.867358 18838 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.899092 18838 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:07.900000 18838 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.900583 18845 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.867462 18775 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.805379 18809 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.876641 16632 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:07.902669 16632 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:07.903730 16632 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.905570 16632 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:07.753484 18733 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.905932 18768 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.907637 18733 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:07.875617 16638 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:07.859839 18619 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.881374 17184 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:07.882714 18826 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.909227 18818 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.900879 18838 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.909938 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:07.910822 18854 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.883838 16566 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:07.911947 16566 pending_rounds.cc:85] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 2
I20260709 13:07:07.912211 16566 pending_rounds.cc:107] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:07.912426 16566 raft_consensus.cc:2889] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.856027 18853 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.888473 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.914197 16559 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:07.915052 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.916054 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.895505 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:07.916301 18768 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:07.917026 16557 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.915046 16633 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:07.918318 16557 pending_rounds.cc:85] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 1
I20260709 13:07:07.918622 16557 pending_rounds.cc:107] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:07.918846 16557 raft_consensus.cc:2889] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.897650 18512 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.920120 18512 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.925201 18827 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.773988 18777 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.909368 18826 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.908099 18870 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:07.913456 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.930840 16566 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:07.804464 18808 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:07.946861 16565 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:07.948134 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.948879 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.953044 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.893749 18909 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.891289 18762 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.959475 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:07.960881 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.962355 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.964731 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.946002 18826 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:07.960162 16566 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:07.972114 18870 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:07.976576 16566 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:07.973876 18786 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.977628 18786 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:07.977991 18786 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.978356 18849 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.791390 18913 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.975736 18872 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.980522 18872 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:07.981383 18872 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:07.974053 18768 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.985355 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.986541 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.950834 18881 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.987528 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.989559 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:07.990679 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:07.992736 17153 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.993319 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:07.995057 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:07.996374 16559 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.987775 18826 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:07.998523 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.997978 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:07.984252 18768 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:07.996263 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:08.003186 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.000906 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:08.003294 16635 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:07.991549 18854 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.008667 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.004740 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.001889 16632 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:07.975870 18844 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:07.992492 18874 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.994313 18870 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.001673 18901 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.994623 18830 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.997022 18775 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:07.989027 18814 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:07:08.017534 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.025527 16633 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:08.017822 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.988920 18932 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:08.005585 18768 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.003988 18845 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.027308 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.029004 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:07.994666 18881 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.020090 18741 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.020401 18901 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:08.030464 16633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
W20260709 13:07:08.032955 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.030915 16635 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:08.040983 16633 raft_consensus.cc:606] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:08.041400 16633 raft_consensus.cc:614] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:08.041975 18874 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:08.042775 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44880.4us
W20260709 13:07:08.043146 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.044355 16633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:08.045135 16633 raft_consensus.cc:606] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:08.045487 16633 raft_consensus.cc:614] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:08.025202 18870 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.044263 18874 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.048288 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.048599 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1780) took 1046 ms. Trace:
I20260709 13:07:08.029902 18775 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:08.015695 18931 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:08.052282 16456 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:08.028600 18849 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.043900 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:08.051318 16638 rpcz_store.cc:276] 0709 13:07:07.002083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.002196 (+   113us) service_pool.cc:224] Handling call
0709 13:07:08.048456 (+1046260us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540043c454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:08.048546 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978060544}
W20260709 13:07:08.061623 18929 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:07:08.062745 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.064405 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:08.064934 16560 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.066035 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.066322 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:08.067154 18911 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.774s	user 0.004s	sys 0.000s
I20260709 13:07:08.067860 17184 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.067992 18872 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.068430 18872 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.068738 18872 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.068130 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.046519 18830 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.046098 18901 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.071712 16638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:08.072309 16638 raft_consensus.cc:606] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:08.072661 16638 raft_consensus.cc:614] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:08.068842 18844 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:08.075084 18826 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.048967 18845 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:08.067075 18838 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.077203 16560 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:08.074009 17180 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:08.078925 18844 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.079272 18844 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:08.080044 18844 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.080614 18768 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.082201 18868 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:08.082549 18768 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.083438 16560 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.082571 18868 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:08.084638 18868 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.085067 18881 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:08.075567 18826 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.079411 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.086464 18844 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.089295 18808 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:08.089583 16529 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:08.090297 18808 consensus_queue.cc:1059] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:08.091037 18808 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:08.091416 18808 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:08.090898 18267 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.092555 18267 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:08.092159 18775 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.093065 18838 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.085827 18868 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.093670 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.092216 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.096789 16633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:08.085094 16558 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.101570 16633 raft_consensus.cc:606] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:08.097043 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:08.097730 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.098395 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:08.102135 16635 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.102281 16638 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.101900 16633 raft_consensus.cc:614] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:08.103929 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:08.104169 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.104501 16483 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:08.095975 18838 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.072016 18830 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.107914 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:08.113426 16633 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:08.071671 18941 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:08.073239 18777 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:08.092927 18267 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.115450 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.120266 18826 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.093204 18858 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:08.121034 18845 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.070874 18940 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:07:08.124174 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.124635 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:08.150563 16560 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:08.112205 18943 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.151743 16638 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:08.128115 16635 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:08.117620 18830 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.106345 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.140156 18838 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.179320 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.093531 18849 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:07:08.151837 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:08.180852 16631 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:08.183595 16563 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:08.185563 16563 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:08.131105 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76426.3us
I20260709 13:07:08.155701 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1048) took 1156 ms. Trace:
I20260709 13:07:08.186569 16563 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.186789 16634 rpcz_store.cc:276] 0709 13:07:06.999047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.999136 (+    89us) service_pool.cc:224] Handling call
0709 13:07:07.073241 (+ 74105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.445853 (+372612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.155514 (+709661us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b54002099d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:08.155646 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169831296}
I20260709 13:07:08.157011 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.189489 16558 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:08.189710 16560 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.157245 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:08.132067 18941 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:08.172842 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.193368 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.193717 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.194577 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:08.175029 18925 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.266s	user 0.001s	sys 0.001s
I20260709 13:07:08.176295 18433 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:08.179543 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 77518.9us
I20260709 13:07:08.198853 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:08.199293 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.187704 16563 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:08.201642 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:08.202762 16604 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.203428 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.204427 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.179239 18870 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.205514 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.156236 18826 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.206681 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.181403 18860 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.213414 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56246.8us
I20260709 13:07:08.222048 16563 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:08.223074 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.223620 16563 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:08.224116 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.224439 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.223474 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.228372 17185 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:08.228938 17186 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:08.232120 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.201478 18433 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:08.234014 16456 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:08.206067 18762 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.235390 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.248294 16563 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:08.249110 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.249640 16563 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:08.236481 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.171275 18872 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.207542 18827 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.251381 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.210196 18777 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.210299 18512 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.241573 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.241708 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.258244 16638 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:08.243345 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.244445 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.245168 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.213052 18817 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.251922 17981 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.209812 18781 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.252035 16487 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:08.279369 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.252988 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.209982 18857 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:07:08.254760 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 238) took 1237 ms. Trace:
I20260709 13:07:08.280864 16489 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
W20260709 13:07:08.283625 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.284356 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:08.284539 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.284684 18844 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.285181 16489 raft_consensus.cc:2393] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:08.285326 18844 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.283113 16482 rpcz_store.cc:276] 0709 13:07:07.017247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.116708 (+ 99461us) service_pool.cc:224] Handling call
0709 13:07:08.254603 (+1137895us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400332cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:08.254705 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883973376}
I20260709 13:07:08.285904 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.286650 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.286981 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.287590 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.287963 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.288584 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.288950 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.284663 16490 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:08.290182 16489 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:08.290659 16563 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:08.291374 16489 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:08.291429 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:08.292407 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.257030 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 214) took 1122 ms. Trace:
I20260709 13:07:08.266489 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.291208 18844 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.231009 18818 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.254298 16635 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:07:08.240937 18853 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.296818 16483 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:08.279644 18870 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.297173 18838 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.254139 18342 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.297374 18949 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.268671 18809 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.298801 18845 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.268884 18900 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:08.299333 18845 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:08.308041 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 84972.6us
I20260709 13:07:08.309237 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:08.313164 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 70137.3us
I20260709 13:07:08.232931 18860 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.317828 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.297860 18949 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.292954 16636 rpcz_store.cc:276] 0709 13:07:07.134863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.136156 (+  1293us) service_pool.cc:224] Handling call
0709 13:07:07.383020 (+246864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.458240 (+ 75220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.256858 (+798618us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000cba50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:08.256977 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567163776}
I20260709 13:07:08.294894 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.229768 17184 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:07:08.255590 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.233903 18782 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:08.314996 18781 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:08.292222 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:08.297713 18342 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:08.325541 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:08.327697 17188 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:08.317402 18941 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.337393 18845 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:08.339279 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 83768us
I20260709 13:07:08.317394 18870 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:08.322530 18940 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.319214 18827 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:08.341958 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.347344 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:08.325768 18949 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.316222 18931 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:08.314352 18267 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.340651 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 233) took 1335 ms. Trace:
I20260709 13:07:08.320492 18947 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.344758 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.345853 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.346205 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 209) took 1239 ms. Trace:
I20260709 13:07:08.317271 18786 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.349695 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:08.349934 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.340278 18923 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.340327 18849 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.317715 18900 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.354408 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1782) took 1351 ms. Trace:
I20260709 13:07:08.355197 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.370059 16565 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.368911 16637 rpcz_store.cc:276] 0709 13:07:07.002750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.002852 (+   102us) service_pool.cc:224] Handling call
0709 13:07:07.046756 (+ 43904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.625120 (+578364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.354168 (+729048us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540043b054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:08.354350 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230514048}
I20260709 13:07:08.359366 16640 rpcz_store.cc:276] 0709 13:07:07.106677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.133540 (+ 26863us) service_pool.cc:224] Handling call
0709 13:07:07.133754 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.608457 (+474703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.346006 (+737549us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54000fc3d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:08.346152 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923983616}
I20260709 13:07:08.358304 16484 rpcz_store.cc:276] 0709 13:07:07.005604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.145878 (+140274us) service_pool.cc:224] Handling call
0709 13:07:07.146691 (+   813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.444999 (+298308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.340416 (+895417us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000f1f20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648ea02 00007f063648add6 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:07:08.340597 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377143168}
I20260709 13:07:08.331451 18733 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:07:08.375990 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.352766 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.352990 18777 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.377887 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.362381 18817 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.362213 18881 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.320685 18433 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.383602 17981 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:08.387130 17981 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.348460 18940 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.384691 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.376552 18715 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.388722 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.357759 18868 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:08.384680 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.393805 18847 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.395210 18900 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:08.395771 18924 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:08.398770 18872 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.388007 18782 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.386781 18712 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.400398 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.419910 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.420892 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:08.422731 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:08.424986 18267 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:08.425606 17981 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.402401 18808 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.403940 17181 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:08.404978 18786 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.428437 18733 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.409268 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.381481 18817 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:08.429071 18817 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.429292 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:08.430209 18947 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:08.430706 18947 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:08.390866 18768 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:07:08.378830 18765 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:07:08.369071 18827 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.409989 18955 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.438172 18782 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:08.411857 18952 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:07:08.414482 18853 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.415136 18941 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:08.440543 18715 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:08.442256 17981 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.382485 18956 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.386906 18881 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:08.431552 18947 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.436951 18712 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.437158 18765 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:08.464998 18765 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:08.465781 18765 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.466885 18765 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.440593 18960 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.468261 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 1781) took 1465 ms. Trace:
I20260709 13:07:08.449148 18668 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:08.463531 18881 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.468621 16631 rpcz_store.cc:276] 0709 13:07:07.002344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.002483 (+   139us) service_pool.cc:224] Handling call
0709 13:07:08.468112 (+1465629us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002c8654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:08.468207 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417740160}
I20260709 13:07:08.448321 18931 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:08.469637 18931 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.471983 18668 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:08.472412 18668 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.463361 18619 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.473423 18619 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:08.474824 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.475270 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.476907 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.478675 18269 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:08.478952 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.443279 18940 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.444345 18901 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.376863 18781 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.406248 18870 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.445708 18267 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:08.447712 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.379189 18844 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:07:08.514213 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 66570.7us
I20260709 13:07:08.514977 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:08.439986 18612 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.433112 18900 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.453037 18763 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.480957 18931 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:08.454622 18944 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 13:07:08.513895 18940 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.457490 18817 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:08.480274 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.459986 18899 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:07:08.453050 18830 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:08.482875 18930 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.580s	user 0.002s	sys 0.000s
W20260709 13:07:08.487335 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 132011us
W20260709 13:07:08.562750 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 324974us
W20260709 13:07:08.488564 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 121900us
I20260709 13:07:08.517124 18712 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.517393 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.519769 18809 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.518859 18763 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:08.453274 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:08.519192 18433 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.518127 18612 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:07:08.487825 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 47572.7us
I20260709 13:07:08.567410 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:08.581482 16565 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.582743 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:08.583290 16637 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:08.584420 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.585501 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.585918 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:08.569211 18668 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.569847 18762 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:08.572117 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54795.2us
I20260709 13:07:08.590528 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.517951 16486 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.590770 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:08.573060 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:08.574649 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:08.562294 18849 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:08.575569 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.591600 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:08.592136 16635 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:08.571062 18900 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.593780 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:08.598168 16490 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.577292 18809 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:08.600836 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:08.606216 18782 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:07:08.584440 18716 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.607957 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:08.611416 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:08.612403 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.570859 18940 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.606482 18771 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.599833 18267 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.618343 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:08.617007 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:08.620675 17981 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:08.620805 16637 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:08.622092 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.604877 18809 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.624960 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:08.596267 18964 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:08.591298 18960 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:07:08.618016 17179 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:08.629544 16565 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:08.626622 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.632767 18817 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:08.638599 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.619691 18771 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.642558 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:08.654503 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.655184 16565 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:08.617717 18814 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.605587 18899 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:07:08.643441 16456 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:08.644443 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:08.616192 18733 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.644729 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:08.663623 16559 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.640463 18858 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:08.624526 18269 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.659968 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.660419 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.605396 18900 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.664808 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.639696 18827 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.673243 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.665309 18817 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.672390 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.682988 18827 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.683314 16632 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:08.683755 18827 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.684010 18817 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.665799 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:08.682355 16565 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:08.684680 18817 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.685606 18909 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.686077 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:08.687067 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:08.687487 16565 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:08.688171 18909 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:08.688524 18909 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:08.688548 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:08.689016 18909 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.689172 16565 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:08.690478 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:08.691315 18959 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.692992 18959 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:08.693322 18858 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.599413 18904 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:08.627993 18315 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.696940 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.698107 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:08.617060 18716 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.659034 18924 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.643777 18857 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.695066 18874 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.659451 18814 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:08.659266 18771 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.662489 18700 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:08.695051 18733 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.684815 18900 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:08.782193 18847 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.698748 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:08.634964 18853 raft_consensus.cc:2764] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:07:08.812296 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 158655us
W20260709 13:07:08.812220 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 157875us
W20260709 13:07:08.812222 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 114331us
I20260709 13:07:08.633152 18612 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:08.814678 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 117830us
I20260709 13:07:08.848596 18872 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:08.816624 17981 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:08.787500 18901 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:08.807713 18956 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.795727 18860 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:08.816250 18838 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.813915 17184 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:08.860920 16559 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:08.833309 18845 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.816466 18712 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.695688 18849 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.833169 18857 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:08.941308 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.943048 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:08.943813 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:08.947266 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:09.002409 16564 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:09.002851 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 55671.9us
I20260709 13:07:08.976316 18956 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.849442 18315 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.926101 18814 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.931456 18668 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:08.926888 18830 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:08.974330 16483 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:08.977397 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:08.980965 16562 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.015s	sys 0.017s
W20260709 13:07:09.018559 16562 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.016s	sys 0.017s
I20260709 13:07:08.929052 18817 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.936702 18874 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.934800 18733 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.972626 17981 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:08.998572 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:08.815107 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 171740us
W20260709 13:07:09.009323 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.008358 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:09.001710 16485 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:09.008169 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:08.934729 18700 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.016419 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:09.029985 16559 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.030113 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:09.030496 18971 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:09.030848 18858 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.031361 18858 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.031992 18858 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:09.007395 18955 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.971374 18872 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:08.995589 18973 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.004429 18857 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.999239 18612 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.004328 18954 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.035043 16638 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
W20260709 13:07:09.017256 18965 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:07:09.012861 18956 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:09.067339 18974 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:07:09.044024 16564 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:09.071125 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.072198 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.072722 16564 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:09.073738 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.042538 18874 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:09.047333 18968 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:08.994844 18838 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:09.059518 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.060609 16559 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:09.043016 18955 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.061527 18901 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:09.022603 18940 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.042157 16489 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:09.078130 16564 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.083392 16559 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:09.017483 18315 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:09.091274 18958 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:07:09.103433 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:09.039746 18953 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.297s
I20260709 13:07:09.090199 18955 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.104401 18786 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.124688 18854 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.129252 18854 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:09.129865 18342 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.130045 18854 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.133033 18716 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.133541 18716 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:09.133879 18716 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.134176 18716 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.134424 18733 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.135540 16637 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:09.114566 18940 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.152607 18940 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.136034 18990 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:09.115975 18874 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.087385 18966 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.289s
I20260709 13:07:09.056037 18973 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.144548 18872 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.151150 18827 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.095898 18901 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.137852 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.155743 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 215) took 1070 ms. Trace:
I20260709 13:07:09.158147 18940 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.158420 18315 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:09.159291 18817 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.160403 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.215623 16640 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
W20260709 13:07:09.162629 18809 consensus_meta.cc:287] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.000s
I20260709 13:07:09.168618 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:09.217629 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 49071.5us
I20260709 13:07:09.218457 16631 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:09.220474 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:09.172407 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 166751us
I20260709 13:07:09.179334 16638 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
W20260709 13:07:09.224869 18881 consensus_meta.cc:287] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.749s	user 0.007s	sys 0.002s
I20260709 13:07:09.221830 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:09.229686 16640 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.169198 18956 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.183873 18901 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:09.186582 18765 consensus_meta.cc:287] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.002s
I20260709 13:07:09.190932 18973 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.191519 17179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 410) took 1125 ms. Trace:
I20260709 13:07:09.192318 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 217) took 1092 ms. Trace:
I20260709 13:07:09.192947 18838 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.193094 18700 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.222093 18940 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.227551 17183 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:07:09.230165 18433 consensus_meta.cc:287] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.649s	user 0.013s	sys 0.000s
I20260709 13:07:09.179301 16560 rpcz_store.cc:276] 0709 13:07:08.085403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.190461 (+105058us) service_pool.cc:224] Handling call
0709 13:07:08.190729 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.195463 (+  4734us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:08.195495 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.199891 (+  4396us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.377234 (+177343us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.377269 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.377326 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.155547 (+778221us) raft_consensus.cc:1685] finished
0709 13:07:09.155567 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.155684 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6674,"raft.queue_time_us":4345,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":7947,"thread_start_us":176266,"threads_started":1,"wal-append.queue_time_us":317746}
I20260709 13:07:09.225268 18881 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.154172 18786 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.231580 16558 rpcz_store.cc:276] 0709 13:07:08.099911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.194491 (+ 94580us) service_pool.cc:224] Handling call
0709 13:07:08.194783 (+   292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:08.202006 (+  7223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.202037 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:08.207936 (+  5899us) log.cc:844] Serialized 52 byte log entry
0709 13:07:08.625652 (+417716us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.644156 (+ 18504us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.653099 (+  8943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.653167 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.192116 (+538949us) raft_consensus.cc:1685] finished
0709 13:07:09.192137 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.192262 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27530,"prepare.queue_time_us":18525,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":32259,"raft.queue_time_us":16256,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":9513,"thread_start_us":373034,"threads_started":1,"wal-append.queue_time_us":618371}
I20260709 13:07:09.240324 16634 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.219449 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:09.233502 17179 rpcz_store.cc:276] 0709 13:07:08.065701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.065805 (+   104us) service_pool.cc:224] Handling call
0709 13:07:09.191274 (+1125469us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b5400610dd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:09.191461 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196483968}
I20260709 13:07:09.249207 18733 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.249074 18763 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.250072 18763 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.251931 18956 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:09.252372 16639 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:09.252740 18342 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.253082 18881 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:09.259706 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:09.222698 18809 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:09.243574 18949 consensus_meta.cc:287] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.879s	user 0.009s	sys 0.006s
I20260709 13:07:09.264303 17981 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.217381 18814 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:09.264333 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44953.7us
W20260709 13:07:09.264631 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 235223us
I20260709 13:07:09.265784 17187 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:09.266644 17981 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.269742 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:09.271767 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.274513 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.275095 16639 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:09.275539 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:09.276219 17187 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:09.279153 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.270331 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:09.289089 16455 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:09.292573 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:09.294998 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:09.298080 16565 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.299180 16482 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:09.301421 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:09.302402 16639 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.266888 18913 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:09.304822 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 181598us
W20260709 13:07:09.270961 18909 consensus_meta.cc:287] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 13:07:09.269511 18973 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.308218 16489 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:09.305181 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.310738 16639 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:09.268898 18997 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.295347 19002 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.311897 17981 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.313180 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:09.313503 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:09.311563 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.316547 16639 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:09.291783 18990 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.295662 18844 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.318013 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.269892 18838 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:09.306005 18870 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.298095 18830 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:07:09.310039 18973 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.316344 17179 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.330745 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:09.318143 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:09.327776 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:09.311542 18997 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.334468 19003 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:09.337122 19009 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.337546 19009 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:09.322932 18953 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.327190 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:09.305919 18872 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:09.312053 19002 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.322176 18964 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.310412 18909 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.325136 18870 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.270604 18949 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.332231 18973 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.337307 18997 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.345621 18964 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.324838 18844 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.345294 18953 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.345830 19003 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.349287 18827 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:09.351346 18870 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.363677 17180 raft_consensus.cc:2368] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:09.361400 17184 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:09.368022 19004 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.357426 18872 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:09.359118 18964 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.347038 18881 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:07:09.370008 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.338331 19009 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.371272 18984 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:09.360529 18997 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.360658 18953 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.378036 18872 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:09.380268 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 430663us
I20260709 13:07:09.381106 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:09.382483 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:09.383277 16560 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:09.383879 18820 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.384251 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 512) took 1162 ms. Trace:
I20260709 13:07:09.384802 19003 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:09.385169 19006 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:09.385772 18997 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.386689 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1809) took 1125 ms. Trace:
I20260709 13:07:09.384478 16558 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.369029 18844 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:09.386161 18995 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:09.387034 16561 rpcz_store.cc:276] 0709 13:07:08.261134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.294768 (+ 33634us) service_pool.cc:224] Handling call
0709 13:07:08.295044 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.295361 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:08.592115 (+296754us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.815744 (+223629us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.841071 (+ 25327us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.841203 (+   132us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.847962 (+  6759us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.379876 (+531914us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18002263c0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f0636483060 00007f0636495716 00007f06364a6287 00007f06364a6208
0709 13:07:09.380029 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.380108 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.386511 (+  6403us) raft_consensus.cc:1685] finished
0709 13:07:09.386533 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.386643 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67397,"prepare.queue_time_us":96442,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":13571,"raft.queue_time_us":538103,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":33965,"spinlock_wait_cycles":3199360,"thread_start_us":392142,"threads_started":2,"wal-append.queue_time_us":453879}
I20260709 13:07:09.400113 18715 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.400586 18715 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.404492 18715 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.396314 18777 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:09.405407 18777 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.406144 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:09.407152 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:09.407289 18777 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.407512 18786 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.408435 18712 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.408907 18765 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:09.409169 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.379726 18984 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.389600 18830 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:09.417594 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.368556 19004 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.362875 18857 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.386221 18853 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:09.392445 18956 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.424407 18715 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.428442 18715 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.426651 18818 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.429358 18818 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.402685 19009 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.398849 18809 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.411607 18814 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.435956 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:09.436426 16485 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.402897 18838 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:09.422541 18984 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.384650 17183 rpcz_store.cc:276] 0709 13:07:08.222298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.229780 (+  7482us) service_pool.cc:224] Handling call
0709 13:07:09.213787 (+984007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.243410 (+ 29623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.384064 (+140654us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400610dd0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:09.384195 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139868032}
I20260709 13:07:09.439437 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.441928 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.423620 18777 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:09.443027 16558 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:09.424912 18765 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:09.443997 18814 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:09.446653 19007 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:09.446444 18814 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.448900 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.450011 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.429847 18716 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.449466 16560 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:09.453276 16485 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
W20260709 13:07:09.454057 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 70480.6us
I20260709 13:07:09.435238 18949 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:09.437587 18849 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:09.443082 18715 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.503444 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.504058 16563 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:09.455802 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:09.451488 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.432039 18956 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.513522 18844 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:09.514874 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.535418 16566 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:09.451956 18777 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:09.536402 19010 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:09.536197 18844 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.537906 18777 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.538079 18716 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.514444 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.539736 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:09.541778 16559 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:09.548563 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:09.548828 16485 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:07:09.549288 16485 pending_rounds.cc:85] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:07:09.549566 16485 pending_rounds.cc:107] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:07:09.454303 19002 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.549813 16485 raft_consensus.cc:2889] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.538720 18844 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.526175 18881 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.515653 18849 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.513164 18830 raft_consensus.cc:697] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:09.515528 18909 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:09.560288 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 54833.7us
I20260709 13:07:09.516463 19003 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:09.463995 18997 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.444363 18872 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.578293 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.581425 16638 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:09.582190 19013 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.574056 18786 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.563621 18881 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.565148 18765 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.596257 18818 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.599593 16639 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:09.600939 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.601990 16639 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:09.602751 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.604146 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:09.610162 19017 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:09.612720 16635 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:07:09.613603 19008 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 13:07:09.614842 18808 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.620118 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 426) took 1172 ms. Trace:
I20260709 13:07:09.620478 17182 rpcz_store.cc:276] 0709 13:07:08.448115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.448599 (+   484us) service_pool.cc:224] Handling call
0709 13:07:08.480401 (+ 31802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.480572 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.480595 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.480633 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.480668 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.480734 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.619961 (+1139227us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b54005794d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:09.620063 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72457600}
W20260709 13:07:09.621830 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 166120us
I20260709 13:07:09.624150 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:09.628018 18830 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.631291 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:09.634984 16559 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
W20260709 13:07:09.635604 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.710718 16558 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:09.594336 18771 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.001s
W20260709 13:07:09.758096 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 179838us
I20260709 13:07:09.764700 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:09.765166 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:09.582701 19013 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.773234 18771 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.621744 18715 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.778185 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:09.765705 19015 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:07:09.600446 18857 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.711210 18809 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.591605 18786 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.819093 16560 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
W20260709 13:07:09.820052 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 59360.6us
I20260709 13:07:09.602097 19018 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.213s
I20260709 13:07:09.836481 18956 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.818884 18909 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:09.837234 18913 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.000s
I20260709 13:07:09.837594 18909 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:09.838081 18612 consensus_meta.cc:287] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.003s
I20260709 13:07:09.834422 18763 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:09.839113 18763 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.839437 18763 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:09.840188 18763 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.842751 16561 raft_consensus.cc:2410] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:09.846810 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 214528us
I20260709 13:07:09.843035 18924 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.851593 18768 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.812768 18809 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.602413 19003 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:09.916824 18964 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 13:07:09.919854 18924 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.918777 18768 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.908001 18956 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.839224 18953 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.935621 18763 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.865553 19016 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:07:09.949524 18956 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:09.941670 18955 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.001s
I20260709 13:07:09.965926 19013 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.966429 19013 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.966837 19013 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.970896 18845 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:09.942744 19004 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:09.972179 19009 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.535s	user 0.004s	sys 0.004s
I20260709 13:07:09.973009 18931 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.973352 18931 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:09.974063 18931 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.975106 18931 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.976627 18978 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.981s	user 0.001s	sys 0.001s
I20260709 13:07:09.978860 18786 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.960405 18881 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:09.982154 18956 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.964668 18955 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:09.984670 18955 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:09.984860 19011 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.545s	user 0.001s	sys 0.001s
I20260709 13:07:09.985330 18953 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.986711 18809 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.988443 18924 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.992628 19013 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.993680 18768 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.954573 18909 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:09.941942 18964 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:09.997078 18964 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.997761 18854 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:09.999132 18984 consensus_meta.cc:287] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.547s	user 0.000s	sys 0.008s
I20260709 13:07:10.004019 18855 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.004401 18855 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:10.005131 18855 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.006043 18855 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:10.007177 18973 consensus_meta.cc:287] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.003s
I20260709 13:07:10.007536 18973 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.008432 18943 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.008792 18943 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:10.009428 18973 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.999502 18984 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.012802 18984 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.014583 18814 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.953693 18849 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:09.971393 18845 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.009516 18943 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.034777 18943 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:10.087065 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 400616us
I20260709 13:07:09.258052 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:10.102852 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.104339 16558 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:10.105950 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:10.106930 16558 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:10.114521 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.121114 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:10.122103 17187 raft_consensus.cc:2368] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:10.122637 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.128249 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:10.133693 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.135288 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:10.123485 16559 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:10.207170 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:10.229387 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:10.006053 18870 consensus_meta.cc:287] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.638s	user 0.003s	sys 0.005s
I20260709 13:07:10.250524 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.249684 16559 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.261603 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.265178 18818 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.265933 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:10.266122 18777 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.267259 18612 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.267069 18870 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.268177 18612 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.270272 18853 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:10.270860 18870 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.271301 18612 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.266722 16560 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.271988 18715 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.274923 18765 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:10.275537 18715 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.275820 18765 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.276587 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.276747 18906 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.277403 18906 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.278373 18715 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.281553 18853 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:10.285841 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.286757 16561 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:10.287834 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.288766 16563 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:10.283289 18853 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.268198 18716 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.293098 18716 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.294850 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:10.292171 18924 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.268256 18899 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.296862 18924 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.297806 18899 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.298904 18849 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:10.299333 18849 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:10.300565 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.266336 18808 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.312994 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1806) took 1368 ms. Trace:
I20260709 13:07:10.277402 16564 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:10.310199 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1818) took 1010 ms. Trace:
I20260709 13:07:10.287536 18845 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.313987 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1822) took 1695 ms. Trace:
I20260709 13:07:10.320601 18809 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.337987 18809 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.303432 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1814) took 1968 ms. Trace:
I20260709 13:07:10.315717 17981 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.339370 17981 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:10.341615 18900 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.341802 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:10.342619 16564 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.302486 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1074) took 1358 ms. Trace:
I20260709 13:07:10.343369 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.299721 18849 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.308696 16484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1626) took 1368 ms (client timeout 1763 ms). Trace:
I20260709 13:07:10.299651 18924 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.278522 18765 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.343518 18716 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.297117 18771 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.349454 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:10.301404 18732 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.306164 18768 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.352902 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.345659 16484 rpcz_store.cc:269] 0709 13:07:08.939967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.942814 (+  2847us) service_pool.cc:224] Handling call
0709 13:07:10.308234 (+1365420us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002986d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:10.308460 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700607360}
W20260709 13:07:10.360937 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.363096 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.364816 16640 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:10.364915 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.364303 17981 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.366532 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.367471 16635 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:07:10.367926 17981 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.369187 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.347862 18715 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.370424 16566 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:10.370592 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.317200 16388 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 4, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 4 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:10.370874 18715 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.373351 18906 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.373946 18715 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.336310 16565 rpcz_store.cc:276] 0709 13:07:08.618841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.692319 (+ 73478us) service_pool.cc:224] Handling call
0709 13:07:08.692542 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.298446 (+605904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.313500 (+1015054us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400233cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.313811 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392189312}
I20260709 13:07:10.374612 18715 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.266134 18818 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.333652 16634 rpcz_store.cc:276] 0709 13:07:08.944665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.945545 (+   880us) service_pool.cc:224] Handling call
0709 13:07:08.946780 (+  1235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.244429 (+297649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.312500 (+1068071us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003f1954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.312842 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674690432}
I20260709 13:07:10.376200 16561 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:10.306815 18923 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.339221 16557 rpcz_store.cc:276] 0709 13:07:08.334726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.365721 (+ 30995us) service_pool.cc:224] Handling call
0709 13:07:08.378237 (+ 12516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.354532 (+976295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.354564 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.354606 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:09.354644 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.302956 (+948312us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b5400210cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.303012 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.303254 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244824448}
I20260709 13:07:10.334345 16639 rpcz_store.cc:276] 0709 13:07:09.299926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.604929 (+305003us) service_pool.cc:224] Handling call
0709 13:07:09.605189 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.605480 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.605506 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.605912 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.806338 (+200426us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.806378 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.806444 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.309703 (+503259us) raft_consensus.cc:1685] finished
0709 13:07:10.309741 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.309983 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1242,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":200072,"threads_started":1,"wal-append.queue_time_us":700994}
I20260709 13:07:10.343281 16631 rpcz_store.cc:276] 0709 13:07:08.944131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.944256 (+   125us) service_pool.cc:224] Handling call
0709 13:07:08.944525 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.222418 (+277893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.301867 (+1079449us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54000fbed4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.302284 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629487488}
I20260709 13:07:10.375274 18715 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.382746 16637 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:10.342353 18900 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.266952 18777 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:10.387246 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55502us
W20260709 13:07:10.356779 18830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.051s	sys 0.096s
I20260709 13:07:10.378744 18808 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.396967 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 233) took 1032 ms. Trace:
I20260709 13:07:10.397352 16636 rpcz_store.cc:276] 0709 13:07:09.364710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.606053 (+241343us) service_pool.cc:224] Handling call
0709 13:07:09.606316 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.606642 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.606667 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.607049 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.865768 (+258719us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:09.865810 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.865883 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.390418 (+524535us) raft_consensus.cc:1685] finished
0709 13:07:10.392867 (+  2449us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.396790 (+  3923us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":256,"raft.run_cpu_time_us":42,"raft.run_wall_time_us":43,"thread_start_us":258430,"threads_started":1,"wal-append.queue_time_us":766958}
I20260709 13:07:10.394951 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.401788 16566 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:07:10.404487 16565 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.406708 16635 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:10.405764 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.410243 18870 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:10.410751 18870 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:10.410669 18881 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.411334 18870 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.411603 18881 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.412580 18956 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.413091 18956 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.388041 18906 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.399315 18830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.051s	sys 0.097s
I20260709 13:07:10.416090 18881 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.399011 18818 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.379128 18768 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.425136 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:10.405452 18899 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.422583 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:10.440243 18906 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.442471 16560 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:10.442665 18906 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:10.444262 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.446017 16604 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:10.448480 18981 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.451562 16557 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:10.453500 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61699.8us
I20260709 13:07:10.448917 18981 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.406143 18732 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.452409 16639 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:10.459344 18872 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.460242 16560 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:10.460659 16560 pending_rounds.cc:85] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 2
I20260709 13:07:10.460897 16560 pending_rounds.cc:107] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:10.461153 16560 raft_consensus.cc:2889] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.458055 18981 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.427820 18923 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:10.475065 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 68866.4us
I20260709 13:07:10.475761 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:10.477260 16558 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:10.480264 18342 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.480444 18716 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:10.481024 18716 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.486682 18342 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:10.487154 18342 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.489665 18981 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.466971 18809 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.475437 18899 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:10.465817 18872 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.497150 16559 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:10.491719 18981 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:10.483121 18956 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:10.512274 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 61018.8us
I20260709 13:07:10.514889 16557 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:10.482715 18853 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:10.509737 16604 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.763s (SENT) [suppressed 25 similar messages]
I20260709 13:07:10.523062 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:10.514590 18809 raft_consensus.cc:2764] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:10.515635 18899 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:10.525542 18868 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:10.522182 18715 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.529071 18899 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.523947 18901 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:10.526654 18777 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.543843 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:10.544818 17182 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:10.545066 18619 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.546320 18619 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.546022 18342 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.534052 18818 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.533154 18900 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.537985 18901 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.540262 19003 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.556795 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1807) took 2296 ms. Trace:
I20260709 13:07:10.544185 19029 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.557123 16562 rpcz_store.cc:276] 0709 13:07:08.260533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.261920 (+  1387us) service_pool.cc:224] Handling call
0709 13:07:08.262184 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.318796 (+ 56612us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:09.019344 (+700548us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.396439 (+377095us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.396850 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.399885 (+  3035us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.400102 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.401401 (+  1299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.556255 (+1154854us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b54001c9654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.556318 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.556461 (+   143us) raft_consensus.cc:1685] finished
0709 13:07:10.556481 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.556645 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239537,"prepare.queue_time_us":98519,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":190163,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":12895,"spinlock_wait_cycles":80929024,"thread_start_us":818656,"threads_started":2,"wal-append.queue_time_us":246069,"wal-append.run_cpu_time_us":2635,"wal-append.run_wall_time_us":1115851}
I20260709 13:07:10.559036 19029 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.561161 19029 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.539727 18973 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:10.562374 18973 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:10.563235 18855 consensus_meta.cc:287] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.003s
I20260709 13:07:10.564389 18826 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.566850 18870 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.567751 18732 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.556486 19003 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.540059 18966 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:10.537911 18853 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.532948 18868 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.548345 18818 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.548856 18716 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:10.581185 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 716906us
I20260709 13:07:10.584601 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.584765 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.585216 16484 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.585353 16482 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.585981 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.586664 16490 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:10.586971 19003 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.570238 18826 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:10.573599 18981 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.568177 18768 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.578437 18818 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.596959 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.578240 18777 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:07:10.611003 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:10.612053 18768 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:10.617986 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 108272us
I20260709 13:07:10.600931 18855 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.622128 16639 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:10.614909 18923 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.631287 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.633073 18868 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:10.633553 18763 consensus_meta.cc:287] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.002s
I20260709 13:07:10.634828 18849 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.629069 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:10.595772 18966 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.620882 18872 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.638067 16484 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:10.638626 16482 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
W20260709 13:07:10.641819 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.642488 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:10.641712 19044 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:07:10.614187 18981 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.642936 16632 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:10.647321 17180 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:10.649214 18777 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:10.649603 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:10.649818 18777 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.651621 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.652024 18777 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.652475 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.653038 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.653644 16640 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:10.653823 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.654553 17180 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:10.656868 18342 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.657379 18847 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.657965 18847 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.652571 17183 raft_consensus.cc:2410] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:10.659898 19042 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:07:10.662125 16456 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:10.654480 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:10.657416 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:10.645623 18855 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.669376 18732 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:10.716408 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:10.678177 19043 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
W20260709 13:07:10.687958 19046 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:07:10.694736 19045 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:10.699941 18777 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:10.703176 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.656778 18619 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.703914 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:10.705260 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.705549 17184 raft_consensus.cc:2410] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:10.706075 16388 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 3, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 3 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:10.708509 18853 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.712695 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1805) took 1768 ms. Trace:
I20260709 13:07:10.713231 18818 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.714134 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.714349 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.715415 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.715785 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1597) took 1034 ms. Trace:
I20260709 13:07:10.716058 16638 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.717094 16562 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
W20260709 13:07:10.717998 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 54042.5us
I20260709 13:07:10.738253 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.721576 16564 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:10.716858 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:10.730445 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.739428 16637 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.733240 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:10.716693 18732 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:10.732296 18768 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.730140 19029 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.706019 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.737053 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1591) took 1056 ms. Trace:
I20260709 13:07:10.736256 16632 rpcz_store.cc:276] 0709 13:07:08.944403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.945112 (+   709us) service_pool.cc:224] Handling call
0709 13:07:08.945373 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.656234 (+1710861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.712408 (+ 56174us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003a2d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.712647 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3895127424}
I20260709 13:07:10.740667 18342 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.740820 18870 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.741138 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1809) took 1703 ms. Trace:
I20260709 13:07:10.741333 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.741504 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.741758 19003 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.742365 18808 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.742944 18826 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.744623 18966 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.745697 18849 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.741285 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:10.746593 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:10.747303 18855 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.747614 18973 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.874789 16488 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.714298 18901 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.748178 16484 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:10.748884 16491 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:10.749343 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:10.751175 18981 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:10.752559 18868 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.753453 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.754390 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:10.754592 18715 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.747817 17180 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:10.834908 16483 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.835016 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.838129 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.741250 17152 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:10.842836 16638 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:10.755914 18818 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.838867 17183 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:10.852566 18826 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.747725 18777 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.737793 16566 rpcz_store.cc:276] 0709 13:07:09.681620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.372540 (+690920us) service_pool.cc:224] Handling call
0709 13:07:10.372952 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.405608 (+ 32656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.715499 (+309891us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b540032a0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.715693 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60468992}
I20260709 13:07:10.789487 18732 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.843660 17981 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.841598 18342 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:10.855068 18808 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.853387 16633 rpcz_store.cc:276] 0709 13:07:09.033566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.034189 (+   623us) service_pool.cc:224] Handling call
0709 13:07:09.034505 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.116315 (+ 81810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.116344 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.121893 (+  5549us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.130577 (+1008684us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b18003ec140. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:07:10.331640 (+201063us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:10.344161 (+ 12521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.731891 (+387730us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b54003264d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.731950 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.731990 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:10.732002 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.736875 (+  4873us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2877,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5519,"spinlock_wait_cycles":205888512,"thread_start_us":110669,"threads_started":1,"wal-append.queue_time_us":1212304}
I20260709 13:07:10.859444 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:10.853066 16561 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:10.861371 18768 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.741904 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.864207 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.869009 16635 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.878328 16559 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.880081 17186 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:10.755278 16482 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.897377 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:10.907070 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 165939us
I20260709 13:07:10.879469 18855 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.745944 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.885334 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:10.893805 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 175753us
I20260709 13:07:10.790899 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1598) took 1109 ms. Trace:
I20260709 13:07:10.853915 16563 rpcz_store.cc:276] 0709 13:07:09.680256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.290538 (+610282us) service_pool.cc:224] Handling call
0709 13:07:10.290894 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.291351 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.291377 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.332318 (+ 40941us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.509328 (+177010us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:10.627452 (+118124us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.627650 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.627718 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.735224 (+107506us) raft_consensus.cc:1685] finished
0709 13:07:10.735242 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.736992 (+  1750us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":231437,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":888,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":1840,"thread_start_us":227229,"threads_started":2,"wal-append.queue_time_us":214747}
I20260709 13:07:10.905321 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.864068 19029 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.896157 18342 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.935312 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.945077 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.946170 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.947206 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.935958 16490 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:10.948987 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.890480 17179 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:10.949536 16490 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:07:10.950248 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.950429 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.951063 16482 raft_consensus.cc:2368] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:10.951843 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.880709 18924 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:10.940538 16485 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.951598 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.936088 17981 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.924819 16640 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:10.892251 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.953878 16490 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:10.881201 18715 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:10.934319 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:10.936152 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.934816 16639 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:10.962442 16632 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:10.941260 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.957629 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.963263 18818 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:10.966003 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.966840 17981 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.908046 16487 raft_consensus.cc:2368] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5.
I20260709 13:07:10.960505 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
W20260709 13:07:10.960772 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.884857 19003 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:10.957553 16559 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:10.933780 16565 rpcz_store.cc:276] 0709 13:07:09.681833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.375064 (+693231us) service_pool.cc:224] Handling call
0709 13:07:10.375432 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.405698 (+ 30266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.790651 (+384953us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5400019854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:10.790837 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66374912}
I20260709 13:07:10.949180 18777 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:10.967267 16633 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:10.896811 18966 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.986155 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:10.975324 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:10.972177 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.972713 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:10.988677 16482 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:10.982820 16636 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:10.941289 19029 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:10.989431 16483 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.969583 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:10.976217 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:10.895674 18868 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:10.990598 16566 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:10.992801 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:10.995189 17981 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.995671 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.997048 17981 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.997519 17981 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.997109 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.997543 16639 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.996174 16486 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:11.000100 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.002750 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.996300 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.968763 18872 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:11.003839 16638 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:11.003729 16485 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:10.986440 18966 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:11.011060 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:11.011447 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.010367 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:11.008983 16633 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:10.967712 18855 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.015025 16486 raft_consensus.cc:2368] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:10.969069 18924 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.014798 16491 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:07:11.015847 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.016367 18838 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.018610 16485 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 3.
I20260709 13:07:10.972453 18808 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.020350 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.021452 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.018110 16491 pending_rounds.cc:85] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 2
I20260709 13:07:11.024425 16484 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:11.024487 16491 pending_rounds.cc:107] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:07:11.025110 16491 raft_consensus.cc:2889] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.025408 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.019182 16638 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.026517 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:10.988785 18830 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:11.030864 18973 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.031392 18973 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.033267 18973 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.034792 16637 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:11.036290 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.036525 16637 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.002998 18818 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.037259 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.038371 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.038583 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.017341 18966 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.045125 18818 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.046389 18732 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.047144 17182 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:11.048051 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.049346 16633 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:11.049510 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.039230 16632 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:11.049882 16485 raft_consensus.cc:2410] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
W20260709 13:07:11.053501 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.054519 18855 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:11.054970 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.048499 18715 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.058755 16488 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:11.053591 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:11.055728 16484 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:11.059202 16640 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:11.062309 16483 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
W20260709 13:07:11.063898 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 44393.8us
I20260709 13:07:11.027925 18901 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:07:11.068336 18855 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.028472 18838 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:11.071878 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.062294 16631 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:11.081642 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.082513 16485 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:11.082736 17981 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.083901 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.084703 16488 raft_consensus.cc:2410] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:11.085371 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.086107 16484 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.087026 16483 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:11.088590 16487 raft_consensus.cc:2368] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:11.055909 18715 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.013679 18872 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.089562 16482 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:11.092593 16490 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:11.093114 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.079468 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:11.077435 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.097880 16486 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:11.072100 18732 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.101198 17981 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.081382 18900 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.105125 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.106478 16637 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:11.106817 16637 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:11.107743 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.108354 16564 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:11.111469 16640 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.113257 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.113790 16559 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:11.107586 16637 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.118721 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.123193 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.124389 16561 raft_consensus.cc:2410] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:11.119314 16566 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:11.124804 16488 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:11.119341 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:11.127178 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:11.132131 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.132623 16557 raft_consensus.cc:2368] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:11.132694 16563 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:11.134223 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.138396 16559 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:11.138427 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.136880 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.147603 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:11.155230 18847 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:11.138607 18826 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:11.113938 18900 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.132943 19003 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.134090 18768 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.165450 16635 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:11.167479 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.168010 16637 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.114887 18855 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.166986 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:11.170398 19029 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.170912 19029 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:11.136472 18777 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:11.148867 18956 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:11.177810 18956 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.180089 18818 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.172194 18826 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:11.180553 18818 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.181313 18826 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.182433 18818 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.182837 16637 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.183180 18342 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.184129 18868 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.174480 18777 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.188043 18924 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.189252 18777 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.189488 18342 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.189837 16489 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.196187 18808 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:11.197857 19050 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.304s	user 0.002s	sys 0.001s
W20260709 13:07:11.201382 19052 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 13:07:11.202361 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.204046 16640 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:11.206527 16634 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:11.173260 19029 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.210994 16562 raft_consensus.cc:2410] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:11.211963 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48739.1us
I20260709 13:07:11.211185 18768 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:11.213798 18768 consensus_queue.cc:1243] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:11.214354 18991 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:11.214701 18991 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.214910 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:11.215111 19003 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.215938 18342 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.162246 18838 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:11.217605 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 123595us
I20260709 13:07:11.215268 18984 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.218690 16454 leader_election.cc:400] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:11.218428 18984 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.216310 18991 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.215605 18966 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.218976 16454 leader_election.cc:403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.224436 18849 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:11.224812 18849 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.225620 18849 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.226698 18849 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.220815 16639 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:11.227545 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:11.227927 18342 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6.
I20260709 13:07:11.232692 18619 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.238534 18984 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.215564 19003 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:11.221390 18872 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.243994 18619 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:11.246817 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.248847 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.250936 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.251583 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.251896 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.252488 16633 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:11.254669 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.243301 18991 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.247750 19003 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.258085 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.258692 17187 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:11.260097 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:11.260807 17182 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:11.251096 16487 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.251600 16483 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:11.264060 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.266863 16558 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:11.267370 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.268076 16559 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:11.269013 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.269191 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.269675 16558 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:11.271896 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:11.274941 16636 raft_consensus.cc:2410] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:07:11.269801 16563 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 3.
I20260709 13:07:11.237201 18900 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.282342 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.277665 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.281234 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.281831 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.283191 16635 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.283299 16634 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:11.292272 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64796.1us
I20260709 13:07:11.296350 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.296873 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.297603 16633 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.297761 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.297176 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.293009 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:11.298096 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.259577 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.302497 16631 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:11.303969 16563 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:11.304556 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:11.304910 16637 raft_consensus.cc:2410] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:11.305209 16558 raft_consensus.cc:2368] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5.
I20260709 13:07:11.305733 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.306818 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.307709 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.310395 16638 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.311955 16640 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:11.312927 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.313452 16634 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:11.314231 18768 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.315397 18855 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.315116 16388 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 4, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:11.277160 18826 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:11.317071 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57563us
I20260709 13:07:11.318514 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.319361 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.323130 16639 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:11.323467 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.324425 18899 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.324818 18899 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.325161 18899 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.327858 18619 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.328493 18826 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.330468 18826 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.331759 18899 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.333585 18942 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.333981 18942 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.334282 18942 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.334633 18899 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.318570 18956 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:11.336834 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65117.5us
W20260709 13:07:11.340692 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.338536 16388 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 5, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 5 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:11.341984 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.335301 19003 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:11.332563 19054 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:07:11.345238 16564 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:11.347611 16388 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 5, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 5 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.344895 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.346784 18984 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:11.350306 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.350441 16562 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:11.356446 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.355047 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:11.352005 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 59076.2us
I20260709 13:07:11.357913 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:11.351611 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.354977 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.358613 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.359009 16487 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:11.355607 16565 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:11.321558 16635 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:11.353608 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.353775 16633 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.359905 16563 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:11.361654 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.361869 16558 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:11.355396 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:11.362839 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.364048 18808 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:11.364215 16637 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.364959 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.364759 18808 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.364267 18342 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:11.392946 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.368374 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.374801 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.402801 16482 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:11.364755 18872 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.404317 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.406116 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.406662 16564 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:07:11.402462 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.360572 18826 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:11.419054 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 55465.8us
I20260709 13:07:11.404109 18872 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:11.420836 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 74559.6us
W20260709 13:07:11.429400 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.431905 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.436003 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 78142.2us
I20260709 13:07:11.403548 18966 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.416276 18899 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.416416 18924 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.418474 18826 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.416540 18777 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.433403 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.445984 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:11.444540 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.448184 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.429863 18956 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.433673 18872 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.454957 16634 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:11.452999 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:11.457885 16604 leader_election.cc:400] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:11.458248 16604 leader_election.cc:403] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.459503 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.460399 16604 leader_election.cc:400] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5.
I20260709 13:07:11.463604 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.471357 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.449647 18826 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.472512 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.473664 18838 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.444967 18900 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:07:11.475769 18838 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.475855 18906 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.476390 18838 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.476585 18984 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:11.477664 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45270.7us
I20260709 13:07:11.478138 18901 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.478613 18901 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.478997 18818 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.479943 17981 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.480291 17981 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.480582 17981 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.454847 18956 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.484063 18956 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.464872 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.478829 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:11.493362 16530 leader_election.cc:400] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
W20260709 13:07:11.496133 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69753.6us
W20260709 13:07:11.496694 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.497786 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:11.461246 18732 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.463898 18899 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:11.486120 18966 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.504887 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.489814 18619 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.512142 18619 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.512504 18619 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.513166 18808 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.479485 18901 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.483964 18973 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:07:11.519018 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.519820 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:11.520426 16631 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:11.454368 18924 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.522159 18924 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.455889 18777 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.509258 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:11.493710 18818 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.540834 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:11.522255 19064 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:07:11.524219 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 59409.3us
I20260709 13:07:11.505852 17981 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.477875 18984 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:07:11.503974 18732 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.549093 16564 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.508265 18966 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:11.550611 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:11.540567 18763 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:11.544589 18924 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.543898 18818 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:11.544593 19055 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.556730 17981 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.548903 18732 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:11.575769 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 75674.1us
I20260709 13:07:11.550314 18808 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.553491 18966 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.577260 16633 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:11.556520 18763 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:11.583361 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:11.556440 18899 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.582155 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:11.568058 18924 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.567818 19003 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:11.546207 18931 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:07:11.570097 19055 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.570325 18818 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:11.589974 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 116650us
I20260709 13:07:11.599884 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:11.600626 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.601521 17185 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.604269 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.605487 18768 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:11.606003 18768 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.606555 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.606865 18768 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:11.590652 19063 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:11.584684 18847 raft_consensus.cc:2764] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:11.608616 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.597313 18715 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.597555 18924 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.592532 19029 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:11.640240 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.646082 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.637784 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 90669.1us
I20260709 13:07:11.637852 17187 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:07:11.644774 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:11.608346 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.582823 18838 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.652055 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:11.603757 19055 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.644241 18715 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.642949 18868 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:11.598702 18899 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.652633 16529 leader_election.cc:400] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
W20260709 13:07:11.660156 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 53709.7us
I20260709 13:07:11.657228 16491 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:11.649138 19029 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:11.651279 18808 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.665642 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:11.668861 16388 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 5, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 5 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.674643 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.675220 17187 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:11.680578 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.661425 18715 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.664119 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.646718 18942 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.696171 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.669703 19029 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.672111 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:11.673853 18868 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.666301 18984 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:11.705242 19074 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:11.706193 19072 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:07:11.706970 19073 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:11.708078 19080 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.708601 18838 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.711176 18619 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.713312 18942 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:11.716146 19065 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:07:11.716930 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 173513us
I20260709 13:07:11.717808 18868 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.704756 16455 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.700788 19075 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.739243 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.739923 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:11.741596 18619 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:11.702525 19070 raft_consensus.cc:2764] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:07:11.704829 18777 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.698851 18956 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:11.745105 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 97742.2us
W20260709 13:07:11.746225 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44767.2us
I20260709 13:07:11.730469 19080 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:11.731415 19074 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:11.758137 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.760627 17981 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.761004 17981 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.761314 17981 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.761899 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:11.766135 18619 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:11.767535 18619 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.755244 17180 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 4: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:11.748837 18849 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.780332 16637 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.772185 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.782665 16485 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:07:11.783335 17981 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.750488 17179 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:11.791958 19076 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:11.792500 19076 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.796593 19074 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.799445 18956 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:11.760460 18901 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:07:11.800065 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.804231 16484 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.805521 16490 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.812225 18900 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.784150 18855 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:11.758373 19075 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:11.814391 19075 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.758438 18777 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.816713 18777 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.817060 18777 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.814247 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:11.819067 16486 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:11.818961 17185 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:11.825470 16455 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:11.828158 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.756465 19080 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.830842 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:11.832427 16485 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:11.817749 19059 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.468s	user 0.006s	sys 0.005s
I20260709 13:07:11.831981 18342 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:11.836220 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 78879.7us
W20260709 13:07:11.830350 18991 consensus_meta.cc:287] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.000s
I20260709 13:07:11.845198 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.829504 18849 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.883548 16483 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:11.847848 16530 leader_election.cc:400] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:11.884449 16530 leader_election.cc:403] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.881168 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.833424 18984 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.888381 18899 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:11.888687 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 126886us
I20260709 13:07:11.889909 16529 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:11.890836 16639 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.885190 18855 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:11.890040 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.896674 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:11.833889 18872 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.903152 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.910916 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:11.898639 19089 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:11.910135 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.893234 18855 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:11.893800 18984 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.916321 16640 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.920930 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.921623 17185 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:11.923321 18872 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.925817 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.928120 18906 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:11.928326 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:11.928968 18984 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.934482 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.925355 18966 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.937348 19029 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.937902 18966 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:11.938423 17186 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.935678 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.939450 17183 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:11.939859 19092 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.940567 19092 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.940984 19092 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.941617 18868 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:11.942006 18868 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:11.942842 18868 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.900574 19083 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:11.943761 18808 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.943943 18868 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.919749 18826 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:11.944108 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:11.945829 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:11.946503 16488 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:11.945860 16637 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.950002 18855 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.944401 19083 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.895416 18763 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:11.933063 18906 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:11.684721 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:12.156495 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.117076 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 269357us
I20260709 13:07:12.112373 17981 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:12.416674 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 199380us
I20260709 13:07:12.104884 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:12.197423 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 307928us
W20260709 13:07:11.988396 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.036128 16603 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:12.422092 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.369484 16389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 235) took 14948 ms (client timeout 15000 ms). Trace:
W20260709 13:07:11.979534 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.418447 16637 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:12.426162 18808 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.423143 17187 raft_consensus.cc:2368] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5.
I20260709 13:07:12.423084 16529 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.190454 16388 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.444432 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:12.462934 16388 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 4, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 4 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:12.432596 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.464300 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.464663 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:12.466670 16486 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:07:12.444136 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 408045us
I20260709 13:07:12.443128 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:12.468066 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 43905.2us
W20260709 13:07:12.469954 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.097709 19055 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.108330 19066 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:11.944712 18924 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:12.475510 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.472105 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:12.485745 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 62739.6us
I20260709 13:07:12.468443 19074 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.940935 18715 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.476096 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.117652 19029 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:12.472276 16388 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 4, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 4 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:12.111696 18956 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:12.475091 19092 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.499931 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.503264 17182 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:12.206430 19082 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.312s
I20260709 13:07:11.969398 18732 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.090420 19091 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:12.482962 16636 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:12.469017 17186 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.429464 18855 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.140305 19076 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.140796 19068 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:12.426676 18808 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.098809 19090 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.490283 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:12.491487 16639 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:12.492282 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.480783 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:12.483430 19088 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.499346 16633 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:12.499873 19103 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.500627 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:12.521277 19091 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:12.501585 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:12.490561 18342 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.143287 18818 consensus_meta.cc:287] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.002s
I20260709 13:07:12.501963 18924 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.513160 16488 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:11.951303 18849 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.113240 19080 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.097288 18777 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.492684 18826 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.496407 18956 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:12.536485 16638 raft_consensus.cc:2368] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7.
I20260709 13:07:12.539379 16640 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:12.539783 16631 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:12.537572 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62770.6us
I20260709 13:07:12.536624 16639 pending_rounds.cc:85] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 6
I20260709 13:07:12.514171 19029 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.550521 16639 pending_rounds.cc:107] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:12.551008 16639 raft_consensus.cc:2889] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:12.537207 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 44998.8us
I20260709 13:07:12.550626 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.555184 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:12.540200 16665 heartbeater.cc:646] Failed to heartbeat to 127.15.6.62:43625 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.6.62:43625 timed out after 15.000s (SENT)
I20260709 13:07:12.484848 19066 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.557968 19066 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.544565 18818 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.559178 19080 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.544076 18342 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.559890 19029 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.561436 18342 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.561882 19029 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.537990 19105 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.562484 19105 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:12.562835 19105 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.568099 19082 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:12.569463 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:12.570196 19097 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.572255 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.574975 19097 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.575438 19097 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:12.576529 19097 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.533043 19098 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:07:12.521646 19079 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.581264 18899 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:12.581691 18899 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:12.538290 19088 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:12.582551 18899 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.583973 18777 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.584540 18777 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.584867 18777 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.585188 18777 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.588706 18715 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.589308 18924 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.589568 18906 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.590703 18906 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.537708 19092 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:12.424275 16389 rpcz_store.cc:269] 0709 13:06:57.438505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.457318 (+ 18813us) service_pool.cc:224] Handling call
0709 13:07:12.369257 (+14911939us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:07.806433 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:07.884660 (+ 78227us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:07.884719 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:07:07.884739 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:07.885625 (+   886us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:07.885700 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:07.885727 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:07.886408 (+   681us) tablet.cc:701] Row locks acquired
0709 13:07:07.886454 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:07:07.886617 (+   163us) write_op.cc:270] Start()
0709 13:07:07.886747 (+   130us) write_op.cc:276] Timestamp: P: 1783602427886555 usec, L: 0
0709 13:07:07.886770 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:07.889537 (+  2767us) log.cc:844] Serialized 2787 byte log entry
0709 13:07:08.347941 (+458404us) op_driver.cc:464] REPLICATION: finished
0709 13:07:08.714156 (+366215us) write_op.cc:301] APPLY: starting
0709 13:07:08.795295 (+ 81139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:08.929211 (+133916us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:08.952912 (+ 23701us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:09.097777 (+144865us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:09.098071 (+   294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:07:09.098118 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:09.098352 (+   234us) log.cc:844] Serialized 59 byte log entry
0709 13:07:09.098509 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.098607 (+    98us) write_op.cc:454] Released schema lock
0709 13:07:09.098645 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:09.098956 (+   311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.098982 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":809339,"reported_tablets":41,"spinlock_wait_cycles":1280,"child_traces":[["op",{"apply.queue_time_us":300391,"apply.run_cpu_time_us":10704,"apply.run_wall_time_us":436957,"num_ops":7,"prepare.queue_time_us":181407,"prepare.run_cpu_time_us":85486,"prepare.run_wall_time_us":210876,"raft.queue_time_us":229709,"raft.run_cpu_time_us":11375,"raft.run_wall_time_us":197607,"replication_time_us":453323,"thread_start_us":542457,"threads_started":4,"wal-append.queue_time_us":155909,"wal-append.run_cpu_time_us":56908,"wal-append.run_wall_time_us":2199179}]]}
I20260709 13:07:12.596545 16605 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.599519 17186 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
W20260709 13:07:12.592458 19099 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:07:12.605461 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.596211 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:12.619804 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.620389 17182 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:12.619551 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:12.622051 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.623098 16605 leader_election.cc:400] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:12.539005 19103 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:12.581650 19079 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:12.540056 19090 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:12.627493 16486 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:12.629014 17183 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:12.629524 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 93638.5us
I20260709 13:07:12.596205 19088 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.630167 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.653453 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.651587 17981 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.656808 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:12.657613 17180 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:12.657845 18763 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.619539 18900 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.656200 17981 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.630117 19103 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:12.658933 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 180592us
I20260709 13:07:12.654318 18715 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.672771 18715 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.674829 18715 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.674932 16562 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:12.624313 19092 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.665686 17981 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.676059 19092 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:12.659863 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 171151us
I20260709 13:07:12.677652 18715 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:12.678045 19092 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.678457 18715 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.682158 18715 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.685529 16562 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.686932 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:12.689544 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 134419us
I20260709 13:07:12.532645 19068 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.691955 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.682416 17981 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.714195 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:12.715747 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.691938 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.718581 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.719331 16558 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:12.721122 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.664852 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:12.723001 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57735.9us
I20260709 13:07:12.629143 19090 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.724653 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:12.687599 17179 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:12.665422 18900 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.732309 16455 leader_election.cc:400] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7.
I20260709 13:07:12.732630 16455 leader_election.cc:403] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.733799 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.733621 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.734683 17981 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.735584 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.736722 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.737255 16563 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
W20260709 13:07:12.737735 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72935.9us
I20260709 13:07:12.665910 18342 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.738449 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.739256 16559 raft_consensus.cc:2410] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:12.741158 16483 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.741413 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.539894 19091 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.738823 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:12.728430 18872 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.738093 18900 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.752518 16488 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:12.665320 19066 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 13:07:12.753630 19102 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:07:12.741937 18966 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:07:12.754406 19110 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:12.754549 19091 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.755163 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:12.793020 16483 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:12.742447 18924 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.758533 16558 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:12.761842 19088 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.780772 19092 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:12.761401 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.764139 18763 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:12.768100 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 142947us
I20260709 13:07:12.770362 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.737469 19079 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.783627 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.787220 18849 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.764030 19114 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.787390 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:12.789984 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58658.8us
I20260709 13:07:12.783514 19029 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.776047 18715 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.808362 19120 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.812556 19068 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.782612 19115 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.814497 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:12.815623 16563 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:12.786558 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:12.903226 16482 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.902360 18872 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:12.904632 19115 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:12.904917 18872 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.902655 19120 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.907245 19120 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.815117 16565 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:12.816128 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.818117 19092 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:12.818655 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.818162 19118 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:12.819130 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50175.3us
W20260709 13:07:12.909596 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 95176.1us
W20260709 13:07:12.827111 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.794836 18924 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.916426 18906 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.917058 16605 leader_election.cc:400] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5.
I20260709 13:07:12.848803 19029 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.917387 16605 leader_election.cc:403] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.917639 19029 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.918327 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.909448 19115 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.919603 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.920004 19074 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5.
I20260709 13:07:12.920277 19124 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.920753 19124 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:12.920852 19118 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:12.824931 18849 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.921124 19124 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.922097 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 245340us
I20260709 13:07:12.922744 18849 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.908790 19105 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.925076 16562 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:12.926669 19105 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:12.910624 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.927906 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.928452 16560 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:12.928864 19119 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.909567 16557 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.929198 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.929749 16560 raft_consensus.cc:2376] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7. Re-sending same reply.
I20260709 13:07:12.930487 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.930938 16560 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.916540 18924 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.816710 18763 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:12.927182 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.927690 19092 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:12.823899 19066 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:12.926728 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.927933 16482 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:12.936103 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.936172 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:12.936926 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 195581us
I20260709 13:07:12.907716 19120 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.950776 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.954980 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.955621 16564 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:12.958402 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:12.959162 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 216465us
I20260709 13:07:12.949055 18763 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.942368 16566 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:12.944945 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.962539 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.929278 19119 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:12.953990 19127 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.950587 19124 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:12.969242 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.969951 16564 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:12.970424 19124 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:12.970662 19119 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.940657 16560 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:12.963282 16565 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:12.962510 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:12.963703 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 231503us
I20260709 13:07:12.975000 16557 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:12.977115 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.977802 16557 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:12.976248 16482 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:12.970670 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.979453 16564 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.977124 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.980384 16560 raft_consensus.cc:2376] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6. Re-sending same reply.
I20260709 13:07:12.950665 19080 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7.
I20260709 13:07:12.950688 19066 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:12.981190 16454 leader_election.cc:400] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5.
I20260709 13:07:12.982445 16454 leader_election.cc:403] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.979745 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:12.982983 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:12.983690 16565 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:12.942093 18849 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:12.992425 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:12.993153 16560 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:12.960916 18966 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:12.985029 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.002038 16565 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.005810 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.987663 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:13.008257 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.008460 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:12.985672 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:12.990176 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:12.963263 18855 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.994033 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:12.948066 19068 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:12.975492 19113 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.935644 19103 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.048362 19103 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.049069 16561 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.014686 19117 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5.
W20260709 13:07:13.015396 19083 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.003s
I20260709 13:07:13.000185 19124 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.016093 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:13.016070 19133 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:07:13.017552 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.015314 19129 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.021565 19106 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.983891 19092 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.033579 18763 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.037036 16564 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:12.947916 19114 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:13.044106 19118 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.045850 19088 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:13.051091 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 57150.1us
I20260709 13:07:13.051403 16483 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:13.056864 16633 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.069113 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.069578 16484 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:07:13.070354 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 89308.7us
W20260709 13:07:13.071997 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.057974 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 48691.4us
I20260709 13:07:13.058415 16565 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:13.058907 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.065495 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:13.066679 16566 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
W20260709 13:07:13.067276 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.067414 16560 raft_consensus.cc:2410] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:13.018126 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:13.013276 19105 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.050724 18966 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.098201 16634 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:13.072973 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:13.097677 16637 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:13.070732 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.099747 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.099721 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.100472 16564 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:13.100736 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.101065 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.101341 16566 raft_consensus.cc:2410] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:13.101660 16565 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:13.102206 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.102607 16565 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:13.103125 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.103564 16565 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.104017 16529 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:13.107460 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.064206 19083 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:13.106061 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.114125 16638 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:13.066112 18818 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.121784 16637 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.120957 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.123355 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:13.122355 16529 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:13.124035 17183 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:13.118579 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.124994 16634 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.072021 17179 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.128383 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.128800 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.129470 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.133859 16557 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.135206 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:13.072391 19106 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.068929 19131 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.136515 16640 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:13.140053 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:13.136016 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 124653us
I20260709 13:07:13.141199 16566 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:13.105567 19103 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:13.142395 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.147979 19088 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.148836 18818 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.149195 18818 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:13.149547 18818 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.149467 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:13.070211 18973 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:07:13.153270 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:13.068828 19124 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.164429 16634 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:13.161312 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.161155 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.128250 19091 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.164418 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.167392 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.134850 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:13.168227 16564 raft_consensus.cc:2376] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7. Re-sending same reply.
I20260709 13:07:13.169008 16637 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:13.139159 19106 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.170514 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.172483 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.173098 16564 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.173511 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:13.140913 19131 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:13.145016 19103 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:13.120211 19029 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.174785 16560 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:13.128423 19066 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.177018 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.170250 19090 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:13.168089 18777 consensus_meta.cc:287] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.001s
I20260709 13:07:13.182113 16564 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:13.184139 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:13.186904 16559 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:13.098289 19129 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.118238 18966 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.170591 19105 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.203058 16605 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:13.206415 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 71281.7us
I20260709 13:07:13.169735 19137 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.209595 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.193783 18906 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.180773 19131 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.183533 19103 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.158926 18924 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.210959 16564 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.208473 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:13.208979 19066 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.212689 19141 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.215677 17179 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:13.215940 19135 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.216763 19124 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.217335 16488 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:13.218137 19129 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.202960 19117 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.231905 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.237071 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:13.237920 18956 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.240124 19055 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:13.204567 18872 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.210167 19079 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:13.253377 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 97030.6us
W20260709 13:07:13.254149 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 92897.6us
I20260709 13:07:13.255131 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.203119 18777 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.257014 16558 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.257741 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:13.258770 16632 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
W20260709 13:07:13.259888 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 98810.5us
I20260709 13:07:13.263695 16564 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:13.250361 19105 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.268553 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.261037 19141 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:13.242616 19115 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.273236 18715 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.279412 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.279347 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.280921 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.280483 18777 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.280118 16563 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.281960 16564 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.274351 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.287214 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:13.267968 19105 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.287978 19105 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.288051 17183 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.288309 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.292176 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:13.294147 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.294236 19138 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:13.294866 16640 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:13.295679 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.296432 18899 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.297215 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.297878 16561 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.298594 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.299185 16561 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.279760 19147 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:07:13.300261 18900 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.510s	user 0.001s	sys 0.006s
I20260709 13:07:13.265571 18763 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.301003 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.303339 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.266851 19079 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:13.268396 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.280710 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:13.316872 17181 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.300848 19091 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.317219 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.310046 16564 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:13.300633 18900 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.299466 19106 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.270143 19124 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:13.311411 16561 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:13.231899 19137 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.319954 16637 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.301090 19135 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.317670 19091 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.313149 18956 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.316146 19079 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:13.336097 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 95027.8us
I20260709 13:07:13.336433 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.344240 16561 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:13.338932 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.337426 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.345149 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:13.318351 18777 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.346643 16564 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:13.345551 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:13.341761 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 53516.2us
I20260709 13:07:13.349932 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.301626 18715 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.353103 19164 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:13.355177 19152 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:13.355453 19136 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:13.355767 19152 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.355955 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.356098 19106 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.357040 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.356712 19152 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.358078 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.359012 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.359598 16632 raft_consensus.cc:2368] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:13.360185 19068 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.365136 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.365119 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.354251 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:13.366358 16636 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:13.353508 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.336450 19098 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.339491 19090 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.333775 19080 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.336963 18872 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:13.394526 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.391371 16530 leader_election.cc:400] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:13.396991 16559 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:13.391136 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.341768 19074 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.401937 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.347187 19138 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.403909 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:13.406111 16530 leader_election.cc:403] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.406594 16564 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:13.417034 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50294.7us
I20260709 13:07:13.407624 18872 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.407580 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 90421.6us
I20260709 13:07:13.408288 16631 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.409130 16632 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:13.408015 19143 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.412340 19115 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:13.368846 19029 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.391271 19075 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.418373 16633 raft_consensus.cc:2410] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:13.418877 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.336513 19150 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:07:13.336704 19135 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:13.421708 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54023.6us
W20260709 13:07:13.425913 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 77498.1us
I20260709 13:07:13.423076 19090 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5.
I20260709 13:07:13.336401 19141 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.423146 19103 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.430114 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.429497 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:13.433449 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.409322 18777 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:13.423573 19142 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 13:07:13.417125 19083 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.421519 18872 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.422446 18900 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.444494 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:13.447248 19155 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:13.448536 19119 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.450906 19079 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.452976 18818 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.417472 19139 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.178s
I20260709 13:07:13.455190 16566 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:13.456599 19137 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:13.458825 16557 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:13.460445 16557 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:13.460748 16557 pending_rounds.cc:85] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 3
I20260709 13:07:13.460976 16557 pending_rounds.cc:107] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:13.461187 16557 raft_consensus.cc:2889] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.438566 18777 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:13.461583 18777 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.463869 19135 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:13.464015 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.463744 16639 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.472355 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.440899 19143 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.409742 19098 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.473963 16456 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.456535 18715 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.451388 19119 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.444432 19152 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.468794 19120 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.471005 19124 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:13.473148 19129 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.435699 19075 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.502004 18966 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.515117 16559 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.505638 19157 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.524531 19075 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:13.511886 19155 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:13.512079 19129 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.525790 19129 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.526902 19129 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.506108 19106 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:13.517832 19165 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:13.524283 19160 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:13.533329 19105 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.522179 16559 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:13.542397 19124 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.527469 18966 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.548561 18966 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.549829 19092 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.551266 16565 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
W20260709 13:07:13.551651 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 77760.9us
I20260709 13:07:13.552470 16640 raft_consensus.cc:2410] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:13.552325 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.568591 19117 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.569101 19117 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.569952 19117 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.539633 19165 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.527102 18777 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.577698 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:13.552690 19152 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.611565 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:13.550913 19157 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:13.541550 19106 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.631249 19164 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:13.632992 19164 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.633469 19164 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.610503 19165 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.616706 19080 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.619408 19079 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:13.650696 19164 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.654525 19157 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:13.662297 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.663411 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.663926 16566 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.673681 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.674770 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.675259 16558 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:13.677516 16558 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:13.678516 18777 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.679452 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:13.681267 16558 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:13.682261 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:13.683419 16558 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:13.948769 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 262731us
I20260709 13:07:13.963891 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:07:13.810992 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.755568 16558 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:13.692130 16566 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:13.688917 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:13.989178 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:13.729575 19168 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:07:13.937134 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.711370 18777 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.978920 19164 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:13.994812 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 305953us
I20260709 13:07:13.967182 19092 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.733403 19105 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.680559 19080 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.971632 16558 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:13.685712 19068 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.312s
I20260709 13:07:13.997725 18777 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.998641 18808 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:13.995386 19120 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.877482 18872 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:13.707119 19082 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.717583 19167 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.685737 19141 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.324s
I20260709 13:07:13.735167 18849 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.957491 19098 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:13.949092 19106 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:14.002840 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 384872us
I20260709 13:07:13.686431 19139 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.316s
I20260709 13:07:14.008716 19120 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:13.994118 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1674) took 1265 ms. Trace:
I20260709 13:07:14.002907 16558 pending_rounds.cc:85] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 6
I20260709 13:07:14.107944 16558 pending_rounds.cc:107] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:14.107523 19120 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.108203 16558 raft_consensus.cc:2889] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.109396 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:14.109910 16558 raft_consensus.cc:2376] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7. Re-sending same reply.
I20260709 13:07:14.110773 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:14.111231 16558 raft_consensus.cc:2376] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7. Re-sending same reply.
I20260709 13:07:14.107137 16486 rpcz_store.cc:276] 0709 13:07:12.726992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.727934 (+   942us) service_pool.cc:224] Handling call
0709 13:07:13.464702 (+736768us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:13.464908 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.471774 (+  6866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.471827 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.472174 (+   347us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.563322 (+ 91148us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:13.580488 (+ 17166us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.966040 (+385552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.966120 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.966162 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:13.991683 (+ 25521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.991857 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14323,"prepare.queue_time_us":17030,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":41692,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":9125,"spinlock_wait_cycles":2829696,"thread_start_us":440290,"threads_started":2,"wal-append.queue_time_us":65851}
I20260709 13:07:14.115688 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:14.116053 19129 consensus_meta.cc:287] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.584s	user 0.003s	sys 0.005s
I20260709 13:07:14.116629 19165 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.117063 16558 raft_consensus.cc:2376] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6. Re-sending same reply.
I20260709 13:07:14.118995 16484 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:14.009048 19157 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.173326 19139 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:14.173933 19139 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.002638 19092 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.014921 18849 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:13.728869 19152 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.160979 19143 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.241420 16631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.024s	sys 0.035s
I20260709 13:07:14.171897 19157 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:14.241773 16631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.024s	sys 0.035s
I20260709 13:07:14.190806 18973 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.011567 19082 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.265534 19068 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:14.258208 19088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.051s	sys 0.081s
W20260709 13:07:14.259068 19131 consensus_meta.cc:287] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.997s	user 0.010s	sys 0.000s
I20260709 13:07:14.314452 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.240309 19105 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:14.316603 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.259418 19157 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.258045 18868 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:14.321681 19088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.051s	sys 0.081s
I20260709 13:07:14.332319 19098 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.245029 19143 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.342275 19190 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:14.321296 19165 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.348760 19098 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.321588 19139 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.307514 19164 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.337352 19186 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:14.358762 16558 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:14.341529 19088 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:14.274021 18973 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.265946 19080 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.327310 19131 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:14.367375 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 378268us
I20260709 13:07:14.368726 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:14.338119 19105 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.354243 19190 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.370414 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:14.341192 18868 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.355815 18777 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:14.377193 17981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.003s	sys 0.014s
W20260709 13:07:14.377554 17981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.003s	sys 0.014s
I20260709 13:07:14.340736 18849 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.372471 18808 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:14.374599 19141 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.396384 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 257) took 1287 ms. Trace:
I20260709 13:07:14.363893 19186 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.377251 18777 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.397312 16638 rpcz_store.cc:276] 0709 13:07:13.106858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.107229 (+   371us) service_pool.cc:224] Handling call
0709 13:07:14.393601 (+1286372us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b54000cba54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.393718 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13742848}
I20260709 13:07:14.390091 18872 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.401484 18868 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.407879 19190 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.408447 19190 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.409022 19190 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:14.411674 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.412124 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1111) took 1158 ms. Trace:
I20260709 13:07:14.412281 16486 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:14.412530 16640 rpcz_store.cc:276] 0709 13:07:13.254097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.295474 (+ 41377us) service_pool.cc:224] Handling call
0709 13:07:14.411929 (+1116455us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002ba2d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.412066 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588916992}
I20260709 13:07:14.413781 19088 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:14.415953 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.418481 19189 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:14.420256 19131 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.420156 18868 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:14.420467 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 430) took 1764 ms. Trace:
I20260709 13:07:14.421216 18868 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:14.421613 18868 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:14.422747 19192 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.420864 17186 rpcz_store.cc:276] 0709 13:07:12.656267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.656380 (+   113us) service_pool.cc:224] Handling call
0709 13:07:13.257595 (+601215us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b58001e0998. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:14.420269 (+1162674us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54005ff0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.420390 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579961472}
I20260709 13:07:14.423239 19192 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.409436 19190 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:14.396309 18808 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.425593 19082 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:14.404620 19141 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.406414 18777 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.438262 19143 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.438131 19082 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:14.482517 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 112215us
I20260709 13:07:14.484318 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:14.457118 19193 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.486660 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:14.487315 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1856) took 1754 ms. Trace:
I20260709 13:07:14.488412 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:14.488463 16562 rpcz_store.cc:276] 0709 13:07:12.732978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.733074 (+    96us) service_pool.cc:224] Handling call
0709 13:07:12.740997 (+  7923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.925407 (+184410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.487089 (+1561682us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400113354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:14.487258 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422977280}
I20260709 13:07:14.489857 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.490413 16562 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:14.491245 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.492087 16562 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:14.492859 16635 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:14.495217 16638 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.494480 19118 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.493001 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 168881us
I20260709 13:07:14.496833 19118 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.496219 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 246) took 1232 ms. Trace:
I20260709 13:07:14.492852 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.498729 16566 rpcz_store.cc:276] 0709 13:07:13.263594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.967023 (+703429us) service_pool.cc:224] Handling call
0709 13:07:13.967323 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.967509 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:14.357927 (+390418us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.495359 (+137432us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.495614 (+   255us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.496017 (+   403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.496081 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.496173 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":467915,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":255,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":309,"thread_start_us":514055,"threads_started":2,"wal-append.queue_time_us":131533}
I20260709 13:07:14.484355 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:14.501187 19208 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.501670 19208 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:14.501405 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:14.502168 19208 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.502946 16562 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:14.504815 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.505878 16562 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:14.508126 17186 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:14.508448 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.509025 16562 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:14.509697 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1864) took 1601 ms. Trace:
I20260709 13:07:14.510068 16563 rpcz_store.cc:276] 0709 13:07:12.908119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.908634 (+   515us) service_pool.cc:224] Handling call
0709 13:07:12.908916 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.283646 (+374730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.509492 (+1225846us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540040e054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:14.509644 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838049536}
I20260709 13:07:14.511270 16563 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:14.509733 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:14.511981 16562 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:14.463095 19188 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:14.459926 19098 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:14.466472 16604 connection.cc:256] RPC call timeout handler was delayed by -1.2373465120000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
I20260709 13:07:14.519073 19118 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.526923 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 249) took 1262 ms. Trace:
I20260709 13:07:14.549712 16563 rpcz_store.cc:276] 0709 13:07:13.264246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.510863 (+1246617us) service_pool.cc:224] Handling call
0709 13:07:14.511116 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.522949 (+ 11833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.526874 (+  3925us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:14.572556 19197 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:14.572289 19208 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:14.573091 19213 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:07:14.485831 19143 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.481808 19082 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.584836 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.550704 19105 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.590494 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1645) took 1316 ms. Trace:
I20260709 13:07:14.590834 16563 rpcz_store.cc:276] 0709 13:07:13.274285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.552511 (+1278226us) service_pool.cc:224] Handling call
0709 13:07:14.552762 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.590284 (+ 37522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.590302 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.590329 (+    27us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.590347 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.590380 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.590455 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.521633 19195 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:07:14.595662 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.596899 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1647) took 1233 ms. Trace:
I20260709 13:07:14.597443 16563 rpcz_store.cc:276] 0709 13:07:13.363766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.593815 (+1230049us) service_pool.cc:224] Handling call
0709 13:07:14.594067 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.596589 (+  2522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.596617 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.596660 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.596703 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.596757 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.596852 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83}
I20260709 13:07:14.598713 19208 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.585381 19201 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.582331 19143 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.584196 19205 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:14.612299 18808 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.613196 19186 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.631294 16563 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.635025 19157 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.636693 19205 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.637058 19205 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:14.637802 19205 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.638864 19205 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.615329 18777 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.616477 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.620968 19082 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.586565 19159 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:14.588660 19113 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.522166 19190 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.628612 16562 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:14.647915 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.647965 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.522723 19193 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.657038 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.657425 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:14.657613 16633 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.649715 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:14.658595 16562 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.659157 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1649) took 1252 ms. Trace:
I20260709 13:07:14.659458 16562 rpcz_store.cc:276] 0709 13:07:13.407157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.658201 (+1251044us) service_pool.cc:224] Handling call
0709 13:07:14.658440 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.658939 (+   499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.659106 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.660674 16562 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:14.661662 16562 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:14.661967 16562 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:14.662627 16562 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.664359 16562 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.665279 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.667101 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.693358 19103 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.695025 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1891) took 1457 ms. Trace:
I20260709 13:07:14.695384 16637 rpcz_store.cc:276] 0709 13:07:13.237493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.239347 (+  1854us) service_pool.cc:224] Handling call
0709 13:07:13.239600 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.334455 (+ 94855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.694811 (+1360356us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b540015cf54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:14.694960 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184304384}
W20260709 13:07:14.696763 16560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1888) took 1701 ms (client timeout 1935 ms). Trace:
I20260709 13:07:14.696996 19157 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.697517 19092 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:14.699370 16560 rpcz_store.cc:269] 0709 13:07:12.995157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.106122 (+110965us) service_pool.cc:224] Handling call
0709 13:07:14.696616 (+1590494us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b540002ce54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.696712 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91944704}
I20260709 13:07:14.708288 16633 raft_consensus.cc:2410] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:14.668502 19082 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.640790 19201 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.700886 19192 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.663229 19113 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.719503 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:14.727880 16560 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.718434 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.704208 19143 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.657294 19159 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.715464 19082 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:14.733495 19159 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.733786 19082 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.732064 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.736320 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.737291 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.733093 16562 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:14.738400 16562 pending_rounds.cc:85] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 2
I20260709 13:07:14.738657 16562 pending_rounds.cc:107] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:14.738894 16562 raft_consensus.cc:2889] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.739956 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.740600 16562 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:14.740166 16640 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:14.740849 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:14.743599 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.746222 16560 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:14.747100 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.748513 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.748939 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.749379 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.749652 16640 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:14.750092 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.750438 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.748684 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:14.731662 19113 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.754596 19201 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.757539 19193 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.759805 18868 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.761289 18868 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.764240 19159 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.764721 19159 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:14.765596 19159 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:14.766000 16565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1890) took 1770 ms (client timeout 1890 ms). Trace:
W20260709 13:07:14.766405 16565 rpcz_store.cc:269] 0709 13:07:12.995621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.105871 (+110250us) service_pool.cc:224] Handling call
0709 13:07:14.765845 (+1659974us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b540002c454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.765949 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978416384}
I20260709 13:07:14.768278 16557 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:14.769328 19082 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.771169 16638 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:14.764626 18924 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.774848 19141 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.780239 16485 raft_consensus.cc:1217] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:07:14.781309 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.781972 16483 raft_consensus.cc:2368] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:14.782603 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.772068 16565 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:14.785307 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 98235.4us
I20260709 13:07:14.786656 16485 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:14.788498 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.789417 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.791235 16560 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:14.792567 19135 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:14.793352 19209 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:14.793716 19209 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:14.794056 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.794636 16489 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.795670 19209 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.800398 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.801596 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.793651 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.802678 16488 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:14.803357 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.805023 19074 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:14.805513 19074 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.808637 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:14.809321 19131 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:14.809397 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.810148 16490 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:14.816572 19141 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:14.817098 19141 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:14.832659 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.835060 16489 raft_consensus.cc:2410] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:14.840590 16636 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:14.844002 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.845448 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:14.848122 16560 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:14.848060 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 96115.2us
I20260709 13:07:14.844287 19209 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.853582 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.855624 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.856696 16489 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.857661 16530 leader_election.cc:400] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:14.858990 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:14.862166 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:14.862373 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.863248 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.863636 19116 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.863726 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:14.864377 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:14.865722 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:14.866816 17182 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.867049 17186 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:14.848796 19082 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:14.850335 19201 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.872931 16489 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:14.873741 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.869606 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:14.870698 16636 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.860491 18924 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.788633 16640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:14.872081 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.877647 16640 raft_consensus.cc:606] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:14.877776 16560 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:14.879084 16640 raft_consensus.cc:614] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:14.877054 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:14.878607 19131 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.881441 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.881985 16560 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:14.882682 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.883154 16560 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:14.860148 18732 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.860644 19141 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.884313 16486 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:14.884279 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.888141 16487 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:14.888494 16636 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:14.877156 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:14.891045 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:14.893159 17182 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:14.894006 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:14.886775 19203 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.397s	user 0.002s	sys 0.000s
I20260709 13:07:14.871268 19080 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.868810 19143 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.896867 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.893610 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:14.898272 16603 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:14.900242 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:14.876406 19147 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.896502 17186 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:14.901391 16456 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.935s (SENT)
I20260709 13:07:14.904616 19103 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.905030 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:14.906011 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:14.892931 19201 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:14.926124 19201 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.897692 19131 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.928544 19184 consensus_queue.cc:1059] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:14.929050 19204 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.436s	user 0.000s	sys 0.002s
I20260709 13:07:14.929311 18868 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.929754 18868 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:14.930510 18868 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.931581 18868 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.932478 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.933219 16491 raft_consensus.cc:2410] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:14.933880 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.934813 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.935309 16491 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:14.902817 19082 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.943005 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 244) took 1679 ms. Trace:
I20260709 13:07:14.943825 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.944870 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.945116 18973 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.945396 16488 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:14.946228 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.946707 16488 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:14.947382 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.905581 18732 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.911675 16640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:14.948807 16640 raft_consensus.cc:606] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:14.943377 16561 rpcz_store.cc:276] 0709 13:07:13.263244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.345752 (+ 82508us) service_pool.cc:224] Handling call
0709 13:07:14.942843 (+1597091us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400115154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.942955 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826538752}
I20260709 13:07:14.950870 16640 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:14.910543 19091 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.908288 17184 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.953814 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:14.954155 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:14.955163 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:14.911928 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 264) took 1441 ms. Trace:
I20260709 13:07:14.908499 19147 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.956189 19143 raft_consensus.cc:2764] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:07:14.956795 19143 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.957118 19143 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.957439 19143 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.957626 19147 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.913220 18984 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.913899 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1648) took 1549 ms. Trace:
I20260709 13:07:14.914500 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1651) took 1491 ms. Trace:
I20260709 13:07:14.958724 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.958967 16559 rpcz_store.cc:276] 0709 13:07:13.423260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.441400 (+ 18140us) service_pool.cc:224] Handling call
0709 13:07:14.914350 (+1472950us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b5400116f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.914451 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116260096}
I20260709 13:07:14.960269 16559 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:14.960546 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.961421 16559 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.961544 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.962204 16486 raft_consensus.cc:2368] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:14.899336 19092 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.962872 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.963129 19092 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.963507 19092 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.915251 16489 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:14.916375 19074 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.964321 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.964910 16489 raft_consensus.cc:2368] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:14.965312 19074 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.917187 18777 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.872787 19116 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:14.967224 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1644) took 1814 ms. Trace:
I20260709 13:07:14.968560 19116 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.901942 19080 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:14.922128 18342 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:14.969465 18818 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:14.922835 16636 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:14.970363 19080 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:14.970947 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.971660 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.971958 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:14.972494 16636 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.924129 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.967566 16557 rpcz_store.cc:276] 0709 13:07:13.152950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.461963 (+309013us) service_pool.cc:224] Handling call
0709 13:07:14.767985 (+1306022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.768610 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.967042 (+198432us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540002c450. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.967157 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3002779008}
I20260709 13:07:14.965523 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.925235 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 252) took 1660 ms. Trace:
I20260709 13:07:14.973817 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:14.974417 16489 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.958678 16563 rpcz_store.cc:276] 0709 13:07:13.364059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.599551 (+1235492us) service_pool.cc:224] Handling call
0709 13:07:14.599829 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.631722 (+ 31893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.913699 (+281977us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b540002d354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:14.913846 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71917952}
I20260709 13:07:14.976153 16638 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:14.976828 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.977537 16640 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:14.973479 16558 rpcz_store.cc:276] 0709 13:07:13.264912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.512454 (+1247542us) service_pool.cc:224] Handling call
0709 13:07:14.700148 (+187694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.700317 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.700340 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.700382 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:14.700410 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.700477 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.915695 (+215218us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540002ce50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:14.925178 (+  9483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343529728}
I20260709 13:07:14.993848 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:14.978850 16634 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:14.979311 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.955952 16631 rpcz_store.cc:276] 0709 13:07:13.470408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.470587 (+   179us) service_pool.cc:224] Handling call
0709 13:07:13.470866 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.535495 (+ 64629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.535526 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.563195 (+ 27669us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.246828 (+683633us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.246870 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.911567 (+664697us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b540043c454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:14.911619 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.911662 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:14.911675 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.911875 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8072,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":11214,"spinlock_wait_cycles":129885952,"thread_start_us":666100,"threads_started":1,"wal-append.queue_time_us":817860}
I20260709 13:07:14.979321 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.981592 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:14.984068 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.984695 18818 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:14.995380 16639 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:14.984850 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:14.995474 16491 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:15.000826 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:15.001253 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:15.001506 16486 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:14.987102 19074 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.989094 18342 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.989434 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.000298 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:14.990615 17184 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:15.009526 16454 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:14.992333 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1878) took 1937 ms. Trace:
I20260709 13:07:14.993216 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:15.011469 17186 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.993534 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:15.012580 17187 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:14.978440 16632 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:14.996130 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:15.014173 16632 pending_rounds.cc:85] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 2
I20260709 13:07:14.996618 16563 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:14.994868 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:15.014415 16632 pending_rounds.cc:107] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:15.014664 16632 raft_consensus.cc:2889] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.015417 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:15.017105 16638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da035835f764425db56e9649db0a0bcc"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:15.017645 16638 raft_consensus.cc:606] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:15.017962 16638 raft_consensus.cc:614] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:14.998063 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:14.998404 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 103697us
I20260709 13:07:15.004844 16489 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:14.997936 16636 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:15.024180 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:15.025549 17184 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.026566 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:15.028023 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.028363 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.030097 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.030920 16482 raft_consensus.cc:2410] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:15.010529 16635 rpcz_store.cc:276] 0709 13:07:13.054606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.065165 (+ 10559us) service_pool.cc:224] Handling call
0709 13:07:13.075846 (+ 10681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.493393 (+1417547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.992140 (+498747us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000fcdd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:14.992282 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3258444160}
I20260709 13:07:15.033455 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.029527 16605 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:15.038970 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.042034 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.042940 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:15.043241 16491 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.040947 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.039438 16605 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:15.057717 16489 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:15.058611 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50209.1us
I20260709 13:07:15.059170 16489 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:15.060923 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.062238 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:15.061070 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.009423 19225 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.064234 18342 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:15.009554 19118 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:15.064563 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 55113.7us
I20260709 13:07:15.073961 16634 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:15.027716 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:15.075591 16489 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:15.076706 16489 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.064198 16558 raft_consensus.cc:2410] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:15.038868 19106 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:15.073901 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.070148 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 282) took 1523 ms. Trace:
I20260709 13:07:15.078157 16484 rpcz_store.cc:276] 0709 13:07:13.546521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.546770 (+   249us) service_pool.cc:224] Handling call
0709 13:07:13.547130 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.160724 (+613594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.069918 (+909194us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54002e40d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:15.070092 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314633600}
I20260709 13:07:15.060391 19082 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.084393 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:15.077373 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:15.078953 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:15.080360 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.085597 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.057806 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:15.086548 16489 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:15.086534 17187 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.053620 16482 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:15.009471 19143 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.090215 17182 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:15.090777 16487 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:15.101346 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.035094 18732 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:07:15.100466 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.100760 18342 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.066790 16638 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.091720 16484 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.105087 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.104308 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.112959 16558 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:15.109800 16631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecb26c2b33364a6583c0073862883947"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:15.113952 16631 raft_consensus.cc:606] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:15.114252 16631 raft_consensus.cc:614] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:15.027817 18973 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:07:15.095160 16482 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:15.095934 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:15.091382 17186 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:14.999475 19116 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:07:15.043581 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:15.103184 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:15.057976 19135 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:15.092679 19082 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.104542 19152 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.083602 19225 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.034052 19074 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.128136 18732 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.128572 18732 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:15.129455 19225 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:15.129310 18732 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.129810 19074 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:15.104990 18872 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:15.130414 18732 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.130913 19155 raft_consensus.cc:2764] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:15.131820 19193 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.132262 19193 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.105697 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:15.133426 16487 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:15.134167 19193 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:15.135911 19082 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.136986 17183 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:15.139609 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.101636 19133 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:15.106616 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:15.107148 19186 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.107761 18868 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.108106 19141 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.109287 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:15.172314 16566 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.109754 19184 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.043447 19029 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:07:15.093979 18966 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.120146 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:15.115785 16488 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:15.040573 19098 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:07:15.124187 16483 raft_consensus.cc:2410] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:15.091727 17181 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:15.132539 19152 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.106266 19219 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.141180 16563 raft_consensus.cc:2368] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:15.142218 16529 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.092046 19118 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.104930 19080 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:15.118830 19209 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.180442 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.181671 16566 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:15.107772 18849 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.156889 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:15.191164 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:15.195175 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75106.4us
I20260709 13:07:15.219552 16635 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:15.128207 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.221424 16640 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:15.198680 18826 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.201848 16560 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:15.202145 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 1897) took 1123 ms. Trace:
I20260709 13:07:15.143056 19090 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.123404 19092 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.153192 18777 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:15.221561 16558 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:15.172073 19141 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:15.220709 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 78560us
I20260709 13:07:15.245850 19106 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:15.246757 16558 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.223495 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.246865 19106 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.125083 19114 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:07:15.220275 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:15.178699 19184 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:15.247385 16560 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:15.222754 16566 rpcz_store.cc:276] 0709 13:07:14.078959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.500255 (+421296us) service_pool.cc:224] Handling call
0709 13:07:15.109155 (+608900us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b5800174c98. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:15.202075 (+ 92920us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6816640}
I20260709 13:07:15.247488 19141 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.248055 19184 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.185016 18868 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.258772 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:15.201844 19164 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:15.243669 18924 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:15.263926 17183 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:15.262290 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:15.266978 16557 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.244726 19201 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.244856 18973 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:15.201375 19155 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:15.270272 16635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:15.222200 19209 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.277208 18868 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:15.277632 19241 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:15.286178 16635 raft_consensus.cc:606] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:07:15.264485 18966 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.201174 19152 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.264328 19205 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:15.319953 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 280575us
I20260709 13:07:15.328428 16605 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:15.332866 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:15.283133 18973 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:15.361786 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.267843 19103 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:15.317939 19241 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:15.365869 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 259308us
I20260709 13:07:15.272379 19150 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:07:15.286234 19133 consensus_queue.cc:1059] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:07:15.283236 19164 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:15.373318 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 131020us
I20260709 13:07:15.374199 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:15.377539 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.378968 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.286370 19201 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.327950 19135 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:07:15.394778 19230 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:07:15.453125 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:15.394624 18966 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.451261 19080 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:15.368052 19241 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.379364 19147 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:07:15.393389 19225 consensus_queue.cc:1059] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:07:15.470417 19116 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:07:15.466612 18966 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:15.476325 18872 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.477223 19248 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.477536 19201 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:15.478168 19231 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:07:15.479628 19235 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:07:15.480317 19234 log.cc:927] Time spent T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:07:15.480891 19233 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:07:15.481978 18732 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.470562 18868 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:07:15.474135 19147 consensus_queue.cc:1243] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:15.506222 19118 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:15.524623 19244 consensus_queue.cc:1059] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.525127 19250 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.525357 19201 raft_consensus.cc:3055] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.525754 19201 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:15.525924 19092 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:15.526358 19243 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.526885 19243 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.484241 19164 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:15.484633 19240 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.467676 18924 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:15.486137 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1905) took 1310 ms. Trace:
I20260709 13:07:15.536118 16565 rpcz_store.cc:276] 0709 13:07:14.176005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.784587 (+608582us) service_pool.cc:224] Handling call
0709 13:07:14.784822 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.838868 (+ 54046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.838902 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.845500 (+  6598us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.903558 (+ 58058us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.903595 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.903654 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.485914 (+582260us) raft_consensus.cc:1685] finished
0709 13:07:15.485938 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.486077 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57681,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2941,"thread_start_us":42616,"threads_started":1,"wal-append.queue_time_us":220001}
W20260709 13:07:15.492138 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 159325us
I20260709 13:07:15.484683 19152 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:15.476070 19249 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:07:15.514545 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 257) took 1024 ms. Trace:
I20260709 13:07:15.506780 19219 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:15.506163 18872 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.524143 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1901) took 1444 ms. Trace:
I20260709 13:07:15.548908 16562 rpcz_store.cc:276] 0709 13:07:14.079914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.773782 (+693868us) service_pool.cc:224] Handling call
0709 13:07:14.841992 (+ 68210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.842952 (+   960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.842980 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.847598 (+  4618us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.149231 (+301633us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:15.192638 (+ 43407us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.192895 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.192961 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.481795 (+288834us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b180035df40. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e522 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:15.523859 (+ 42064us) raft_consensus.cc:1685] finished
0709 13:07:15.523965 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.524084 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":539,"prepare.queue_time_us":43057,"raft.queue_time_us":1460,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":7524,"spinlock_wait_cycles":59087488,"thread_start_us":282377,"threads_started":1,"wal-append.queue_time_us":342770}
I20260709 13:07:15.550839 19080 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:15.537179 16485 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:15.506197 18966 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.552484 19080 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.456446 18973 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.540210 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:15.542987 19243 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:15.544725 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 72153.9us
I20260709 13:07:15.545871 16561 rpcz_store.cc:276] 0709 13:07:14.490568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.949425 (+458857us) service_pool.cc:224] Handling call
0709 13:07:14.949713 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.950021 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.950049 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:14.950554 (+   505us) log.cc:844] Serialized 52 byte log entry
0709 13:07:15.263295 (+312741us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:15.491573 (+228278us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.512570 (+ 20997us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.514248 (+  1678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.514319 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.514363 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:15.514376 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.514494 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1444,"prepare.queue_time_us":286254,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":3170,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":11361,"thread_start_us":509409,"threads_started":2,"wal-append.queue_time_us":417333}
I20260709 13:07:15.557363 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.558238 19243 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.558614 19243 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.558934 19243 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.564903 18342 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.565137 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:15.566172 18342 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:15.566614 18342 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:15.567342 18342 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.569481 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.570176 16561 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:15.572603 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.573266 16561 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:15.577142 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.577684 16562 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:15.539325 18826 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.515645 18732 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:15.582645 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44175.9us
I20260709 13:07:15.595525 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:15.597406 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.597913 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:15.599038 16605 leader_election.cc:400] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:15.599299 16605 leader_election.cc:403] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:07:15.588141 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.579880 18826 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.583464 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.608120 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 256) took 1117 ms. Trace:
I20260709 13:07:15.580952 18872 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:15.588445 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 425128us
W20260709 13:07:15.604319 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 501138us
I20260709 13:07:15.605490 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.606386 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.606671 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.611521 16560 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:15.612331 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:15.609009 16564 rpcz_store.cc:276] 0709 13:07:14.490287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.916092 (+425805us) service_pool.cc:224] Handling call
0709 13:07:14.916410 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.916714 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.916742 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.917188 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.272688 (+355500us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:15.488296 (+215608us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.488520 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.488599 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.607912 (+119313us) raft_consensus.cc:1685] finished
0709 13:07:15.607936 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.608061 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19743,"prepare.queue_time_us":247997,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":372,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":17289,"thread_start_us":525558,"threads_started":2,"wal-append.queue_time_us":398976}
I20260709 13:07:15.582551 19240 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:15.613540 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.608670 16565 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:15.594725 18732 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.594188 19118 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.627291 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:15.539999 19250 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.635613 16454 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.633827 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.579777 18924 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:15.631193 18342 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:15.626739 19150 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.612936 19251 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.632669 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:15.630205 19193 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.669755 18342 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:15.630401 19118 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.636350 16564 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:15.602671 19243 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.612833 19074 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:07:15.679677 18342 consensus_queue.cc:1243] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:15.668972 19259 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.579900 19219 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.634922 19082 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.674777 19249 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.705734 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:15.717633 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 81490.8us
I20260709 13:07:15.742090 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:15.743088 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:15.693802 19245 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:07:15.718005 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 84711.6us
I20260709 13:07:15.681428 19118 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.634371 19201 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:15.677609 19251 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:15.708963 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:15.841660 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 132776us
I20260709 13:07:15.842582 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:15.848646 19271 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.849144 19271 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.849480 19271 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:15.857566 19270 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:07:15.756110 19244 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:07:15.726076 19080 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:15.726586 19263 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.727275 18826 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:15.867568 19248 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.871476 19193 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.729344 19267 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:15.730561 19265 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:15.691846 19246 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:07:15.699065 19259 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.677994 19190 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:15.756426 16635 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:15.858321 19238 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
W20260709 13:07:15.879361 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 129355us
I20260709 13:07:15.867491 19276 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.880584 19201 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:15.721383 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 108995us
W20260709 13:07:15.723099 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 87540.8us
I20260709 13:07:15.920354 19267 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:15.932231 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:15.748936 19240 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.009105 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:15.923198 19265 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.933862 19276 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.036298 19276 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:15.944861 19264 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:07:15.923005 19251 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.927532 19259 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.039867 19243 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:15.924542 19135 consensus_queue.cc:1243] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:15.923939 19193 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.045030 19252 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.044484 19103 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.045341 19244 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.045761 19244 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:16.046295 19244 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.046054 19252 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.048202 19252 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.045717 19103 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.050714 19103 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:16.043617 19274 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:16.053375 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:16.014444 19241 consensus_meta.cc:287] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.003s
I20260709 13:07:15.980197 19282 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:15.991106 19279 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.946858 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:16.073388 16561 raft_consensus.cc:2410] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:16.043771 18872 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.015040 19265 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.053493 19250 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:16.070279 19238 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:16.058954 19243 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.113524 19244 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.115855 19244 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:16.095211 19278 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:16.117892 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:16.102607 19141 consensus_meta.cc:287] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.836s	user 0.007s	sys 0.000s
I20260709 13:07:16.070444 19082 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:16.107399 19277 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:16.071957 19282 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:16.060884 19193 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:16.128721 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 85879.7us
I20260709 13:07:16.045027 19276 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.137501 16635 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.127609 19248 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.106555 18732 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.111624 19243 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:16.142241 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.070828 19241 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.148053 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.148782 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.149092 19276 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.149588 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.107000 19271 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.143309 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.156970 17187 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:16.099058 19259 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:16.137868 18966 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.004s
I20260709 13:07:16.149868 17183 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.153357 16632 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:16.157696 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.158010 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.158300 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.158744 16483 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.182717 16484 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:16.158910 17187 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:16.149262 19282 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.159158 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.159633 16487 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:16.164166 16482 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:16.164592 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.165452 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 262) took 1528 ms. Trace:
W20260709 13:07:16.166631 19184 consensus_meta.cc:287] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.003s
I20260709 13:07:16.167373 16564 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:16.167483 19209 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.149390 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.132781 19141 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.200389 19141 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.192543 19251 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.205996 19251 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:16.192426 19118 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.183677 18966 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.210695 18966 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.194886 19184 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.212674 18808 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.213076 18808 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:16.213160 19184 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.193197 19249 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:16.213979 18808 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.215016 17187 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.215577 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:16.216655 19184 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.216428 16454 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:16.217909 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:16.219835 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.220253 19259 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.220352 16558 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.220840 18849 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.221218 18849 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.221534 18849 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.221803 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.152835 19248 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.226711 16564 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.227309 19248 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.227878 19248 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:16.223343 19118 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.228757 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.229432 16564 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.230427 19143 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.230942 16558 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:16.176741 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1078) took 1396 ms. Trace:
I20260709 13:07:16.177446 18732 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.179742 19241 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.184952 16561 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:16.231586 16486 rpcz_store.cc:276] 0709 13:07:14.780653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.033217 (+252564us) service_pool.cc:224] Handling call
0709 13:07:16.176573 (+1143356us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54000e8154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:16.176687 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198872320}
I20260709 13:07:16.184639 16482 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:16.155568 19267 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.232796 16482 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:16.233254 19255 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.715s	user 0.001s	sys 0.000s
I20260709 13:07:16.233563 19267 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.233817 16482 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.235759 16564 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:16.236047 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 555) took 1010 ms. Trace:
I20260709 13:07:16.236368 17186 rpcz_store.cc:276] 0709 13:07:15.225762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.225893 (+   131us) service_pool.cc:224] Handling call
0709 13:07:15.226192 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:15.244308 (+ 18116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.244336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:15.263290 (+ 18954us) log.cc:844] Serialized 52 byte log entry
0709 13:07:15.456888 (+193598us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:15.552106 (+ 95218us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.580596 (+ 28490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.580669 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.218731 (+638062us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b18000e89c0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:16.232649 (+ 13918us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:16.235859 (+  3210us) raft_consensus.cc:1685] finished
0709 13:07:16.235878 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.235997 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28207,"prepare.queue_time_us":242753,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2055,"raft.queue_time_us":30477,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":10920,"spinlock_wait_cycles":69835520,"thread_start_us":269066,"threads_started":2,"wal-append.queue_time_us":239475}
I20260709 13:07:16.237659 19271 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.238523 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.239015 16564 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.184800 16559 rpcz_store.cc:276] 0709 13:07:14.636951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.962070 (+325119us) service_pool.cc:224] Handling call
0709 13:07:14.962321 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.962622 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:14.972379 (+  9757us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.474596 (+502217us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.475053 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.475611 (+   558us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:15.536269 (+ 60658us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.537081 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.537149 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.165242 (+628093us) raft_consensus.cc:1685] finished
0709 13:07:16.165262 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.165398 (+   136us) inbound_call.cc:177] Queueing success response
0709 13:07:16.178625 (+ 13227us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b480005e758. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
Metrics: {"mutex_wait_us":35525,"prepare.queue_time_us":54610,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":25832,"raft.run_cpu_time_us":6383,"raft.run_wall_time_us":868695,"spinlock_wait_cycles":2998016,"thread_start_us":551758,"threads_started":3,"wal-append.queue_time_us":495843}
W20260709 13:07:16.173744 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.198113 19282 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.240315 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:16.197793 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.239574 16482 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:16.241725 16482 pending_rounds.cc:85] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:07:16.241972 16482 pending_rounds.cc:107] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:16.242182 16482 raft_consensus.cc:2889] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.243089 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.198738 17180 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:16.223318 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:16.224069 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.159209 19243 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.224752 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:16.241001 19258 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.521s	user 0.000s	sys 0.001s
I20260709 13:07:16.245398 16562 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.216351 18872 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:16.227306 19116 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.256664 19158 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.257053 19158 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:16.257786 19158 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.259212 19158 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.259481 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 264) took 1407 ms. Trace:
I20260709 13:07:16.259847 16557 rpcz_store.cc:276] 0709 13:07:14.852494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.973352 (+120858us) service_pool.cc:224] Handling call
0709 13:07:14.984917 (+ 11565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.269148 (+284231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.259287 (+990139us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54003296d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:16.259429 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648251776}
I20260709 13:07:16.257661 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:16.264127 19241 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:16.260365 16562 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:16.268625 19118 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:16.268951 17183 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:16.257928 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:16.269903 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.271914 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.272387 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.272704 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.273142 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.273449 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.274529 19092 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:16.269110 19118 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.275055 19092 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.275727 19225 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:16.276142 19225 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:16.276412 19118 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.276893 19225 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.277478 19092 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:16.279004 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.269243 18984 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.280915 18984 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:16.280519 19118 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.281448 19118 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.281795 19118 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.282788 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.281803 18984 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.285033 18984 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.285367 19113 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.296876 16564 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:16.287993 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:16.300922 16605 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:16.304527 16604 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:16.315896 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:16.318490 16604 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:16.292743 19113 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:16.319741 16604 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:16.307358 19251 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.309307 19133 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:16.306766 19201 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.347245 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.306136 19241 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:16.347572 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.317752 19279 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.343374 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:16.401285 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:16.440114 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:16.440541 16558 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:16.440796 16561 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:16.441581 16558 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.443005 16562 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.344679 16564 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:16.306581 18872 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:16.438148 16559 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:16.465692 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 122403us
I20260709 13:07:16.346753 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.347100 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:16.439368 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.439512 16557 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:16.326452 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:16.323197 19219 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.322767 19240 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.471771 16563 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:16.471925 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 145532us
I20260709 13:07:16.340010 19250 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:16.470146 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:16.437173 19092 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:16.476042 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:16.480207 19242 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.956s	user 0.003s	sys 0.012s
I20260709 13:07:16.480978 19113 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.482921 18849 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:16.483356 16485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1084) took 1701 ms (client timeout 1752 ms). Trace:
I20260709 13:07:16.474598 19271 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.464627 19201 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:16.441749 19133 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.468726 19279 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:16.511284 16485 rpcz_store.cc:269] 0709 13:07:14.782086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.800190 (+ 18104us) service_pool.cc:224] Handling call
0709 13:07:16.483192 (+1683002us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54000e8b54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:16.483296 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661221632}
I20260709 13:07:16.498268 16558 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:16.465729 19143 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:16.469040 19259 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.504221 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:16.513715 19113 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.474864 19219 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:16.480890 18872 consensus_queue.cc:1243] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:16.467016 19239 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.201s
I20260709 13:07:16.518597 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:16.525915 19201 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.529026 18849 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:16.530512 19133 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:16.524492 19143 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.539515 19143 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.533003 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.531473 19259 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:16.540462 17187 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:16.540697 19259 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.541708 19247 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:16.542098 19247 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:16.542804 19247 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.543664 19247 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.506011 19082 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:16.532730 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:16.525085 19271 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.499698 19265 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.512395 19092 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.546708 19279 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.533483 19219 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:16.590021 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.593240 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.507598 19251 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.607254 19114 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:16.523864 19118 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.605041 19240 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.605228 17180 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:16.627606 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 92972.2us
I20260709 13:07:16.613788 19209 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:16.615516 19271 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:16.629664 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 129098us
I20260709 13:07:16.623831 19240 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:16.643567 19271 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:16.645622 19293 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:16.633790 19240 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.633868 18732 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:07:16.606576 19082 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:16.659658 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.659440 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.664462 19118 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.665577 19118 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:16.667995 19265 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.667274 17180 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:16.669700 19267 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:16.670167 19267 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.673676 19306 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:16.622169 19114 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.678754 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:16.681879 16558 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.682703 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.683248 16485 raft_consensus.cc:2376] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4. Re-sending same reply.
I20260709 13:07:16.684937 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.685571 16486 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:16.686121 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.686057 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.686539 16561 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:16.686863 16491 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:16.686983 16487 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
I20260709 13:07:16.687481 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.686558 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.695300 19082 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.707050 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.713303 16558 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:16.714541 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:16.631003 19209 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.721328 16563 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:16.681298 19251 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.718114 19143 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:16.760573 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 98919.8us
I20260709 13:07:16.768903 19271 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.769466 19271 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:16.770453 19271 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:16.786265 16603 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.4:44223 timed out after 1.555s (SENT) [suppressed 26 similar messages]
I20260709 13:07:16.731017 19219 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.763232 19265 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:16.781801 19243 consensus_meta.cc:287] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:07:16.733080 19251 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.733876 19240 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:16.793754 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.767046 19143 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.806293 16635 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:16.791438 19092 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:16.762250 19303 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:07:16.810194 17179 raft_consensus.cc:1217] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Deduplicated request from leader. Original: 5.6->[6.7-7.8]   Dedup: 6.7->[7.8-7.8]
I20260709 13:07:16.821012 17179 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 13:07:16.819922 17186 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:16.819118 19288 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.822134 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.822331 19288 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:16.823027 19304 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:16.826646 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:16.821374 18984 consensus_meta.cc:287] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.520s	user 0.000s	sys 0.008s
I20260709 13:07:16.818867 19274 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.841720 17187 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.845492 19114 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:16.799530 19265 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.847297 18808 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.848519 19265 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:16.852785 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.854468 19303 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:16.854965 19303 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:16.856238 19307 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:16.799737 19243 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.859583 19243 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:16.860116 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:16.861717 16482 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.862073 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.863373 16631 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.839782 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.863169 19288 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.868166 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.868911 16638 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:16.861598 19274 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.869858 16638 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.870738 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.871297 16637 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:16.872293 19260 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:16.872637 19260 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:16.861334 19267 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.873374 19260 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:16.874516 19260 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:16.876782 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.861620 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.881595 16637 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:16.844548 19225 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.886426 16631 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:16.887308 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.888125 16639 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:16.883422 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:16.889534 19186 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:16.890692 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.890830 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:16.891928 16634 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.893601 17181 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:16.894876 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:16.896014 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:16.896811 19298 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
W20260709 13:07:16.897734 19297 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.461s	user 0.002s	sys 0.000s
W20260709 13:07:16.899420 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.899554 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:16.900889 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.903462 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.904259 16482 raft_consensus.cc:2410] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:16.904940 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:16.905253 16484 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:16.905781 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.906417 16483 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:16.906594 16491 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:16.907124 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.907542 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.907685 16490 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:16.908246 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.908941 16488 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:16.909090 16487 raft_consensus.cc:2410] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:16.909667 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:16.910236 16489 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:16.911093 16637 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.913758 16631 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:16.916024 16486 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:16.916242 16558 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:07:16.944676 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.950429 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:16.969923 19310 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.861238 19143 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:16.972858 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 186607us
I20260709 13:07:16.871052 19274 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:16.970496 19310 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:16.990387 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:16.998193 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:16.992612 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 100800us
W20260709 13:07:16.995832 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.969854 19201 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:17.008651 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 220181us
I20260709 13:07:17.012421 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.013057 18342 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:17.013314 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.013885 16638 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.992229 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:17.015187 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.000401 19090 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.030224 16637 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.030248 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.005553 19143 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.000635 18924 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.056634 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:17.015740 19260 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.010483 19274 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.021279 17186 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:17.021113 19141 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:17.022390 18973 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.064669 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:17.024361 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.026544 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.025796 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:17.016446 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.030167 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.039251 18342 consensus_queue.cc:1243] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:17.039181 16633 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:17.074843 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:17.040282 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1322267450000254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 13:07:17.016139 19186 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.076877 16634 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:07:17.057338 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.057210 16557 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.024586 19131 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:17.070473 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.071875 16640 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:17.016301 18984 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:17.069774 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.085131 16638 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.073927 16562 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:17.077893 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.078523 16560 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.078797 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.008157 19275 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:07:17.088167 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 62993.6us
I20260709 13:07:17.080777 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.083271 16640 pending_rounds.cc:85] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 7
I20260709 13:07:17.092976 16640 pending_rounds.cc:107] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:17.093245 16640 raft_consensus.cc:2889] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:17.083545 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 57812.2us
I20260709 13:07:17.073504 19133 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.101013 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.101600 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.102128 16635 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.100893 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:17.057744 19314 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:17.107764 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:17.084949 19091 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:17.012905 19201 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.083016 19272 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.083444 19092 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:17.128583 16635 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:17.124887 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.087854 19280 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.135186 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.056385 19090 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.069527 18808 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:17.141938 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.074010 18924 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.150296 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.069873 19143 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:17.148092 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 47295.1us
I20260709 13:07:17.078253 19260 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.108186 18966 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.112084 18868 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:17.168210 19209 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:17.148772 16635 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:17.169394 16564 raft_consensus.cc:1217] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-7.4]   Dedup: 5.3->[7.4-7.4]
I20260709 13:07:17.169656 16635 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.162207 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.165649 16640 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.170634 16635 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.170835 16564 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: [3.2-7.4]
I20260709 13:07:17.171306 16637 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.144876 19280 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.104288 19131 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.168229 19260 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.088020 19080 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:07:17.178596 16635 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:17.084741 18818 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:07:17.084868 19186 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.149394 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:17.166290 16603 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:17.162741 19082 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.103811 18984 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.107540 19225 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:07:17.134339 19314 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.193161 16386 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 5, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 5 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.195297 19314 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.160549 19247 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:07:17.176599 19280 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.144084 19164 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.148249 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:17.150396 16638 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:17.146559 19092 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.079759 19274 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.178273 16566 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:17.125991 19091 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.177269 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:17.165823 19275 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.188040 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1133) took 1988 ms. Trace:
I20260709 13:07:17.173746 19190 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.187395 19271 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.160703 19106 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.195781 19314 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.192883 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.133260 19289 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:07:17.200099 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 50777.9us
I20260709 13:07:17.201689 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.191118 19080 consensus_queue.cc:1243] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:17.146992 19272 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.190534 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.236243 16636 rpcz_store.cc:276] 0709 13:07:15.199513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.199617 (+   104us) service_pool.cc:224] Handling call
0709 13:07:15.199927 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.328215 (+128288us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:15.370547 (+ 42332us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.227636 (+857089us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b48001a01d8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
0709 13:07:16.651819 (+424183us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b18000baee0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:07:17.016152 (+364333us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.055244 (+ 39092us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.055409 (+   165us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.055444 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.055505 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.187856 (+132351us) raft_consensus.cc:1685] finished
0709 13:07:17.187876 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.187984 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42163,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":1451,"raft.queue_time_us":108050,"raft.run_cpu_time_us":1388,"raft.run_wall_time_us":969335,"spinlock_wait_cycles":23672064,"thread_start_us":481448,"threads_started":3,"wal-append.queue_time_us":1519238}
I20260709 13:07:17.192493 17186 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:07:17.240821 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 162992us
I20260709 13:07:17.259557 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.260797 16530 leader_election.cc:400] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:17.261572 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.203121 19260 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.203042 19288 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.244437 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 479446us
I20260709 13:07:17.267529 16604 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:17.211406 18966 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:17.241346 18808 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.241768 19158 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.252102 17184 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
W20260709 13:07:17.265957 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 75492.3us
I20260709 13:07:17.211470 18868 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.268683 19080 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:07:17.273878 19143 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.301683 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:07:17.274966 19300 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.765s	user 0.004s	sys 0.001s
I20260709 13:07:17.275247 19247 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.250391 19222 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:17.251564 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 161526us
I20260709 13:07:17.275957 19274 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.252133 19314 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:17.295470 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.323309 16603 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:17.279907 19271 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:17.278919 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 262531us
I20260709 13:07:17.297672 17180 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:17.305656 19316 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:07:17.331496 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:17.328219 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.328346 16455 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:17.333344 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.265178 19279 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:17.336529 16566 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:17.322798 19314 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.337548 16566 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:07:17.338779 16566 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:17.339531 19334 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.340149 19340 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.340026 19334 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.340607 19340 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:17.341070 19340 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.296455 18808 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.342710 18808 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.345213 19251 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:17.347887 19340 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.348655 19091 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:17.349004 19325 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:17.349421 19131 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.350178 19340 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:17.351315 19329 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:17.276652 19317 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:07:17.329952 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.262445 19090 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.298305 18966 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.352272 19080 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.327028 19143 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:17.350232 19320 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:07:17.353554 19335 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:17.354668 16604 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:17.355538 16561 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:17.276908 19288 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.302027 18868 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.314795 19249 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:17.329643 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.305783 19158 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.335729 19164 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.340653 19303 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:17.336104 19271 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:17.363912 19327 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:07:17.443178 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 181672us
I20260709 13:07:17.378346 16604 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:17.434119 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 175268us
W20260709 13:07:17.428668 19331 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:17.352200 19342 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.374658 19251 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:17.419672 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.445437 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 67095.8us
W20260709 13:07:17.427188 19316 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:17.376076 16559 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:17.354918 19247 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:07:17.377341 19080 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.449839 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.353271 19135 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.450740 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:17.451850 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.453842 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.455008 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:17.456578 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.445644 19303 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.461596 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.467556 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:17.461863 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:17.473222 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.362277 19143 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:17.471218 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:17.448593 19186 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.475111 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:17.378017 18924 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.476656 16559 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:17.451524 18984 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.449170 19240 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:17.479558 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:17.360560 19243 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
W20260709 13:07:17.477335 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 142197us
I20260709 13:07:17.453891 19249 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.456038 19251 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.461228 19247 consensus_queue.cc:1243] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:17.477345 19141 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.470760 19164 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:17.552901 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 52077us
W20260709 13:07:17.544625 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 65203.7us
I20260709 13:07:17.556159 16559 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:17.557546 16561 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.558485 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.559031 16562 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:17.478662 19092 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.470964 19114 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:17.446835 18966 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.556110 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.493152 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.551599 19338 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.562193 16562 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:07:17.491669 19186 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.479808 19143 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.481145 19209 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:07:17.547446 19249 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:17.540148 18984 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:17.489248 19190 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.568631 19338 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:17.474519 19337 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:07:17.551708 19336 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 13:07:17.600427 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 107350us
I20260709 13:07:17.571424 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.600085 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.551950 19289 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:17.501200 19271 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:17.608995 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53119.2us
I20260709 13:07:17.607065 19114 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.588629 19340 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.612262 19190 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.552702 19247 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:07:17.618971 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.622566 19341 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.626775 19346 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.617120 16562 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:17.699574 16562 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:17.618906 19338 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.617617 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.704617 16566 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 3.
I20260709 13:07:17.632055 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.633682 19345 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:17.634392 19344 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:07:17.635246 19347 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:07:17.636101 19348 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:17.632620 19190 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.639876 18924 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:17.697260 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 53348.7us
I20260709 13:07:17.736243 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.644026 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:17.705817 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 73850.7us
W20260709 13:07:17.630067 19333 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.264s	user 0.000s	sys 0.000s
I20260709 13:07:17.625226 19114 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:17.708184 16559 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:17.701665 16562 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:17.738235 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.629195 19272 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:17.713737 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 168989us
I20260709 13:07:17.637300 19334 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.630820 19186 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:17.718520 19354 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:17.718670 19158 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.724617 19338 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.709945 19349 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.741189 19114 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.728900 19147 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.730634 18872 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.642818 19288 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:17.779277 18872 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.780141 18872 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.781067 18872 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.740017 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:17.784324 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 44564.1us
I20260709 13:07:17.784982 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:17.741817 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.566476 19080 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.787688 19346 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.788319 19346 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.742749 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.743162 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:17.743320 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.743736 19340 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.786680 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:17.750761 16633 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:17.712177 18868 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.711073 19345 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:17.769553 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.754707 19186 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.762913 18984 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:17.795250 17183 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:17.795817 18984 consensus_queue.cc:1243] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:17.727114 19249 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.798538 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:17.798981 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65757.6us
I20260709 13:07:17.803541 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:17.808696 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:17.776957 19147 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.816429 19147 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.817533 19147 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.819181 17188 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:17.820365 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:07:17.821421 18973 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.737s	user 0.004s	sys 0.004s
I20260709 13:07:17.773679 18966 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:17.827953 19341 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.828498 19314 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.832027 16560 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:17.800997 19340 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.834673 19338 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:17.794929 19345 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.838052 19342 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.814019 19349 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:17.839113 19349 raft_consensus.cc:697] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:17.839942 19349 consensus_queue.cc:237] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:17.841825 19326 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.657s	user 0.000s	sys 0.003s
I20260709 13:07:17.843111 19113 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.843477 19113 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:17.844453 19280 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.609s	user 0.003s	sys 0.006s
I20260709 13:07:17.844187 19113 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.844822 19280 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.846055 18342 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.846392 18342 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.847002 18342 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.848244 19274 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:17.848608 19274 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:17.849375 19274 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.755074 18924 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:17.796295 18984 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.823318 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:17.823525 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.852461 18342 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.775600 19282 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:17.854000 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:17.854369 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:17.821902 19334 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.857335 16488 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:17.857726 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:17.861164 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.861958 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:17.862703 16488 raft_consensus.cc:2410] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:17.862787 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:17.863070 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:17.863619 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:17.864198 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.864812 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:17.865377 16485 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:17.865312 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.863189 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:17.866591 16486 raft_consensus.cc:2410] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:17.867110 16491 raft_consensus.cc:2410] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:17.868032 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:17.869105 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:17.869540 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.869793 19346 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.871220 19346 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:17.872403 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:17.873515 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:17.872941 16490 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.850311 19274 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.880425 16557 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:17.828464 19341 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:17.881108 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:17.884980 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.885661 16562 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:17.886202 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:17.886710 16565 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.856626 18984 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.859449 19265 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.855719 19284 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.891018 16566 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:17.872700 19342 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.835420 19186 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.874254 19113 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.880776 19092 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:17.896133 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.879369 18818 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.888782 19249 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.908986 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.868081 19282 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.872968 19340 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.903023 16565 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:17.909520 16566 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:17.919776 16565 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:17.896432 19265 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.923384 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.910415 19186 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.908237 18818 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:17.923365 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.916663 19092 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:17.896637 19284 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.948366 19106 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.948742 19106 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.949486 19106 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.950541 19106 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.928623 18984 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.952877 18984 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.958127 19133 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.958521 19133 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:17.959270 19133 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.960160 19133 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.960994 19280 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.966389 19306 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.966846 19306 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.968204 19098 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.968565 19098 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:17.968726 19306 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.970820 18732 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.971256 18732 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.975649 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.975924 18732 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:17.932067 19341 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.976950 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.977578 19143 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:17.934974 19367 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:17.926769 18818 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.979019 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:17.937180 16490 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:17.938910 19345 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:17.941059 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:17.939536 19141 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.941764 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:17.972628 19240 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.972865 19201 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:17.978098 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.929107 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:17.989568 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:17.992121 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.992452 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.992636 16565 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:17.993420 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:17.994308 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.994913 16633 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:17.979475 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.996184 16637 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:17.981258 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:17.997452 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.974509 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1927) took 1094 ms. Trace:
I20260709 13:07:17.998417 16634 rpcz_store.cc:276] 0709 13:07:16.880234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.892508 (+ 12274us) service_pool.cc:224] Handling call
0709 13:07:16.892762 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.082323 (+189561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.974265 (+891942us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002ba2d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:17.974452 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422825728}
I20260709 13:07:17.999435 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.984587 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.978955 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:17.987221 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:17.927107 19314 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:17.945483 18872 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.007618 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:17.989668 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 48691.4us
I20260709 13:07:18.001021 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.004026 16636 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:17.988511 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 46816.2us
I20260709 13:07:17.997996 16640 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:18.005770 16565 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:18.009843 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.042619 16487 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.042845 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.043602 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.044083 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:18.010257 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:18.011159 16640 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:18.045742 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.047533 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:18.047998 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.048580 16563 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:18.049185 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.049585 16563 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:17.992076 18924 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.050343 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:18.054147 16640 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:17.992213 19259 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.056682 16637 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:18.004355 19343 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.007726 19306 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:18.108744 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46918.3us
W20260709 13:07:18.109216 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46705.3us
I20260709 13:07:17.988394 19135 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:07:18.042313 19338 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.066962 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:18.067296 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.118129 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:18.118500 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51286.3us
I20260709 13:07:18.118691 16632 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.119505 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.012701 19271 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:07:18.055675 19314 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.120674 19334 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.120620 19158 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.055876 19346 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.012362 19225 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:07:18.106024 19090 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.131413 18342 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.146407 18342 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.120642 19288 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.054711 19275 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.057493 18872 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.111537 19306 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:18.108269 19259 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:18.156971 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44447.3us
I20260709 13:07:18.117296 18732 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.146768 18342 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:18.131995 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65104.6us
I20260709 13:07:18.163385 16455 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.130993 19314 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.060560 19366 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:07:18.127755 19338 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:18.137447 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.151541 19158 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:18.191313 19158 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.194131 18342 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.165779 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.170607 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:18.196830 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:18.198434 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.199093 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.199447 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.156702 19288 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.157759 19306 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.157976 19275 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:18.172747 19373 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:07:18.172538 19338 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.166931 18732 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.174710 19345 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:18.123890 19357 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:18.132025 19343 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:18.159248 19259 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.174665 19346 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.187606 18872 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.169242 19314 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.131963 19092 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.190466 19143 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.195264 16640 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:18.204869 19090 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.195601 16632 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:18.123368 19342 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.200903 18342 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.201824 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.219302 16634 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.204433 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:18.209252 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.220714 16637 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:18.173951 19282 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.132151 19098 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.192518 19272 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.207059 19219 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:18.206835 19349 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.222972 18342 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:18.223361 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:18.207315 18924 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.203923 19190 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.227705 19284 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.228230 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1691) took 1223 ms. Trace:
I20260709 13:07:18.229079 19275 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.229740 18732 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:18.230546 19288 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.297102 16558 rpcz_store.cc:276] 0709 13:07:17.005250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.005870 (+   620us) service_pool.cc:224] Handling call
0709 13:07:17.006193 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.029513 (+ 23320us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:17.077583 (+ 48070us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.859887 (+782304us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b18002f2420. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:07:17.924640 (+ 64753us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.945417 (+ 20777us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.945556 (+   139us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:17.945589 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.945649 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.227955 (+282306us) raft_consensus.cc:1685] finished
0709 13:07:18.228055 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.228180 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24786,"prepare.queue_time_us":48051,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":12685,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":7104,"spinlock_wait_cycles":3980544,"thread_start_us":58885,"threads_started":1,"wal-append.queue_time_us":861681}
I20260709 13:07:18.277379 18342 consensus_queue.cc:1243] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:18.233476 19340 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.276134 17187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 564) took 1090 ms. Trace:
W20260709 13:07:18.235590 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69873.7us
I20260709 13:07:18.255105 16634 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:18.242504 19201 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:18.294121 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.223834 19090 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.212464 19334 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.199316 19114 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.250069 18818 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.275746 19253 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:18.296808 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 97439.8us
I20260709 13:07:18.297329 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1945) took 1289 ms. Trace:
W20260709 13:07:18.296198 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72906.8us
I20260709 13:07:18.231499 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.304785 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:18.312770 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:18.312500 16564 rpcz_store.cc:276] 0709 13:07:17.007721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.007900 (+   179us) service_pool.cc:224] Handling call
0709 13:07:17.023859 (+ 15959us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:17.171569 (+147710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.297098 (+1125529us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540040e054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:18.297274 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334265600}
I20260709 13:07:18.313901 18342 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.314246 18342 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.314528 18342 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.315529 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:18.317973 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.312781 16637 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
W20260709 13:07:18.321354 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.304432 17187 rpcz_store.cc:276] 0709 13:07:17.185849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.186635 (+   786us) service_pool.cc:224] Handling call
0709 13:07:17.186873 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.269385 (+ 82512us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:17.269621 (+   236us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.428474 (+158853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.428522 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.428560 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.275896 (+847336us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b54000a46d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:18.275941 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.276055 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66808,"prepare.queue_time_us":476,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":67888,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":189179136,"thread_start_us":91689,"threads_started":1,"wal-append.queue_time_us":181948}
I20260709 13:07:18.296414 18924 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.322261 16635 raft_consensus.cc:1217] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-9.5]   Dedup: 5.3->[7.4-9.5]
I20260709 13:07:18.321915 16566 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
W20260709 13:07:18.322943 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.322996 16635 pending_rounds.cc:85] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 3
I20260709 13:07:18.298172 19106 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:18.323489 16635 pending_rounds.cc:107] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 13:07:18.326411 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.326781 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.323462 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.326135 16635 raft_consensus.cc:2889] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:18.327600 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.328692 16634 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:18.319552 19253 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:18.309268 19090 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.335933 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:18.336580 16490 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:18.340891 18818 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.309494 19383 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:18.329967 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:18.345088 18342 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.319550 19288 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:18.325989 19274 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.351084 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:18.351257 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.325001 18924 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.352160 18342 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.322988 19284 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.358888 17188 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.360551 17183 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:18.367280 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.367372 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:18.367892 16634 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.352891 19106 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:18.375273 16634 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
W20260709 13:07:18.362401 19205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.117s	user 0.001s	sys 0.021s
I20260709 13:07:18.354167 19274 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.377080 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:18.380296 19274 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.380817 19106 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.384375 16482 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:18.388675 16633 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:18.363317 19284 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:18.365075 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:18.378095 19205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.001s	sys 0.021s
I20260709 13:07:18.352078 19383 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.378717 19222 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.357052 19288 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.379873 19345 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.363687 19259 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.408215 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:18.410234 16490 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.391673 18973 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.415607 16633 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:18.394948 19222 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.423735 19334 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:18.426370 19385 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:07:18.401254 19345 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.429562 16638 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:18.443388 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:18.443949 16482 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.401741 19310 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:18.455289 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.457511 16490 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:18.401674 18966 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:18.464134 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:18.429075 19222 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.405105 19141 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:18.466837 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:18.454385 19133 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:18.428905 18973 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:18.434285 19345 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.471244 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.452220 19275 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.451159 19190 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:18.469911 19186 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.463063 19310 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.467410 18872 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.534112 16482 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:18.420778 19314 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.466144 19306 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.479475 18984 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.546923 16640 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:18.467876 19272 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:18.476207 19186 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:18.547474 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.480923 19114 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:18.539713 19390 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.124s	user 0.000s	sys 0.011s
I20260709 13:07:18.462318 19284 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.568578 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:18.472082 19133 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.537814 19190 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:18.574816 19190 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:18.575937 19393 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:07:18.576892 19190 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:18.577260 19391 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:07:18.476065 19275 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.581449 19275 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:18.569645 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.583079 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.584244 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:18.584743 16558 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.536446 18872 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.586238 18872 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:18.590314 19332 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 1.262s	user 0.001s	sys 0.003s
I20260709 13:07:18.576915 19334 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:18.592078 19334 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.592671 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1922) took 1713 ms. Trace:
I20260709 13:07:18.593958 19334 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.593024 16639 rpcz_store.cc:276] 0709 13:07:16.879106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.888731 (+  9625us) service_pool.cc:224] Handling call
0709 13:07:16.888982 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.970252 (+ 81270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.970283 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.995694 (+ 25411us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.244053 (+248359us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:17.244088 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.244144 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.589845 (+1345701us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:18.592423 (+  2578us) raft_consensus.cc:1685] finished
0709 13:07:18.592442 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.592620 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80921,"raft.queue_time_us":84434,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12819,"spinlock_wait_cycles":36603136,"thread_start_us":226801,"threads_started":1,"wal-append.queue_time_us":258362}
I20260709 13:07:18.595310 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:18.595533 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.596163 16559 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:18.596917 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.597846 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.631383 16559 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:18.632061 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:18.632274 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:18.600436 19306 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:18.602303 19383 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.604405 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1695) took 1277 ms. Trace:
I20260709 13:07:18.605528 19274 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.605841 18872 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:18.606353 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.610327 19090 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.546279 19288 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.611476 19259 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:18.570627 16482 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:18.549216 18984 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.622594 16558 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:18.570035 19186 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.624989 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1957) took 1059 ms. Trace:
I20260709 13:07:18.626330 19314 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:18.628973 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.629858 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.630091 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.630780 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.633180 16564 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:18.583217 17180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 451) took 1693 ms (client timeout 2153 ms). Trace:
I20260709 13:07:18.638342 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.641379 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:18.678289 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 49400.3us
W20260709 13:07:18.641360 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 105211us
I20260709 13:07:18.642738 16560 rpcz_store.cc:276] 0709 13:07:17.326543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.328652 (+  2109us) service_pool.cc:224] Handling call
0709 13:07:17.328950 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.832372 (+503422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.604212 (+771840us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400082d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:18.604356 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156581760}
I20260709 13:07:18.679334 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:18.645578 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:18.647290 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.648206 16488 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:18.538968 19310 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:18.653213 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 182015us
W20260709 13:07:18.676213 17180 rpcz_store.cc:269] 0709 13:07:16.889685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.955309 (+ 65624us) service_pool.cc:224] Handling call
0709 13:07:18.583025 (+1627716us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54005794d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:18.583145 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508488960}
I20260709 13:07:18.682487 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.667375 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:18.672535 16561 rpcz_store.cc:276] 0709 13:07:17.565288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.565471 (+   183us) service_pool.cc:224] Handling call
0709 13:07:17.565724 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.710778 (+145054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.710811 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.711257 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.775591 (+ 64334us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:17.775629 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.624610 (+848981us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540002d354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:18.624665 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.624710 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:18.624723 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.624931 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":965,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2900,"spinlock_wait_cycles":332827392,"thread_start_us":64033,"threads_started":1,"wal-append.queue_time_us":104257}
I20260709 13:07:18.683220 16558 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.680646 17188 raft_consensus.cc:2368] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7.
W20260709 13:07:18.684324 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54556.1us
I20260709 13:07:18.687253 16559 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:18.688143 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.648900 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:18.689240 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.668322 18984 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.693936 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:18.745379 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:18.745960 16559 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:18.746712 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:18.709928 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.747578 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.692863 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:18.693933 16558 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:18.751545 16558 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:18.644271 19240 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:18.730783 19106 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.754113 19106 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.757135 16558 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:18.572640 18973 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.758409 16558 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:07:18.723912 19280 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.733824 17179 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:18.733843 16564 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:18.685470 19092 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.695770 19143 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.690300 19205 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.642607 19334 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:18.736464 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:18.731400 19332 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:07:18.733413 19391 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:18.739975 16487 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:18.740864 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:18.781989 16486 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.741496 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:18.741760 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:18.742019 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:18.741768 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:18.787876 16491 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:18.787892 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46223.5us
I20260709 13:07:18.724610 19267 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.788040 16454 leader_election.cc:400] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7.
I20260709 13:07:18.789518 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:18.752619 17181 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:18.759826 16558 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:18.756037 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:18.791565 16482 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:18.765444 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 72644us
I20260709 13:07:18.769001 19280 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.802410 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:18.796856 16486 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:18.771396 19337 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.793519 19147 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.794790 19338 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.804293 19280 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.804924 18966 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.814183 19205 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.851487 19310 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:18.851935 18872 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.852751 19222 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.855283 16491 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:18.800312 19267 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.856537 19147 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:18.838829 19250 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:07:18.848981 18966 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:18.877069 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 138027us
I20260709 13:07:18.856629 19402 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.839061 19243 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:07:18.856527 19133 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:18.860146 19337 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:18.900914 19363 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.169s	user 0.003s	sys 0.000s
I20260709 13:07:18.903952 19250 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:18.904306 19250 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:18.905045 19250 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.906129 19250 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.908241 19090 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.897367 19402 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.909525 19147 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.910318 19402 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.911774 19267 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:18.870610 19205 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:18.846982 18924 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.875687 19274 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:18.897558 19405 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:18.896010 18966 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.890956 19259 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:18.932256 16561 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:18.932369 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 128564us
I20260709 13:07:18.923287 19114 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:18.941402 19205 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.947196 19092 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.960196 19143 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:18.960769 19143 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.962577 19143 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.962693 19337 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.934075 18984 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:18.965675 18984 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:18.935292 19259 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.968035 19259 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:18.969432 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:18.970009 17187 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 3.
I20260709 13:07:18.972378 19410 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:18.972961 19410 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.951707 19114 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:18.976861 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:18.979274 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.982807 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:18.985019 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:18.975632 19410 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:18.951233 19090 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:18.956125 19314 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:18.995636 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:19.004091 16638 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.018074 16559 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:18.978089 19345 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.021855 16638 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:19.027534 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:19.004123 19222 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.036662 16563 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:19.048517 19114 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.053273 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 279) took 1136 ms. Trace:
I20260709 13:07:19.053648 16566 rpcz_store.cc:276] 0709 13:07:17.916489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.917204 (+   715us) service_pool.cc:224] Handling call
0709 13:07:19.053111 (+1135907us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400018954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:19.053206 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915182208}
I20260709 13:07:19.054275 19345 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.055001 16483 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.056663 18924 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.058519 19186 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.059602 16484 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.045694 19416 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:19.068418 19416 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:19.069852 19423 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:07:19.070906 19350 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 1.461s	user 0.006s	sys 0.002s
I20260709 13:07:19.073071 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 456) took 1772 ms. Trace:
I20260709 13:07:19.073400 17186 rpcz_store.cc:276] 0709 13:07:17.300416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.300553 (+   137us) service_pool.cc:224] Handling call
0709 13:07:17.300861 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.301158 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.301183 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.316256 (+ 15073us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.476595 (+160339us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.476628 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.476687 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.070364 (+1593677us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:19.072811 (+  2447us) raft_consensus.cc:1685] finished
0709 13:07:19.072830 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.073017 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":449,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":11522,"spinlock_wait_cycles":10381696,"thread_start_us":139753,"threads_started":1,"wal-append.queue_time_us":204261}
W20260709 13:07:19.074890 19401 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:07:19.076797 19411 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:19.077306 19280 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.079272 19280 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.010993 19314 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.083130 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:19.069401 19416 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.085357 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.009112 19090 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.056783 19319 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:19.090883 19319 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:19.092779 19319 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.093189 18818 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:19.093917 19319 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.093760 18818 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.097270 19253 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:19.099387 19420 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:07:19.106783 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 104964us
I20260709 13:07:19.107622 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:19.111210 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:19.113137 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:19.118350 18966 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.119812 19306 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:19.120211 19306 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:19.120580 19306 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.121439 18966 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.124691 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 274) took 1231 ms. Trace:
I20260709 13:07:19.125314 19402 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:19.125665 19092 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:19.126187 19092 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.127802 19328 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.128319 19328 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.118502 17184 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:19.130774 19328 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:19.132838 19314 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.133563 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:19.134351 17184 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 4: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:19.135811 19302 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:19.136114 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.136632 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.137177 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:19.121394 19098 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.137130 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.138953 16564 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.110033 19417 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.139647 19417 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:19.140018 19417 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.125041 16557 rpcz_store.cc:276] 0709 13:07:17.893105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.893243 (+   138us) service_pool.cc:224] Handling call
0709 13:07:17.905064 (+ 11821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.910640 (+  5576us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:17.910668 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.921566 (+ 10898us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.124454 (+202888us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.124494 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.124353 (+999859us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5400019354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:19.124397 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.124440 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:19.124453 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.124637 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":217,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":7930,"spinlock_wait_cycles":3085568,"thread_start_us":138851,"threads_started":1,"wal-append.queue_time_us":219303}
I20260709 13:07:19.171161 16564 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:19.168174 18973 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:19.172078 18973 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:19.172811 18973 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.173738 18973 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:19.181893 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.114120 19351 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.169122 16529 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:19.225023 19314 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:19.174341 18868 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.234030 19322 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:19.234827 19186 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.235110 19092 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:19.239048 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 94804.1us
I20260709 13:07:19.242118 16562 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:19.242759 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:19.239480 19334 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.137120 16566 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.242472 16562 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:19.253172 16640 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:19.235520 18818 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.247324 18868 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.263285 18868 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.253862 19092 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.252781 19186 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.269941 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:19.254447 19351 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:19.270048 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.270877 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.269963 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:19.270274 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.271703 18868 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.274608 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:19.247380 19143 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:07:19.244910 19314 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:19.293798 16388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 238) took 16942 ms (client timeout 15000 ms). Trace:
I20260709 13:07:19.294010 19366 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:19.294988 19351 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.277338 19402 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.298269 19402 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.276114 19090 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.279520 16566 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:19.279595 16634 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:19.279628 16637 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:19.281378 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1706) took 1309 ms. Trace:
I20260709 13:07:19.327919 16565 rpcz_store.cc:276] 0709 13:07:17.972191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.994838 (+ 22647us) service_pool.cc:224] Handling call
0709 13:07:17.995043 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.012052 (+ 17009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.281163 (+1269111us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54001c8254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:19.281324 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24300416}
I20260709 13:07:19.282517 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:19.282040 16386 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 5, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 5 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.330320 16386 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 4, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 4 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:19.332396 16386 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.281323 19186 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.333961 16386 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 7, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 7 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.335060 17185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 455) took 2096 ms. Trace:
I20260709 13:07:19.057703 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.281533 16638 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:19.280755 18868 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.345460 19265 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.329146 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.353820 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:19.371408 16633 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.373185 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.374191 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.375089 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:19.351747 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 609600us
I20260709 13:07:19.339042 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.352998 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.345803 17187 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.377456 19417 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.379056 18868 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.378028 17185 rpcz_store.cc:276] 0709 13:07:17.238246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.238616 (+   370us) service_pool.cc:224] Handling call
0709 13:07:17.255880 (+ 17264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.466334 (+210454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.466364 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.471374 (+  5010us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.609207 (+1137833us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b18002c2540. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:07:18.794065 (+184858us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:18.794101 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.334782 (+540681us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54005d11d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:19.334832 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.334873 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:19.334887 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.335011 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4101,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":5854,"spinlock_wait_cycles":492622080,"thread_start_us":184703,"threads_started":1,"wal-append.queue_time_us":1440809}
I20260709 13:07:19.379237 18872 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:19.379864 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.379783 18872 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.380470 16566 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.339025 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.382588 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.383034 16564 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:19.383780 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.353542 16637 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.377555 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.385201 16563 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:19.385412 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.343277 19201 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:19.385839 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.341684 19323 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:19.386089 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.386471 19323 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:19.386629 16483 raft_consensus.cc:2410] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.387316 19323 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.388819 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.389523 16563 raft_consensus.cc:2410] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.294411 19366 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:19.351984 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.390406 19201 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.392107 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.395722 19106 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.395270 16386 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 4, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 4 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.396337 19317 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.396795 19317 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.397146 16386 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 6, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.386641 16484 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:19.398844 19317 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.400574 16486 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:19.294206 16388 rpcz_store.cc:269] 0709 13:07:02.351627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.360243 (+  8616us) service_pool.cc:224] Handling call
0709 13:07:19.293696 (+16933453us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:12.811161 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:12.811805 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:12.811857 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:07:12.811877 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:12.812783 (+   906us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:12.812856 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:12.812879 (+    23us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:12.941484 (+128605us) tablet.cc:701] Row locks acquired
0709 13:07:12.960378 (+ 18894us) write_op.cc:260] PREPARE: finished
0709 13:07:12.991187 (+ 30809us) write_op.cc:270] Start()
0709 13:07:13.049536 (+ 58349us) write_op.cc:276] Timestamp: P: 1783602432981694 usec, L: 0
0709 13:07:13.049564 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:13.117535 (+ 67971us) log.cc:844] Serialized 3545 byte log entry
0709 13:07:13.546947 (+429412us) op_driver.cc:464] REPLICATION: finished
0709 13:07:13.564751 (+ 17804us) write_op.cc:301] APPLY: starting
0709 13:07:13.564873 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:13.565242 (+   369us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:13.565407 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:13.569905 (+  4498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:13.570197 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:07:13.570243 (+    46us) write_op.cc:312] APPLY: finished
0709 13:07:13.570542 (+   299us) log.cc:844] Serialized 71 byte log entry
0709 13:07:13.611884 (+ 41342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:13.619596 (+  7712us) write_op.cc:454] Released schema lock
0709 13:07:13.628921 (+  9325us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:13.653860 (+ 24939us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:13.653889 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3493836,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":17540,"apply.run_cpu_time_us":3541,"apply.run_wall_time_us":89083,"num_ops":9,"prepare.queue_time_us":267367,"prepare.run_cpu_time_us":23532,"prepare.run_wall_time_us":335545,"raft.queue_time_us":28793,"raft.run_cpu_time_us":3200,"raft.run_wall_time_us":20796,"replication_time_us":497190,"thread_start_us":262315,"threads_started":4,"wal-append.queue_time_us":62250,"wal-append.run_cpu_time_us":17424,"wal-append.run_wall_time_us":1391326}]]}
I20260709 13:07:19.403534 16636 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:07:19.390141 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.404280 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:19.370730 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.404877 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.405825 16561 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:19.406266 19357 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:19.406832 16561 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:19.407159 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.407881 16489 raft_consensus.cc:2368] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9.
I20260709 13:07:19.406759 19357 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:19.408751 18924 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:19.409261 18924 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.409322 19357 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.411103 18924 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.411399 16566 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:19.412211 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.412896 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:19.436483 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:19.436611 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 166720us
I20260709 13:07:19.414328 16633 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:19.414721 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.437754 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.438519 16632 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:19.443706 16490 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:19.335317 19186 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.404197 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 1959) took 1420 ms. Trace:
I20260709 13:07:19.416249 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.444891 16487 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.444734 16636 rpcz_store.cc:276] 0709 13:07:17.983621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.045742 (+ 62121us) service_pool.cc:224] Handling call
0709 13:07:18.046013 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.403306 (+1357293us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b54002227a0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648d1c0 00007f063648e231 00007f063648ad8f 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c
0709 13:07:19.403971 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.404149 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15676288}
I20260709 13:07:19.448820 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:19.383059 19306 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.389976 19366 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.419221 19253 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.421698 16605 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:19.422168 19417 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.422976 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:19.424580 16561 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:19.426184 16559 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:19.398730 16386 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 5, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 5 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.478814 16489 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.370734 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:19.479094 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56186.6us
I20260709 13:07:19.434563 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:19.434842 16637 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.435343 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.435426 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:19.481631 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 47138us
I20260709 13:07:19.413378 19282 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:19.337913 16562 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.497057 16562 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.497342 16489 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:19.497699 16489 pending_rounds.cc:85] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 2
I20260709 13:07:19.468220 16634 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:19.470257 16564 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:19.471632 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:19.498980 17185 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:19.473250 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:19.473287 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51668.2us
I20260709 13:07:19.473814 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.500128 16491 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:19.500730 16490 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.501044 16491 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:19.477254 16486 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:07:19.480512 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:19.501485 16486 pending_rounds.cc:85] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 2
I20260709 13:07:19.453311 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.479770 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:19.481166 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.501793 16486 pending_rounds.cc:107] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:07:19.502079 16486 raft_consensus.cc:2889] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.502099 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:19.502310 16559 raft_consensus.cc:2410] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:19.504343 16559 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:19.483063 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:07:19.485695 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 72861.9us
I20260709 13:07:19.457620 16485 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:19.507222 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:19.509845 16566 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:19.497915 16489 pending_rounds.cc:107] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:19.510358 16489 raft_consensus.cc:2889] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.510473 16565 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:19.510350 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.497380 16386 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:19.512025 16557 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.512573 16487 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:19.514219 18342 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.514562 18342 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.514849 18342 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.509564 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:19.512001 16386 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 7, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 7 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.517004 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:19.518478 16484 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.519847 16482 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:07:19.521037 16386 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.522276 18342 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.517968 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:19.496402 19412 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.513s	user 0.000s	sys 0.023s
I20260709 13:07:19.524727 16561 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:19.529199 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.529464 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:19.529949 16486 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:19.530841 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.531493 16491 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:19.533385 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.535646 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.535988 18342 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:19.535712 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.536468 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:19.535367 16561 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:19.466092 19402 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.524567 16455 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:19.526284 16487 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:19.544718 16487 pending_rounds.cc:85] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 4
I20260709 13:07:19.346365 19219 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.178s
I20260709 13:07:19.508524 19338 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.524189 16386 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 4 to 6, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:19.527710 16489 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:19.478260 19225 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.555744 16561 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:19.556149 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.524717 16564 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.515225 18966 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.518152 19289 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:19.508909 19186 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.544179 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.544976 16487 pending_rounds.cc:107] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:19.579569 16487 raft_consensus.cc:2889] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.556293 16482 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:19.558549 16564 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.496577 18868 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.499038 19190 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.545825 16386 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 4, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 4 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.587916 16386 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 2 to 4, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:19.564196 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.564426 16484 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:19.564630 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.567287 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:19.568625 16485 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:19.590945 16485 pending_rounds.cc:85] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 3
I20260709 13:07:19.591187 16485 pending_rounds.cc:107] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:19.591416 16485 raft_consensus.cc:2889] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.547786 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:19.592561 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44834.3us
I20260709 13:07:19.593976 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:19.578045 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.526242 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:19.578981 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.583092 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.536089 19082 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.535669 19272 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.612437 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.607947 16386 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:19.613227 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 46016.6us
I20260709 13:07:19.614066 16386 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 4 to 5, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 5 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:19.555398 19367 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:19.615692 16386 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.595870 16487 raft_consensus.cc:2410] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.617362 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.557658 19338 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:19.564049 19289 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.582988 19186 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.619539 18342 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.579520 19147 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.582330 19417 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.620926 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.619539 16386 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.640033 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:19.619194 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 93012.7us
I20260709 13:07:19.622229 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.624099 19239 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.628393 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.628885 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.629132 16483 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:19.629776 16564 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.639782 16484 raft_consensus.cc:2376] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7. Re-sending same reply.
I20260709 13:07:19.612959 19219 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.640872 16386 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:19.631227 18342 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:19.613956 19082 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.640583 16486 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:19.644975 16489 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:19.644639 18342 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.615379 18966 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:19.650857 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.652365 16491 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:19.652681 19219 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.618887 18732 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.656898 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.621954 19402 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.659662 16634 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:19.660933 16633 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:19.621153 19338 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.629699 19289 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.661566 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.662149 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.662931 16637 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:19.663341 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.663775 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.664419 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:19.632136 19186 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.653474 16386 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 4, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:19.669868 16638 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:19.628018 19243 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:19.639572 19417 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:19.668002 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:19.677737 16634 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.674510 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.618834 19225 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:19.643932 19367 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:19.622730 19334 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:19.621735 19250 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:19.648927 19082 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.685077 16485 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:19.665603 19219 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.694736 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.695437 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.698342 16485 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.651938 19113 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:19.656723 19284 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:07:19.665043 19272 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:19.669039 19319 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:07:19.742949 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.732009 16634 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
W20260709 13:07:19.736486 19421 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:19.745623 16485 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
W20260709 13:07:19.736718 19406 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:19.754419 19417 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.755615 19417 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.757539 16484 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:19.757799 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:19.758348 17185 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:19.757050 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.755771 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 165463us
I20260709 13:07:19.698207 19402 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:19.792724 16485 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.796082 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.796669 16485 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:19.797408 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.798023 16485 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:19.798662 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.799558 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.802313 17185 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:19.803150 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.803630 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:19.803726 16491 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
W20260709 13:07:19.499302 19090 consensus_queue.cc:1175] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "16b5b367990f4b5c862484bdec0b9226" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:19.728820 19201 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.746162 18732 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:19.760192 19306 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 4 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:19.745867 19357 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:19.807425 19367 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:19.812249 19147 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.756794 19098 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 13:07:19.758340 19322 consensus_queue.cc:1175] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "359213375db14f3d874c121993f90d76" responder_term: 8 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.4-7.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:19.813767 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:19.820371 16484 raft_consensus.cc:2410] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:19.753480 19353 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:19.813767 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:19.753181 19415 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:07:19.750082 18966 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.750244 19302 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:07:19.807216 19225 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.822029 16485 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:19.810813 19143 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:19.823081 19098 consensus_queue.cc:1243] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:19.823108 19284 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.837069 19432 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:07:19.830370 19225 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:19.819051 19147 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:19.830709 19250 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:19.868160 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 116100us
W20260709 13:07:19.842458 19433 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:07:19.873293 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:19.830869 19143 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:20.050390 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 373871us
I20260709 13:07:19.871686 19250 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:19.884577 19098 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:20.060041 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 261242us
I20260709 13:07:19.866398 19284 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:20.078985 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 201240us
I20260709 13:07:20.077041 16486 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:20.085544 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 324979us
I20260709 13:07:20.087339 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.091361 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:20.093538 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:20.094228 16639 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:20.095042 19402 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:20.051625 19446 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:20.110107 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 1979) took 1349 ms. Trace:
W20260709 13:07:20.111459 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.117488 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:20.109237 19439 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:07:20.083314 19317 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:20.110497 16558 rpcz_store.cc:276] 0709 13:07:18.760440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.107720 (+347280us) service_pool.cc:224] Handling call
0709 13:07:19.111389 (+  3669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.111703 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:19.240107 (+128404us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.510494 (+270387us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.518494 (+  8000us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.518616 (+   122us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.819300 (+300684us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.819475 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.819951 (+   476us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.109914 (+289963us) raft_consensus.cc:1685] finished
0709 13:07:20.109932 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.110051 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50589,"prepare.queue_time_us":155789,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":30125,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":14122,"thread_start_us":502774,"threads_started":2,"wal-append.queue_time_us":361640}
W20260709 13:07:20.118595 19436 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:07:20.088876 19302 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:20.114364 19106 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.129312 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 73726us
I20260709 13:07:20.136771 16639 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:07:20.102788 19357 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:20.119611 19201 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.121412 19415 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.146862 19454 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.140669 19448 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:07:20.153143 19457 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.157779 19457 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:20.158649 19457 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.159611 19457 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:20.160143 19447 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:07:20.153702 19460 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:20.164804 19143 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.166496 19452 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:20.146457 19106 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.169201 19106 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.156651 19464 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.170436 16639 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:20.180346 16456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.006s
W20260709 13:07:20.180922 16456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.008s	sys 0.006s
I20260709 13:07:20.109514 19225 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.111950 19250 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.187776 19250 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:20.182318 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 536512us
I20260709 13:07:20.144703 19456 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:20.186619 19338 consensus_meta.cc:287] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.508s	user 0.003s	sys 0.004s
I20260709 13:07:20.160173 19459 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.196267 19459 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.197337 19164 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:20.197525 17185 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:20.197919 19338 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.198355 19459 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.180903 19323 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.191833 19463 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:20.193281 19219 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.194865 17153 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.169970 19464 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.196787 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:20.186972 19366 consensus_meta.cc:287] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.000s
I20260709 13:07:20.211330 19368 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:20.200610 19164 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:20.212124 19219 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:20.212813 19164 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.210222 19343 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:20.216192 19343 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:20.216562 19343 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.212159 19368 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.217587 19368 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:20.218374 19368 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.219442 19368 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.199003 19456 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.201643 19147 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.199118 19457 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:20.212085 19338 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.171108 19454 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.216651 19464 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.220647 19106 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.210960 19366 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.231566 19147 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.260018 16563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.001s	sys 0.017s
W20260709 13:07:20.261708 16563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.001s	sys 0.017s
W20260709 13:07:20.262840 16488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.017s	sys 0.030s
W20260709 13:07:20.264253 16488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.017s	sys 0.030s
I20260709 13:07:20.266392 17183 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.247059 19106 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:20.247195 19459 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.268306 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1723) took 1018 ms. Trace:
W20260709 13:07:20.266534 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 175246us
I20260709 13:07:20.280236 16604 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:20.283586 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:20.282392 19417 consensus_meta.cc:287] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.004s
I20260709 13:07:20.288945 16604 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:20.263406 19147 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.286561 19250 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:20.284914 19351 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:07:20.289127 19466 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:07:20.290410 19219 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.291261 19336 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.281996 19459 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.301817 19336 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:20.309620 19454 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.312428 19456 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.312631 19459 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:20.338738 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.340358 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1732) took 1081 ms. Trace:
W20260709 13:07:20.337016 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 181905us
I20260709 13:07:20.341087 16559 rpcz_store.cc:276] 0709 13:07:19.258911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.505656 (+246745us) service_pool.cc:224] Handling call
0709 13:07:19.505890 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.506049 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:19.674548 (+168499us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.339106 (+664558us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.339571 (+   465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.339656 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.339810 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.339919 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.340131 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48903,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":26207,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":801565,"threads_started":3,"wal-append.queue_time_us":517854}
I20260709 13:07:20.343536 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:20.349264 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.349126 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:20.297806 18872 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.356755 18872 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.357904 18872 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.361123 18872 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.292896 19106 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.378485 19106 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:20.385619 19082 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.010s
I20260709 13:07:20.366178 19147 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.308638 19366 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.374993 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.396117 19082 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:20.398648 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 109614us
I20260709 13:07:20.364446 19243 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:20.375836 19336 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.399328 19082 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.400364 19351 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:20.389128 19367 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.394188 19186 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.006s
I20260709 13:07:20.400755 19336 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.399386 19243 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.432369 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.433323 16557 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
W20260709 13:07:20.435683 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 86720.4us
I20260709 13:07:20.436813 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.438488 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:20.438602 19106 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.439347 19147 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.426314 19351 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:20.439536 19106 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.440410 19106 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:20.440964 19351 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:20.442468 19462 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:07:20.442735 19472 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:20.441689 19106 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.427454 19186 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.445113 16490 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:20.445998 19186 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.427974 19243 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.450084 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:20.455839 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.463855 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:20.468081 19466 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:20.469358 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 69575.1us
I20260709 13:07:20.471212 16604 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:20.472563 19289 consensus_meta.cc:287] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.794s	user 0.009s	sys 0.009s
I20260709 13:07:20.473099 19289 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.474378 16487 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.476048 16562 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:20.480180 19289 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.492615 19343 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.496397 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:20.497089 16637 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:20.498167 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:20.476318 19367 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.499781 19343 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.500762 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 294) took 1388 ms. Trace:
I20260709 13:07:20.501209 16562 rpcz_store.cc:276] 0709 13:07:19.112545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.241794 (+129249us) service_pool.cc:224] Handling call
0709 13:07:19.242022 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.337577 (+ 95555us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b4c00013940. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634757a20 00007f0634768a29 00007f063472e644 00007f0634755f2d 00007f0634755b93 00007f063648618b 00007f0636486cb5 00007f0636481f30 00007f06364837de 00007f063648db49 00007f063648e416
0709 13:07:20.475563 (+1137986us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54003cba20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648dd87 00007f063648e470 00007f063648ad8f 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c
0709 13:07:20.476503 (+   940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.500655 (+ 24152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649790464}
I20260709 13:07:20.492491 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:20.504926 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.500355 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:20.509078 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.513859 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:20.505683 19082 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:20.517743 19323 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.521052 19243 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.522635 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:20.523941 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:20.524917 16633 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:20.517138 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:20.528359 16638 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:20.523330 19243 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:20.544754 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.532867 19367 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.548764 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:20.551527 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:20.554625 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.555361 19466 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.563328 19322 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.563560 19466 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.564129 19322 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.572001 19106 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.572502 19106 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.572935 19106 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.573050 18732 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:20.574941 18732 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:20.576181 18732 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.577893 18732 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.575003 19466 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:20.582942 16638 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:20.594997 19412 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.914s	user 0.010s	sys 0.000s
I20260709 13:07:20.602902 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:20.604467 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1748) took 1072 ms. Trace:
I20260709 13:07:20.604888 16490 rpcz_store.cc:276] 0709 13:07:19.532381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.533158 (+   777us) service_pool.cc:224] Handling call
0709 13:07:20.604207 (+1071049us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54002d6754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:20.604359 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094638464}
I20260709 13:07:20.605756 16485 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:20.608464 19322 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.609516 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 286) took 2264 ms. Trace:
I20260709 13:07:20.609889 16560 rpcz_store.cc:276] 0709 13:07:18.345050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.679721 (+334671us) service_pool.cc:224] Handling call
0709 13:07:18.680079 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:18.686639 (+  6560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.686667 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:18.695260 (+  8593us) log.cc:844] Serialized 52 byte log entry
0709 13:07:18.858340 (+163080us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:18.879526 (+ 21186us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.890620 (+ 11094us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.890934 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.891022 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.903410 (+ 12388us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b180047f4a0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e522 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:19.393508 (+490098us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:20.594374 (+1200866us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b240027e678. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332249c4 00007f0633222acb 00007f06333dddc9 00007f06333dda55 00007f06333dd09d 00007f063600f10e 00007f063602688c 00007f0636025bb6 00007f06360257d8 00007f063602f221
0709 13:07:20.609157 (+ 14783us) raft_consensus.cc:1685] finished
0709 13:07:20.609182 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.609357 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19248,"prepare.queue_time_us":68015,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":10283,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":44893,"spinlock_wait_cycles":16223872,"thread_start_us":120150,"threads_started":1,"wal-append.queue_time_us":212519}
I20260709 13:07:20.616940 19164 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.618268 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:20.623032 16638 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:20.624367 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:20.625195 16490 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:20.625066 16489 raft_consensus.cc:1217] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[4.2-6.3]   Dedup: 4.2->[6.3-6.3]
I20260709 13:07:20.625698 16489 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:07:20.626192 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:20.627053 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:20.627091 16490 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.631036 19314 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.633630 19239 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.634014 19239 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:20.635159 19239 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.637101 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:20.637347 16640 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:20.637768 16633 raft_consensus.cc:2368] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7.
I20260709 13:07:20.638667 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:20.639420 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:20.639633 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:20.643774 19284 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.644483 19288 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.644992 19341 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.645349 19343 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:20.645571 19367 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.646008 19343 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.646153 19367 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.646317 19336 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:20.647578 19336 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.647966 19336 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:20.648108 19343 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.645074 19288 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.649024 19336 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.650038 19336 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.651288 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.651623 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.650602 19288 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:20.652454 16558 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:20.653121 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:20.653942 16489 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:20.655021 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:20.637564 16490 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:20.636238 19239 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.652688 16562 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:20.657795 16637 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:20.657495 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.659076 16558 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:07:20.658991 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:20.669072 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.662418 19402 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.670065 16566 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:20.670547 19402 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.671025 19402 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:20.661950 19451 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.542s	user 0.000s	sys 0.003s
I20260709 13:07:20.669394 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:20.674244 16490 raft_consensus.cc:2376] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9. Re-sending same reply.
I20260709 13:07:20.659065 19341 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:07:20.665442 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 47370.7us
I20260709 13:07:20.675565 19341 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.673298 19253 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:07:20.677086 19341 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.680184 19367 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.655767 16489 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
W20260709 13:07:20.684688 16530 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.030s	sys 0.016s
W20260709 13:07:20.685067 16530 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.030s	sys 0.016s
W20260709 13:07:20.685535 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 591580us
I20260709 13:07:20.691147 19360 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.691551 19360 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:20.692523 19360 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.702672 19402 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.703109 16638 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:20.706175 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.706470 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:20.707441 19402 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.711232 19353 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.2, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:20.711999 19353 consensus_queue.cc:1243] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:20.712859 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.713511 16557 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:20.714023 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:20.714380 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.710459 19322 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.715744 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:20.716342 16565 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.710280 16604 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:20.710264 19302 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:20.724032 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.728533 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.735978 19452 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:20.736500 19452 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:20.737394 19452 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.738209 19469 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:20.738794 19469 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.740300 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:20.740928 19469 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.742349 19469 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:20.742909 19469 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.744374 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:20.744951 16558 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.745379 19469 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:20.746196 16489 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:20.749996 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:20.750634 16564 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.755026 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 579) took 1423 ms. Trace:
I20260709 13:07:20.755532 17183 rpcz_store.cc:276] 0709 13:07:19.331433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.331547 (+   114us) service_pool.cc:224] Handling call
0709 13:07:19.331812 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.266785 (+934973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.754554 (+487769us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b5400415ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:20.754825 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148999936}
I20260709 13:07:20.728351 19360 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.740868 16561 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:07:20.781234 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 60821.5us
W20260709 13:07:20.786748 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 76508.7us
I20260709 13:07:20.789247 16559 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:20.735512 19106 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.802802 16489 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:20.802690 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:20.804041 16633 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.791013 19466 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.807274 16566 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.811648 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.820072 16489 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:20.823352 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 328) took 1148 ms. Trace:
I20260709 13:07:20.823751 16486 rpcz_store.cc:276] 0709 13:07:19.644758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.645882 (+  1124us) service_pool.cc:224] Handling call
0709 13:07:19.646114 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.080417 (+434303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.758055 (+677638us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54000e8154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:20.793468 (+ 35413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990659968}
I20260709 13:07:20.825438 16486 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:20.827652 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.828974 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:20.829706 18868 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.830355 19289 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:20.830793 19289 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.831166 19289 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.830266 18868 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.833556 18868 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:20.839999 19289 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:20.842175 19289 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:20.852160 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 146169us
W20260709 13:07:20.854210 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.791245 19336 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:20.855921 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 68312.9us
I20260709 13:07:20.830238 19476 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.861302 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:20.866166 16489 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:20.864800 16557 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:20.874285 19353 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:20.874696 19353 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.875013 19353 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.884138 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:20.875046 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.896404 16558 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:20.894088 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.900027 16561 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:20.900691 16566 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:20.874960 19306 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.907402 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:20.909744 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 62602.1us
I20260709 13:07:20.911162 16561 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:20.866652 19466 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:20.913614 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:20.914148 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:20.921576 16565 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:20.915035 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:20.925922 16557 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:20.920481 16566 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:20.911849 19306 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:20.946897 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:20.956116 16561 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:20.956223 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.961169 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 93217us
I20260709 13:07:20.954115 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 469) took 1571 ms. Trace:
W20260709 13:07:20.961804 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 48596.6us
I20260709 13:07:20.951198 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:20.954037 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:20.960171 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:20.967422 17186 rpcz_store.cc:276] 0709 13:07:19.343425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.343872 (+   447us) service_pool.cc:224] Handling call
0709 13:07:19.344187 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.344517 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.344542 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.344966 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.525103 (+180137us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.671128 (+146025us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.672675 (+  1547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.672800 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.840470 (+1167670us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180045c580. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:20.843772 (+  3302us) raft_consensus.cc:1685] finished
0709 13:07:20.885169 (+ 41397us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.915120 (+ 29951us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":299281,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":6373,"raft.queue_time_us":2487,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3848,"spinlock_wait_cycles":23921920,"thread_start_us":320213,"threads_started":2,"wal-append.queue_time_us":333143}
I20260709 13:07:20.971480 16566 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:20.945660 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:21.018172 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.044795 16558 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:21.031546 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 57073.5us
I20260709 13:07:21.041092 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.022065 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:21.053925 16566 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:21.053941 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.055346 19239 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:20.955412 19323 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:07:20.951726 19306 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.055888 19239 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.056747 19306 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.058053 19239 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.059536 16558 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:21.069835 19090 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:21.070426 19090 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:20.278430 16563 rpcz_store.cc:276] 0709 13:07:19.249543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.436621 (+187078us) service_pool.cc:224] Handling call
0709 13:07:19.514502 (+ 77881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.514679 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:19.697063 (+182384us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.267979 (+570916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.268026 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.268065 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.268127 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.268240 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10780,"prepare.queue_time_us":48652,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":5804,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7788,"thread_start_us":718644,"threads_started":2}
I20260709 13:07:21.072477 19090 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.074151 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1763) took 1430 ms. Trace:
I20260709 13:07:21.074528 16487 rpcz_store.cc:276] 0709 13:07:19.644062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.645222 (+  1160us) service_pool.cc:224] Handling call
0709 13:07:19.645484 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.474790 (+829306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.073892 (+599102us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400289454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:21.074082 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905506176}
W20260709 13:07:21.075439 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 85104.2us
I20260709 13:07:21.080863 16633 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:21.045490 19302 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.027989 19343 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:20.953583 18818 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:21.047082 19106 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.085307 19306 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:21.088601 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:21.092360 16635 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.090947 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.019557 19469 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:21.095340 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:21.103376 16564 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:20.959734 19353 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.105458 16559 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:07:21.106634 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 83337.4us
I20260709 13:07:20.955344 19319 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:07:21.045228 19476 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:07:21.052407 19336 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:21.117162 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:21.118877 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.116267 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.039741 19466 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.099773 19289 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.112705 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:21.110363 19302 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.132213 19351 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:21.129783 19106 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:21.179117 19106 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:21.172657 19243 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:07:21.176410 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 216363us
I20260709 13:07:21.185317 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.172478 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:21.186668 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.188024 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.173655 16633 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:21.191838 19098 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:21.175999 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 60474us
I20260709 13:07:21.192418 19098 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.193487 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.194381 19098 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:21.172930 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 88384.2us
I20260709 13:07:21.195225 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:21.195369 16634 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:21.111935 18818 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.111343 19164 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.130821 16639 raft_consensus.cc:2410] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:21.155649 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.111572 19090 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.194952 19098 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.113610 19367 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:07:21.248790 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.273304 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 78170.6us
I20260709 13:07:21.251734 16635 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:21.113067 19343 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.192020 19476 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.276729 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.203558 19341 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.246915 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:21.224279 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.284698 17186 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:21.271929 17184 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.175446 19353 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.111292 19306 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.132491 19239 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.283267 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:21.283638 17185 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:21.183430 18732 consensus_meta.cc:287] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.005s
I20260709 13:07:21.116590 19253 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.164s
W20260709 13:07:21.307987 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61329.2us
I20260709 13:07:21.128242 19469 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:21.313692 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 59444.7us
I20260709 13:07:21.280164 19476 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.281396 19284 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:21.280730 19302 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.268888 19243 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:07:21.328038 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.332877 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.287484 19164 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.314801 19186 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.334829 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.341153 17181 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:21.335632 19476 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:21.348928 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 162406us
I20260709 13:07:21.333544 18732 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.301138 19106 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:21.345458 19360 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.007s
W20260709 13:07:21.355820 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 81845.4us
I20260709 13:07:21.357309 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:21.362102 16560 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.354661 17187 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.334239 18818 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.339589 19147 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:21.339231 19341 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.355125 17186 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:21.349496 19243 consensus_queue.cc:1243] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:21.388267 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:21.389153 17188 raft_consensus.cc:2410] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:21.367688 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:21.368965 19367 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:21.391525 19367 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.393554 19367 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:21.373675 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:21.374744 19496 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:07:21.399992 16529 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:07:21.375576 19493 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:07:21.376292 19502 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:21.383903 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:21.418246 16563 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.398968 16560 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:21.411878 17184 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:21.413868 19476 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.388149 19322 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.393508 19239 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:21.455971 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.456555 17188 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:21.460059 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.399746 19360 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:07:21.466744 19512 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.467444 17184 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:21.452095 19322 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:21.402554 19323 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:07:21.457297 19239 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.469707 19504 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:21.467028 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.455806 19353 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:21.489751 17185 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
W20260709 13:07:21.473009 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 142186us
I20260709 13:07:21.494937 17183 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:21.502771 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:21.519112 19465 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.697s	user 0.000s	sys 0.004s
I20260709 13:07:21.520020 19343 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:21.520435 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.521849 19164 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.522377 19164 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:21.523908 19513 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:21.524677 17184 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.501579 19302 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:21.501740 19353 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.494091 19512 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.528769 19353 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.529678 19512 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.530249 19512 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:21.531263 19512 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:21.463011 19147 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.537120 19164 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.537768 19164 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.538267 19476 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.539368 19510 consensus_queue.cc:1059] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.540506 19164 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.541414 19505 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.541951 19322 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.508073 19504 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.547976 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.548779 17183 raft_consensus.cc:2410] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:21.544032 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:21.531596 19512 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:21.550119 16563 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:21.553157 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.537109 19090 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:21.540469 19510 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:21.541324 19469 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.557447 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.558282 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.537294 19147 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.560667 17188 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 5: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:21.551298 19476 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:21.551591 19164 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.553858 19512 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.556679 19510 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:21.555989 19090 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:21.563265 19322 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.559206 19341 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:21.566532 19186 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:21.589072 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.582583 19284 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:21.590929 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.593076 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.574222 19090 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.572867 19476 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:21.596812 16637 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:21.582864 18868 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.627477 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:21.628458 17184 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:21.630698 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 257097us
I20260709 13:07:21.630837 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:21.631505 19516 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.647769 17187 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:21.643690 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.652338 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:21.654654 17187 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:21.651567 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 108853us
W20260709 13:07:21.643127 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 240466us
I20260709 13:07:21.650627 19106 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.643615 19515 raft_consensus.cc:3055] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.673667 17184 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:21.665855 16632 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:21.678539 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.682019 17188 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:07:21.682339 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.683308 17188 pending_rounds.cc:85] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 6
W20260709 13:07:21.691609 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.715405 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.716058 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 45971us
I20260709 13:07:21.716784 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:21.703550 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:21.717638 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61012.5us
I20260709 13:07:21.664438 19106 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.719223 16560 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:21.722421 17187 raft_consensus.cc:2410] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:21.723661 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.683597 17188 pending_rounds.cc:107] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:07:21.725596 17188 raft_consensus.cc:2889] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.729547 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.679561 19515 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:21.722920 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:21.735896 16562 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.740065 16558 raft_consensus.cc:1217] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-9.5]   Dedup: 5.3->[7.4-9.5]
I20260709 13:07:21.736793 16563 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:21.727656 19106 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.740542 16558 pending_rounds.cc:85] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 3
I20260709 13:07:21.759047 16558 pending_rounds.cc:107] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:21.759310 16558 raft_consensus.cc:2889] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.752295 17152 leader_election.cc:400] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7.
I20260709 13:07:21.759780 17152 leader_election.cc:403] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:07:21.761550 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44865.4us
I20260709 13:07:21.763016 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:21.764968 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.664729 19186 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.678370 19341 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.678161 19516 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.649389 19510 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.750324 19504 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:21.779659 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 135170us
I20260709 13:07:21.682569 19284 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.779579 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.775950 19531 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.727155 19476 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.773617 19343 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7.
I20260709 13:07:21.796512 19459 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.796701 16561 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:21.797600 19522 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:21.787250 19466 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:21.804431 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.782229 19519 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.806545 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.806982 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.813431 19302 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.796854 19525 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:21.820542 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.821265 16566 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:21.809275 19367 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.815173 19459 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.779965 19533 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:21.830966 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 68008.2us
I20260709 13:07:21.781858 19353 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:21.832602 16563 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
W20260709 13:07:21.834865 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 55371.1us
I20260709 13:07:21.835575 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.833668 19113 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.802394 19515 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.839882 19113 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.840538 19515 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.809634 19531 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.841666 19524 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.842743 19519 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:21.843539 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.843765 19519 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.836920 19525 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:21.845480 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.846804 19529 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:21.848112 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1767) took 1245 ms. Trace:
I20260709 13:07:21.848030 19532 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:21.840469 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 54649us
I20260709 13:07:21.849143 19113 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:21.849802 19498 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.675s	user 0.004s	sys 0.000s
I20260709 13:07:21.851049 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2023) took 1056 ms. Trace:
W20260709 13:07:21.848577 19528 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:21.851915 19466 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.854115 19466 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.855188 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.855978 19459 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.855933 19147 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.856698 19147 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.857028 19147 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.827574 19351 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.869275 16561 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:21.870018 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.870260 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.851393 16640 rpcz_store.cc:276] 0709 13:07:20.794914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.795022 (+   108us) service_pool.cc:224] Handling call
0709 13:07:20.813384 (+ 18362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.826607 (+ 13223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.826642 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.827140 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.950885 (+123745us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:20.950933 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.964079 (+ 13146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.782018 (+817939us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:21.850768 (+ 68750us) raft_consensus.cc:1685] finished
0709 13:07:21.850790 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.850974 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12743,"raft.queue_time_us":13943,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"spinlock_wait_cycles":55173504,"thread_start_us":123387,"threads_started":1,"wal-append.queue_time_us":301353}
I20260709 13:07:21.872772 19343 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.831283 19302 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.871675 19336 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.901224 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.901854 16632 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
W20260709 13:07:21.905208 19500 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.583s	user 0.000s	sys 0.004s
I20260709 13:07:21.871861 19351 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.848497 16483 rpcz_store.cc:276] 0709 13:07:20.602503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.604195 (+  1692us) service_pool.cc:224] Handling call
0709 13:07:20.604608 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.629942 (+ 25334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.629969 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.630549 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.394720 (+764171us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b18002ec120. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:07:21.566704 (+171984us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:21.570557 (+  3853us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.582054 (+ 11497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.582120 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.775684 (+193564us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b48001a0658. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
0709 13:07:21.847833 (+ 72149us) raft_consensus.cc:1685] finished
0709 13:07:21.847852 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.847963 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53030,"prepare.queue_time_us":3715,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":6013,"raft.queue_time_us":36617,"raft.run_cpu_time_us":3617,"raft.run_wall_time_us":1150590,"spinlock_wait_cycles":172468864,"thread_start_us":171821,"threads_started":1,"wal-append.queue_time_us":1013241}
I20260709 13:07:21.914511 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.887163 19343 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.888862 19525 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.891067 19516 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.875187 19367 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.884440 19253 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:21.892727 19341 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:21.893309 19302 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:21.894892 19538 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:07:21.895629 19527 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:21.886895 16562 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:21.968477 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:21.969112 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.919931 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.910219 19319 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:07:21.918315 19531 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.923319 19239 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.924134 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.927270 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:21.974982 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:21.928133 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.928767 19524 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.980227 19524 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:21.980636 19524 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.980916 19476 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.981474 19476 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.982575 19090 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.983480 19476 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:21.985276 16562 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:21.929113 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:21.931001 19530 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:07:21.936993 19306 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:21.943770 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:21.974004 16636 raft_consensus.cc:2410] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:21.974514 19265 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.977757 19469 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.978210 19525 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.979804 19289 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.916759 19336 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:07:21.929282 19351 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:21.967120 19341 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:21.931339 19343 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:21.987167 19090 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.020387 19289 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.020063 19265 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.021407 19525 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.023288 19525 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.023768 19265 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.024555 19106 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.025002 19341 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:21.988967 19541 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:07:21.989423 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:21.989815 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:21.990087 16483 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:21.991482 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:21.923593 19147 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:21.991777 19517 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.003644 16640 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.985605 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:21.992760 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.029393 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.001557 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.036134 16482 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.993431 16490 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.037259 16636 raft_consensus.cc:2410] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:22.001173 16637 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.037773 16559 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:22.036733 16639 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
W20260709 13:07:22.003123 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75952.3us
I20260709 13:07:22.040905 16484 raft_consensus.cc:2368] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:22.036458 16487 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:21.996542 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.042691 16565 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:22.043642 16489 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:21.992767 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.046271 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.044531 16485 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:22.003434 19460 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.051330 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:22.050609 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 175962us
W20260709 13:07:22.000699 19543 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:22.020792 19289 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.992185 19459 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.994427 19319 consensus_queue.cc:1243] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:22.002624 19239 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:22.037401 19452 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.030134 19468 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.999533 19532 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.052253 16635 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.026492 19106 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.068500 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.069581 16565 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:21.990151 19523 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:22.072258 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:22.074945 16559 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.081825 16483 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:22.040844 19512 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.047959 19469 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.072695 19515 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.097311 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.108161 16637 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:22.095134 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.108965 16634 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:22.101432 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:22.111073 16559 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:22.113930 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.116611 16635 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:22.117450 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.084409 19239 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:22.120011 16565 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:22.051023 19517 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.068715 19459 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.123085 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.121995 17152 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:22.094334 19466 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.128039 19466 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:22.127130 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.127422 16488 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:22.134660 19547 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.135066 19547 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:22.135425 19547 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.135783 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.136173 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:22.136528 17179 raft_consensus.cc:2410] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:22.137168 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:22.142037 16482 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:22.143285 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.075225 19452 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.145478 16488 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
W20260709 13:07:22.127745 16454 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.4:44223 timed out after 1.797s (SENT) [suppressed 19 similar messages]
I20260709 13:07:22.147409 17188 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.151206 16491 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:22.158070 19551 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.158655 19521 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.158576 19551 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.159169 19521 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.086861 19468 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.161325 19521 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.163802 19147 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.164420 19343 raft_consensus.cc:2764] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:22.144938 19336 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:22.164999 18818 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:22.167992 18818 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.102733 19523 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.170064 18818 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.171509 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.172091 19523 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.172577 18818 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.174052 19459 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.175573 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.176231 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.180172 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:22.183516 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.124810 19239 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.185708 16559 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:22.200736 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61701.9us
I20260709 13:07:22.205163 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.206099 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:22.208052 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.209028 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.209676 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:22.211987 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 132310us
I20260709 13:07:22.212707 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.213388 16566 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:22.210965 19147 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:22.166296 19469 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.214859 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.177897 19289 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.215392 19472 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.220378 19147 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:22.220646 19558 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:22.221009 19289 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.221556 19147 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.225494 16604 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:22.226140 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.226856 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:22.169978 19524 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.229112 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:22.200980 19459 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:22.230551 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.231248 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.232571 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.232962 16604 leader_election.cc:400] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:22.233264 16604 leader_election.cc:403] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.235163 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:22.236544 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.237210 16557 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:22.240192 19186 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:22.240758 19186 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:22.241428 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.241820 19336 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:22.242090 19514 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:22.230084 19306 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.235836 19504 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.243213 19504 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.223759 19098 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.243602 19504 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:22.251526 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.253914 16565 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:22.229523 19533 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:07:22.243427 19550 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:22.235205 19517 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.234098 18732 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.238596 19516 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.259493 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.234234 19531 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.238834 19351 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.264919 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.265064 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:22.242676 19306 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.239342 19513 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:07:22.261730 19225 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.274856 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.275821 17188 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:22.277297 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:22.265836 18732 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.268579 19516 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.256554 19459 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.269469 19512 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.292073 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.290397 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.260831 19353 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:22.268944 19531 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:22.295440 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.241719 19186 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.292125 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:22.293346 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58728.2us
I20260709 13:07:22.279500 19536 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:22.272632 19319 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:07:22.268837 19336 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.304513 17181 raft_consensus.cc:2410] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:22.287766 18732 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.304342 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.287276 19351 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.291211 19516 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.313382 19539 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:22.314061 19534 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.236s	user 0.003s	sys 0.000s
I20260709 13:07:22.342772 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:22.316778 19524 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.297325 19531 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.342386 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.317302 19509 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.344760 16482 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:22.344774 17186 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:22.340698 19539 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.345691 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 76361.8us
I20260709 13:07:22.346669 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.354492 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:22.354713 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 232779us
W20260709 13:07:22.355899 19557 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:22.356371 18818 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.357609 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.358356 16484 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:22.359043 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:22.359225 19558 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.359679 19558 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.360639 19459 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.360796 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.338375 19536 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.359648 16484 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:22.345654 19551 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.350615 19539 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.365010 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:22.375737 16491 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.345592 19509 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:22.343513 19564 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:22.351751 19239 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:22.376572 19558 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:22.406572 19554 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:07:22.407972 19569 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.408131 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.408138 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.405844 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.410282 16482 raft_consensus.cc:2410] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:22.408939 16486 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:22.381599 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:22.431442 16484 raft_consensus.cc:2368] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:22.405814 19560 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:07:22.433851 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.434878 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.436489 19147 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.437131 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.437861 19147 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.439324 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.408610 19536 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.444299 19147 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.434715 19572 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:07:22.435714 19509 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.449455 18818 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:22.449956 18818 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.451853 18818 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.454084 19468 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.455909 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:22.456435 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.457559 18818 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:22.458045 18818 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.460109 19540 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.460534 19540 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.460870 19540 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.462406 18818 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.463450 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.464140 16488 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:22.464334 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.464885 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.465373 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.466197 16488 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:22.466657 16482 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:22.470626 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.478708 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:22.483178 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.446552 19351 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:22.472767 19147 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.467602 19531 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.481034 19570 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:22.481503 19560 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:22.405709 19563 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.189s
W20260709 13:07:22.499377 19555 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:07:22.498750 19561 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.482663 19306 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:22.547960 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.548480 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 63503.2us
W20260709 13:07:22.544133 19568 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.131s	user 0.004s	sys 0.000s
I20260709 13:07:22.551092 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.471839 19547 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:22.542307 19519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.008s	sys 0.003s
I20260709 13:07:22.561734 16454 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.550362 19459 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.566751 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.557456 19336 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.552662 19243 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:22.558651 19323 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:22.559111 19519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.008s	sys 0.003s
I20260709 13:07:22.562611 19558 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.582302 18973 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:22.609589 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 266886us
I20260709 13:07:22.612015 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:22.565761 19289 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.569643 19524 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:22.579026 19243 consensus_queue.cc:1243] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:22.562994 19164 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:22.611407 19532 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.646291 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.635771 19082 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.648159 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:22.649039 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.649570 16559 raft_consensus.cc:2410] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:22.581864 19323 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:22.652645 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.654305 16559 raft_consensus.cc:2410] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:22.616730 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:22.636422 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 157782us
I20260709 13:07:22.657318 17152 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:22.572228 19459 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.663527 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:22.663905 19574 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:07:22.665810 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 99143.4us
I20260709 13:07:22.667630 16559 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:22.669795 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 53150.2us
I20260709 13:07:22.639230 19524 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.673406 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:22.638441 18732 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.677366 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:22.673810 19565 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.083s	user 0.005s	sys 0.000s
W20260709 13:07:22.684441 19515 consensus_meta.cc:287] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.005s
I20260709 13:07:22.684242 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:22.653939 19539 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.686439 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.686581 16484 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:22.686965 16484 pending_rounds.cc:85] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 6
I20260709 13:07:22.677501 19564 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.687495 16484 pending_rounds.cc:107] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:22.688298 19512 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.693836 19564 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.694278 19564 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.693900 16484 raft_consensus.cc:2889] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.689057 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.691206 19524 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.692142 19583 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.611228 19351 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.699083 19547 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.699726 19552 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.685226 19532 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.702715 19510 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.681182 19306 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.704327 19306 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.704743 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.705893 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.706198 19306 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:22.706437 16557 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:22.707512 19539 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.687019 16639 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:22.705657 19540 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.710744 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.677891 18818 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.713798 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:22.716212 16530 leader_election.cc:400] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:22.716506 16530 leader_election.cc:403] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.717028 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.711601 16491 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:22.683594 19531 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.707512 16557 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:07:22.719249 19459 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.708995 19579 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:22.720120 19579 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:22.722374 19579 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.723834 19504 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.725651 19082 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.726099 19082 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.726469 19082 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.725831 19504 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:22.727804 19323 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.728945 19323 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.725780 19466 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:22.729946 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:22.731894 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:22.734344 19540 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.685775 19515 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.736532 19540 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.737057 19540 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.732510 16557 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.738898 19540 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.700443 18732 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.744990 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.745482 19558 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.745568 16558 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:22.746214 18732 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.746661 18732 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.750174 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.756352 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:22.750905 16488 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:22.758948 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:22.759439 16488 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.764716 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:22.765244 16482 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.768663 19587 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:22.769326 19466 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.769155 19587 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.771150 19587 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:22.771217 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:22.748564 19515 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.774438 19306 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.774818 19306 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.775123 19306 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.777096 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.777720 16490 raft_consensus.cc:2368] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:22.760775 19563 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:07:22.781900 19466 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.782316 19466 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.769565 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.791774 16485 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:22.792275 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.793181 16604 leader_election.cc:400] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:22.793491 16604 leader_election.cc:403] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.794240 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:22.760010 19577 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
W20260709 13:07:22.795044 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44126.6us
I20260709 13:07:22.800565 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:22.797243 16482 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:22.794970 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.798695 19567 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:22.804014 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.803896 19567 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.804855 19367 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.805258 19367 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.805599 19367 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.806030 19567 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:22.806799 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:22.771629 19587 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:22.808579 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.807930 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.810889 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.828838 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:22.811038 16635 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:22.783669 19452 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:22.813781 19571 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.814478 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:22.815831 19531 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.817942 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.820423 19289 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:22.821796 19535 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.963s	user 0.004s	sys 0.000s
I20260709 13:07:22.825446 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:22.838526 16483 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:22.827368 16489 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:22.829392 16640 raft_consensus.cc:2368] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
W20260709 13:07:22.830150 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 67021.5us
W20260709 13:07:22.830608 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.840137 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 47375.7us
I20260709 13:07:22.831094 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.832126 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.833796 17184 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:22.841269 17184 pending_rounds.cc:85] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 6
I20260709 13:07:22.841521 17184 pending_rounds.cc:107] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:22.841741 17184 raft_consensus.cc:2889] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.842173 16563 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:22.837751 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.842341 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:22.842638 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:22.842731 16634 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:22.843019 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.787441 19306 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.843252 17179 raft_consensus.cc:2376] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6. Re-sending same reply.
I20260709 13:07:22.847707 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:22.840921 17188 raft_consensus.cc:2376] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7. Re-sending same reply.
I20260709 13:07:22.858702 16557 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:22.860249 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:22.860872 16558 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.837751 19587 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.762534 19561 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:23.769308 19561 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.770452 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:23.770845 19587 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:23.771258 17188 raft_consensus.cc:2410] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:07:23.436400 16562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.020s	sys 0.096s
I20260709 13:07:22.902758 19466 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:22.846796 19469 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.771363 19561 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:22.984114 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:23.081578 16490 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:23.796273 16561 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.773694 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:23.479218 19589 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.856273 19589 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.858108 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:23.858431 19589 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:23.097476 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.860378 16637 raft_consensus.cc:2410] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:23.861433 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:23.862563 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.863624 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:23.506783 19531 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.000s
I20260709 13:07:22.901917 19306 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.083742 16565 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:23.322579 19567 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.777525 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:23.866994 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2071) took 1073 ms. Trace:
I20260709 13:07:22.903162 19571 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.434659 19515 consensus_meta.cc:287] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.661s	user 0.005s	sys 0.001s
I20260709 13:07:23.778324 19260 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:23.082508 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:22.849925 19351 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.070535 19524 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:22.906944 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:23.032341 19575 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:23.228163 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.911980 17181 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:22.906010 16488 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:22.863211 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:23.874143 17181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 505) took 1045 ms. Trace:
I20260709 13:07:23.783022 16631 raft_consensus.cc:2368] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:23.782505 19469 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.874293 17179 pending_rounds.cc:85] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 5
I20260709 13:07:23.874329 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1811) took 1118 ms. Trace:
I20260709 13:07:23.874516 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 512) took 1027 ms. Trace:
I20260709 13:07:23.875044 17179 pending_rounds.cc:107] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:07:22.900341 19532 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.875442 17184 rpcz_store.cc:276] 0709 13:07:22.847335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.847433 (+    98us) service_pool.cc:224] Handling call
0709 13:07:23.874464 (+1027031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.167464 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.064213 16558 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:23.039824 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.016708 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:22.907086 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2032) took 1318 ms. Trace:
I20260709 13:07:23.026255 19147 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.878142 19351 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.875910 19571 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.773347 19561 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.910306 19516 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:07:23.230162 19343 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.907842 19564 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.178855 19082 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:23.843258 19510 consensus_meta.cc:287] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 1.140s	user 0.001s	sys 0.012s
I20260709 13:07:22.863816 18818 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.861424 19521 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.973s
I20260709 13:07:22.897552 19353 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:22.846899 19452 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.987s
I20260709 13:07:23.288125 19536 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.897773 19585 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.984s
I20260709 13:07:22.986501 19367 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.088099 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:23.865095 16557 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:23.865370 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:23.878894 19524 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.870513 16560 raft_consensus.cc:2410] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:07:23.871567 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 94112.6us
I20260709 13:07:22.911087 16633 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:23.875703 17179 raft_consensus.cc:2889] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.874594 17181 rpcz_store.cc:276] 0709 13:07:22.828526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.828632 (+   106us) service_pool.cc:224] Handling call
0709 13:07:23.874093 (+1045461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.870359 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:23.903393 16566 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:23.904654 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2075) took 1109 ms. Trace:
I20260709 13:07:23.905035 16560 rpcz_store.cc:276] 0709 13:07:22.794880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.082257 (+287377us) service_pool.cc:224] Handling call
0709 13:07:23.904594 (+822337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.875253 16488 rpcz_store.cc:276] 0709 13:07:22.755466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.758753 (+  3287us) service_pool.cc:224] Handling call
0709 13:07:23.874264 (+1115511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.863085 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:23.877931 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2072) took 1083 ms. Trace:
I20260709 13:07:23.877465 16632 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:23.876832 19532 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.910092 16636 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:23.906369 16558 rpcz_store.cc:276] 0709 13:07:22.794220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.839915 (+ 45695us) service_pool.cc:224] Handling call
0709 13:07:23.877872 (+1037957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.868247 19531 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7.
I20260709 13:07:23.882211 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1191) took 1019 ms. Trace:
W20260709 13:07:23.772214 16562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.029s	sys 0.110s
I20260709 13:07:23.868432 19567 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:23.885277 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.875859 19515 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:23.888753 16639 raft_consensus.cc:2368] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10.
I20260709 13:07:23.888901 19353 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:23.892408 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.879487 16638 rpcz_store.cc:276] 0709 13:07:21.588257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.588361 (+   104us) service_pool.cc:224] Handling call
0709 13:07:21.594725 (+  6364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.632135 (+ 37410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.632165 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.643704 (+ 11539us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.778011 (+134307us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:21.778373 (+   362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.778441 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.821215 (+1042774us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:22.906791 (+ 85576us) raft_consensus.cc:1685] finished
0709 13:07:22.906812 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.907024 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3999,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6934,"spinlock_wait_cycles":38820224,"thread_start_us":133890,"threads_started":1,"wal-append.queue_time_us":214695}
I20260709 13:07:23.893433 16564 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:07:23.921730 16564 pending_rounds.cc:85] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 3
I20260709 13:07:23.921973 16564 pending_rounds.cc:107] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:23.922178 16564 raft_consensus.cc:2889] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.896344 16485 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.868644 16565 rpcz_store.cc:276] 0709 13:07:22.793993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.083164 (+289171us) service_pool.cc:224] Handling call
0709 13:07:23.083432 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.866683 (+783251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.866940 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.881815 19469 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:23.879319 19602 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:23.898003 16482 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:23.926798 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1822) took 1022 ms. Trace:
I20260709 13:07:23.891233 19466 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.889990 18818 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:23.880008 19351 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.907351 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:23.880296 16561 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:23.885723 19575 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:22.906339 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44524.4us
I20260709 13:07:23.893905 19536 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.931361 16634 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:23.877964 19520 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:23.912197 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:23.887252 19516 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.913594 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.893684 19571 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.911929 16640 rpcz_store.cc:276] 0709 13:07:22.979366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.984318 (+  4952us) service_pool.cc:224] Handling call
0709 13:07:23.882150 (+897832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.937783 19353 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.938943 19353 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.940114 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1182) took 1149 ms. Trace:
I20260709 13:07:23.940517 16633 rpcz_store.cc:276] 0709 13:07:22.791034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.791138 (+   104us) service_pool.cc:224] Handling call
0709 13:07:22.910846 (+119708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.902991 (+992145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.939917 (+ 36926us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540043c950. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:23.940054 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274614016}
I20260709 13:07:23.940131 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:23.944669 16637 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.930176 19599 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:23.923879 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1190) took 1072 ms. Trace:
W20260709 13:07:23.925706 16530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.020s	sys 0.018s
I20260709 13:07:23.926062 16563 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:23.950693 16486 raft_consensus.cc:2368] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:23.950196 19599 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.951596 19516 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:23.952432 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 343) took 1242 ms. Trace:
I20260709 13:07:23.952782 16639 rpcz_store.cc:276] 0709 13:07:22.710168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.710549 (+   381us) service_pool.cc:224] Handling call
0709 13:07:23.952247 (+1241698us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000b1654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:23.952379 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2706560256}
I20260709 13:07:23.953300 19575 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.929656 19510 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.930291 19469 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:23.954248 19469 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.956133 19469 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:23.956230 19521 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.956809 19521 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.958133 18818 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.958914 19521 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:23.962069 19564 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:23.962616 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1188) took 1133 ms. Trace:
I20260709 13:07:23.962994 16631 rpcz_store.cc:276] 0709 13:07:22.829656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.829864 (+   208us) service_pool.cc:224] Handling call
0709 13:07:23.962441 (+1132577us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54003a2d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:23.962563 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158581504}
I20260709 13:07:23.964936 19536 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:23.950233 16636 rpcz_store.cc:276] 0709 13:07:22.842357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.842514 (+   157us) service_pool.cc:224] Handling call
0709 13:07:23.914778 (+1072264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.933681 19602 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:23.950337 16530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.020s	sys 0.018s
I20260709 13:07:23.968271 19602 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.934115 19515 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:23.969656 19515 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.971491 19515 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:23.972733 19524 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:23.927116 16482 rpcz_store.cc:276] 0709 13:07:22.904417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.087879 (+183462us) service_pool.cc:224] Handling call
0709 13:07:23.926736 (+838857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.927253 16565 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:23.951498 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1778) took 1136 ms. Trace:
I20260709 13:07:23.974016 16563 rpcz_store.cc:276] 0709 13:07:22.815125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.912930 (+ 97805us) service_pool.cc:224] Handling call
0709 13:07:23.951355 (+1038425us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540004a454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:23.951445 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294628096}
I20260709 13:07:23.880501 19561 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.975219 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.891134 19343 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:23.935703 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2074) took 1137 ms. Trace:
I20260709 13:07:23.938982 19351 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.975901 16631 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:23.976112 19561 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.923456 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:23.976647 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.953754 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:23.978338 16639 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.950173 16385 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 2 to 3, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 3 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:23.979540 16385 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.981853 16385 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 7, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 7 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.977295 16561 rpcz_store.cc:276] 0709 13:07:22.794655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.864211 (+ 69556us) service_pool.cc:224] Handling call
0709 13:07:23.931903 (+1067692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.977665 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.966271 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:23.986088 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 53156us
I20260709 13:07:23.916750 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1780) took 1075 ms. Trace:
I20260709 13:07:23.989579 16560 rpcz_store.cc:276] 0709 13:07:22.841313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.916010 (+1074697us) service_pool.cc:224] Handling call
0709 13:07:23.916296 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.916469 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.916493 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.916532 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:23.916564 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.916611 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.916700 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.984333 16631 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 4.
W20260709 13:07:23.991811 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 79659.5us
I20260709 13:07:23.983265 16385 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.926218 19306 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:23.920979 19552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.010s	sys 0.027s
I20260709 13:07:23.993465 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.952450 19599 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:23.977510 19510 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:23.996109 19523 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.977178 19343 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.998879 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:23.992053 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:23.918286 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1779) took 1102 ms. Trace:
I20260709 13:07:23.938423 19509 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.966315 19532 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:24.000041 19524 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:24.009492 19082 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:23.993561 19515 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.010998 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:24.014372 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:24.015086 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 240181us
I20260709 13:07:24.016215 16640 raft_consensus.cc:2410] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:24.016987 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:24.016897 16558 rpcz_store.cc:276] 0709 13:07:22.815402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.917590 (+1102188us) service_pool.cc:224] Handling call
0709 13:07:23.917850 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.918017 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.918041 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.918079 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:23.918107 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.918153 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.918238 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.019025 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.021808 16631 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:24.021994 16639 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:24.024724 16483 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 13:07:24.025864 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.027041 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.028105 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.024011 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.029732 16488 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:07:24.027585 16483 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
I20260709 13:07:24.030879 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:24.031418 16483 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.991710 19469 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.036466 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:24.012573 19552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.010s	sys 0.028s
I20260709 13:07:24.036520 16637 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:24.037467 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:24.037890 16485 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:24.042287 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1823) took 1137 ms. Trace:
I20260709 13:07:24.038698 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:24.000903 19521 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:24.046703 19521 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.048646 19521 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:24.049494 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.039781 16385 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 6, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 6 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.012835 19520 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:24.044277 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.042603 16485 rpcz_store.cc:276] 0709 13:07:22.904751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.080457 (+175706us) service_pool.cc:224] Handling call
0709 13:07:24.042236 (+961779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.014137 19306 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.050297 16637 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:24.049417 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.051502 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.052295 16640 raft_consensus.cc:2410] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:24.055045 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.055382 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:24.055588 16631 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
W20260709 13:07:24.057572 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.058799 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:24.020975 19323 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.020545 19536 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.060724 16632 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:24.061573 16640 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:24.043551 19452 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.037171 19532 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.067097 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.067199 17152 leader_election.cc:400] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10.
I20260709 13:07:24.067682 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.041677 19580 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:24.069818 16639 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
W20260709 13:07:24.070120 16386 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 225) took 12842 ms (client timeout 15000 ms). Trace:
W20260709 13:07:24.070442 17180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.006s	sys 0.023s
I20260709 13:07:24.071004 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:24.072691 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:24.083349 17180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.006s	sys 0.023s
I20260709 13:07:24.083602 16563 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.084048 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:24.083002 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:24.073720 19520 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.044202 19469 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.075304 19452 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:24.076747 16631 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:24.064203 19521 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.077308 16558 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:24.077831 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:24.067979 19323 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.084134 17180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 511) took 1249 ms. Trace:
I20260709 13:07:24.077330 16560 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:24.049687 19147 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:24.107851 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:24.109792 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 338) took 1429 ms. Trace:
I20260709 13:07:24.037424 19515 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.110157 16635 rpcz_store.cc:276] 0709 13:07:22.680772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.680893 (+   121us) service_pool.cc:224] Handling call
0709 13:07:22.685485 (+  4592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.829394 (+143909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.109559 (+1280165us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000fcdd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:24.109739 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288239488}
I20260709 13:07:24.065635 19082 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.037508 19524 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.105855 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:24.122057 16563 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:24.114249 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:24.114673 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2050) took 2120 ms. Trace:
I20260709 13:07:24.122970 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:24.079612 17152 leader_election.cc:403] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:24.116539 16530 leader_election.cc:400] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
I20260709 13:07:24.066035 18973 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.123811 16530 leader_election.cc:403] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:24.123517 16560 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.112576 16385 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 6, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 6 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:24.123920 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 59316.4us
I20260709 13:07:24.123653 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:24.125962 16374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48356.9us
I20260709 13:07:24.101913 19599 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.102429 17180 rpcz_store.cc:276] 0709 13:07:22.834486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.907044 (+ 72558us) service_pool.cc:224] Handling call
0709 13:07:22.907397 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.907734 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.907761 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.908816 (+  1055us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.083846 (+1175030us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.083884 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.083940 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.083977 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:24.083987 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.084082 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":248,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":1174638,"threads_started":1,"wal-append.queue_time_us":1162682}
I20260709 13:07:24.128800 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:24.129797 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:24.131932 19367 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:24.132473 19367 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.132860 19532 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.133527 19532 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.133857 19532 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.134176 19532 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.123189 16564 rpcz_store.cc:276] 0709 13:07:21.993886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.021711 (+ 27825us) service_pool.cc:224] Handling call
0709 13:07:22.021989 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.928475 (+1906486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.114477 (+186002us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400233cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:24.114617 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4293266816}
I20260709 13:07:24.136487 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:24.094547 19580 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:24.150171 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.150862 16563 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:24.143721 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:24.140827 16483 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:24.141239 16633 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:24.148109 16631 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:24.150069 19599 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
I20260709 13:07:24.157310 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:24.157914 17180 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.160419 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:24.161523 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:24.113840 19523 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:24.164554 16484 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:07:24.122248 19082 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:24.174324 19082 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.174589 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:24.136809 19517 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.175696 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:24.177028 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:24.178256 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1821) took 1353 ms. Trace:
I20260709 13:07:24.178602 16489 rpcz_store.cc:276] 0709 13:07:22.825352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.848662 (+ 23310us) service_pool.cc:224] Handling call
0709 13:07:22.898053 (+ 49391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.768989 (+870936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.769020 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.769541 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.904261 (+134720us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:23.904298 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.904359 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.178059 (+273700us) raft_consensus.cc:1685] finished
0709 13:07:24.178078 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.178200 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8122,"raft.queue_time_us":877311,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":134339,"threads_started":1,"wal-append.queue_time_us":402309}
I20260709 13:07:24.133119 19600 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:24.180012 19600 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.180363 19600 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.136482 19603 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.180891 19323 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:24.156569 18973 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:24.182451 18973 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:24.081933 16386 rpcz_store.cc:269] 0709 13:07:11.193725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.193973 (+   248us) service_pool.cc:224] Handling call
0709 13:07:24.035872 (+12841899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:20.123540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:20.168908 (+ 45368us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:20.168943 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:07:20.168961 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:20.187838 (+ 18877us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:20.187898 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:20.187927 (+    29us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:07:20.217771 (+ 29844us) tablet.cc:701] Row locks acquired
0709 13:07:20.217792 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:20.217928 (+   136us) write_op.cc:270] Start()
0709 13:07:20.218055 (+   127us) write_op.cc:276] Timestamp: P: 1783602440217883 usec, L: 0
0709 13:07:20.218075 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:20.218713 (+   638us) log.cc:844] Serialized 7820 byte log entry
0709 13:07:20.436049 (+217336us) op_driver.cc:464] REPLICATION: finished
0709 13:07:20.560386 (+124337us) write_op.cc:301] APPLY: starting
0709 13:07:20.560995 (+   609us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:20.561510 (+   515us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:20.569321 (+  7811us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:20.641143 (+ 71822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:20.641524 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:07:20.641572 (+    48us) write_op.cc:312] APPLY: finished
0709 13:07:20.642117 (+   545us) log.cc:844] Serialized 139 byte log entry
0709 13:07:20.643287 (+  1170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.643566 (+   279us) write_op.cc:454] Released schema lock
0709 13:07:20.643640 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:20.660484 (+ 16844us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.660512 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2233897,"reported_tablets":46,"spinlock_wait_cycles":21632,"child_traces":[["op",{"apply.queue_time_us":123985,"apply.run_cpu_time_us":5885,"apply.run_wall_time_us":100098,"num_ops":20,"prepare.queue_time_us":353167,"prepare.run_cpu_time_us":19564,"prepare.run_wall_time_us":171773,"raft.queue_time_us":5025,"raft.run_cpu_time_us":26021,"raft.run_wall_time_us":188536,"replication_time_us":97486,"thread_start_us":511795,"threads_started":4,"wal-append.queue_time_us":85452,"wal-append.run_cpu_time_us":8669,"wal-append.run_wall_time_us":1339027}]]}
I20260709 13:07:24.187318 19306 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:24.173921 17188 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:24.082752 19536 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.190191 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.157547 19343 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.193696 16633 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:24.195597 17180 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:24.158790 19552 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.113435 19521 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.280112 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.226854 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.167861 19599 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.319547 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:24.320559 16563 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.242484 19306 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.194278 19343 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.344669 16635 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:24.342466 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.347019 16564 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:24.195030 19603 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.294130 19552 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:24.192350 19523 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.356588 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.361467 16563 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:24.374107 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.303094 19323 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:24.390031 16558 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:24.365860 19599 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.366412 16484 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 4.
I20260709 13:07:24.393827 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.303622 19561 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:07:24.394490 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:24.397066 17187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.018s
I20260709 13:07:24.404898 16489 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
W20260709 13:07:24.365595 19560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.808s	user 0.033s	sys 0.032s
I20260709 13:07:24.395706 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.344498 19147 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:24.353138 19343 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.343916 19608 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:24.305701 16560 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:24.373828 19552 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.391258 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:24.405021 17187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.000s	sys 0.018s
I20260709 13:07:24.426456 17187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 507) took 1596 ms. Trace:
I20260709 13:07:24.427218 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.348419 19306 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:24.406351 16532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.009s	sys 0.013s
I20260709 13:07:24.417259 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:24.436662 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:24.428999 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:24.437539 16563 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.437472 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:24.426787 17187 rpcz_store.cc:276] 0709 13:07:22.830432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.830545 (+   113us) service_pool.cc:224] Handling call
0709 13:07:22.847091 (+ 16546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.847403 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.847428 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.849638 (+  2210us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.516195 (+666557us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:23.796259 (+280064us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.426161 (+629902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.426230 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.426272 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:24.426284 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.426404 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":275522,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":181598,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":12996,"thread_start_us":1107350,"threads_started":2,"wal-append.queue_time_us":928138}
W20260709 13:07:24.408416 19560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.853s	user 0.033s	sys 0.032s
W20260709 13:07:24.438684 16532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.009s	sys 0.013s
W20260709 13:07:24.502945 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.348378 19452 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:24.505366 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 67000.6us
I20260709 13:07:24.509457 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.510128 16560 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:24.394894 19323 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.506377 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:24.512295 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.515475 16604 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:24.434624 18818 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:24.521375 17179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.027s	sys 0.065s
I20260709 13:07:24.374562 19580 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.404443 19457 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.320s
I20260709 13:07:24.509965 19604 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.575531 16455 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.15.6.62:43625, user_credentials={real_user=slave}} blocked reactor thread for 63568.4us
W20260709 13:07:24.576159 17179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.028s	sys 0.066s
W20260709 13:07:24.576264 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 383137us
I20260709 13:07:24.578563 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.595016 16631 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:24.510440 19515 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:24.427551 19147 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.510210 19585 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:07:24.505332 19260 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:07:24.436491 19608 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:24.770166 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.606319 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 99997.5us
W20260709 13:07:24.665350 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.665741 17152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.030s
W20260709 13:07:24.792477 17152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.022s	sys 0.033s
W20260709 13:07:24.665638 16562 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.012s	sys 0.031s
I20260709 13:07:24.792894 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:24.793234 16562 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.019s	sys 0.034s
I20260709 13:07:24.794332 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2068) took 2001 ms. Trace:
I20260709 13:07:24.516117 19575 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.513054 19602 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:24.792850 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 662042us
I20260709 13:07:24.595822 19513 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.621129 16563 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:24.771732 16561 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:24.632527 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:24.511065 16531 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.020s
W20260709 13:07:24.804062 16531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.004s	sys 0.021s
I20260709 13:07:24.577356 19469 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:24.795817 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 359186us
I20260709 13:07:24.794966 16562 rpcz_store.cc:276] 0709 13:07:22.793058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.793170 (+   112us) service_pool.cc:224] Handling call
0709 13:07:22.809154 (+ 15984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.809346 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:22.822708 (+ 13362us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.794027 (+1971319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.794072 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:24.794109 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.794166 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.794283 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24392,"prepare.queue_time_us":13576,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":44241,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":1959519,"threads_started":2,"wal-append.queue_time_us":1133973}
I20260709 13:07:24.798064 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:24.799142 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:24.511783 19082 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.789242 19536 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:24.786701 19521 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:24.788362 19616 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.804723 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.829639 16635 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:24.797402 19599 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:24.832949 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.620714 19516 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.834957 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:24.653478 19580 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.633658 19353 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.627748 18818 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:24.847760 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 420594us
I20260709 13:07:24.798684 19602 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.794194 19609 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.620483 19612 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.804430 19533 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.800019 19607 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.630553 19623 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.832408 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:24.902559 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:24.836938 19521 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:24.830565 19564 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:24.805018 19575 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:24.845214 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 329788us
I20260709 13:07:24.797252 19604 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.831431 19469 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:24.833310 19523 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:24.843331 19536 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.891223 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:24.899400 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 100830us
I20260709 13:07:24.832777 19603 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:24.807392 19624 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:07:24.858103 19629 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:07:24.903451 16631 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.883803 19602 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.821090 19513 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.908725 19623 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.904484 19515 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:24.909459 19082 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:24.836989 19616 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.910820 19147 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:24.903641 19612 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:24.903684 19466 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:07:24.923084 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 336663us
I20260709 13:07:24.980201 19603 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:25.036406 19367 consensus_meta.cc:287] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.904s	user 0.009s	sys 0.000s
I20260709 13:07:24.906745 19564 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.926563 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:24.927162 19640 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.897403 18818 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:24.905344 19609 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.907666 19521 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.034430 19533 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:24.979211 19323 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:24.920287 19469 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:24.817919 19630 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:25.081676 16564 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:24.905962 19607 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.018927 19632 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:24.921775 19643 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:07:25.034814 19353 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:25.034672 19516 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:25.133812 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 70967.8us
I20260709 13:07:25.188298 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.055555 19639 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.082880 19603 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.190982 19536 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:25.143991 19515 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:25.137921 19564 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.136543 19367 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10.
W20260709 13:07:25.257900 19618 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
W20260709 13:07:25.255717 16486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1140) took 2967 ms (client timeout 2950 ms). Trace:
W20260709 13:07:25.246888 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:25.270056 16486 rpcz_store.cc:269] 0709 13:07:22.277180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.434655 (+157475us) service_pool.cc:224] Handling call
0709 13:07:25.238981 (+2804326us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400289954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:25.244698 (+  5717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484532992}
I20260709 13:07:25.133625 19615 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.265666 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.244170 19323 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:25.133121 18732 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:25.261001 19617 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 13:07:25.259747 19515 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:25.257563 19603 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:25.272272 19627 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:07:25.256734 19466 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.280150 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 437365us
I20260709 13:07:25.271960 19513 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:25.285692 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:25.313321 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.271732 19353 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.335055 19533 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:25.337924 19509 consensus_meta.cc:287] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.304s	user 0.002s	sys 0.006s
I20260709 13:07:25.338261 19604 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:25.340978 19469 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:25.251698 19632 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.415340 19521 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:25.343910 19614 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:07:25.276235 19323 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:25.416754 19323 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.339526 18818 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.265671 19612 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.243060 19630 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.547261 19630 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.547937 19323 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.549100 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.549911 16635 raft_consensus.cc:2410] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:25.551010 16635 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:25.280925 19615 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:25.415150 19343 consensus_meta.cc:287] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.987s	user 0.006s	sys 0.002s
I20260709 13:07:25.554072 19343 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.554757 19615 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.555976 19343 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.286247 19608 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:25.557626 17182 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:25.418634 16636 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:07:25.559469 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2071) took 1476 ms. Trace:
I20260709 13:07:25.561789 16633 rpcz_store.cc:276] 0709 13:07:24.082958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.315424 (+232466us) service_pool.cc:224] Handling call
0709 13:07:24.315756 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.316171 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.316199 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.349037 (+ 32838us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.662568 (+313531us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.662611 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.662688 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.559272 (+896584us) raft_consensus.cc:1685] finished
0709 13:07:25.559291 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.559416 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":23230,"thread_start_us":264877,"threads_started":1,"wal-append.queue_time_us":537519}
W20260709 13:07:25.564967 16631 consensus_meta.cc:287] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.634s	user 0.002s	sys 0.006s
I20260709 13:07:25.565382 16631 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
W20260709 13:07:25.576467 19532 consensus_meta.cc:287] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 1.442s	user 0.009s	sys 0.001s
I20260709 13:07:25.346359 19575 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:25.576887 19532 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.257844 19639 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.603968 19532 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.604696 19639 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:25.612044 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2092) took 1196 ms. Trace:
I20260709 13:07:25.612455 16561 rpcz_store.cc:276] 0709 13:07:24.415516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.906511 (+490995us) service_pool.cc:224] Handling call
0709 13:07:24.918189 (+ 11678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.918473 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.918499 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.921821 (+  3322us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.259253 (+337432us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:25.259294 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.259364 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.611836 (+352472us) raft_consensus.cc:1685] finished
0709 13:07:25.611855 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.611984 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16542,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":55949,"thread_start_us":238873,"threads_started":1,"wal-append.queue_time_us":395357}
I20260709 13:07:25.575685 19515 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.412948 19642 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:25.578056 19571 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.646670 17185 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:25.647527 16530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.033s	sys 0.041s
W20260709 13:07:25.647913 16604 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.009s	sys 0.032s
I20260709 13:07:25.398039 19466 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:25.648259 16604 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.009s	sys 0.032s
W20260709 13:07:25.650020 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 738285us
W20260709 13:07:25.647876 16530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.033s	sys 0.041s
W20260709 13:07:25.649101 17153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.024s	sys 0.017s
I20260709 13:07:25.344036 19516 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:25.651398 17153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.024s	sys 0.018s
W20260709 13:07:25.651955 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 853949us
W20260709 13:07:25.660406 16603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.007s	sys 0.048s
I20260709 13:07:25.666437 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.557844 19536 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.668653 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.672022 16635 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:25.677626 19603 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.680455 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:25.680847 19623 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.651678 19571 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.681365 19655 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:25.681164 17187 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:25.684485 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:07:25.695873 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.689767 19457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.016s	sys 0.017s
W20260709 13:07:25.697460 19457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.016s	sys 0.017s
I20260709 13:07:25.697923 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1795) took 1291 ms. Trace:
I20260709 13:07:25.698298 16564 rpcz_store.cc:276] 0709 13:07:24.406505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.578318 (+171813us) service_pool.cc:224] Handling call
0709 13:07:25.697728 (+1119410us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400018e54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:25.697860 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673856768}
I20260709 13:07:25.699110 19604 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:25.699656 19604 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.700165 16563 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:25.700316 19658 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.700874 19658 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.703470 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.703991 16635 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
W20260709 13:07:25.704567 17152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.009s	sys 0.034s
W20260709 13:07:25.704914 17152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.009s	sys 0.034s
W20260709 13:07:25.705225 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 804954us
I20260709 13:07:25.709798 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:25.710425 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.710740 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:25.713861 16633 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:25.657692 19642 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.696190 19575 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.720283 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.720678 16631 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.704665 19607 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:25.721808 17187 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.689525 19509 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:07:25.727612 19654 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:07:25.730195 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.724063 19657 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:25.730880 19657 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.712738 19513 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.732774 19657 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:25.732556 19513 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.690186 19655 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.734448 19513 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:25.735594 19655 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:25.736173 19646 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:25.713655 19616 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.736719 19575 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:25.737285 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2088) took 1322 ms. Trace:
I20260709 13:07:25.737636 19575 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.737656 16562 rpcz_store.cc:276] 0709 13:07:24.414664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.814164 (+399500us) service_pool.cc:224] Handling call
0709 13:07:24.829856 (+ 15692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.830061 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.830086 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.841404 (+ 11318us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.018766 (+177362us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.018809 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.018886 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.737064 (+718178us) raft_consensus.cc:1685] finished
0709 13:07:25.737083 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.737217 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":114158,"threads_started":1,"wal-append.queue_time_us":696247}
W20260709 13:07:25.744995 19552 consensus_meta.cc:287] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.239s	user 0.008s	sys 0.000s
I20260709 13:07:25.745379 19552 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.747262 19552 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.749987 17179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 513) took 2902 ms. Trace:
I20260709 13:07:25.750152 19466 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:25.752516 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.753472 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:25.708088 19603 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.758316 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:25.717283 19623 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:25.761663 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.775992 19552 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:25.780058 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:25.781322 19466 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:25.736173 19306 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:25.722409 19580 consensus_meta.cc:287] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.862s	user 0.004s	sys 0.005s
I20260709 13:07:25.754915 17179 rpcz_store.cc:276] 0709 13:07:22.847688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.848154 (+   466us) service_pool.cc:224] Handling call
0709 13:07:23.874094 (+1025940us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:23.906972 (+ 32878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.907002 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:23.922553 (+ 15551us) log.cc:844] Serialized 52 byte log entry
0709 13:07:24.791598 (+869045us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.905523 (+113925us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.042324 (+136801us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.042493 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.042555 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.612010 (+569455us) raft_consensus.cc:1685] finished
0709 13:07:25.612032 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.749810 (+137778us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54004f2c50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:25.749909 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168142,"prepare.queue_time_us":596053,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":295881,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":69758,"spinlock_wait_cycles":2325954432,"thread_start_us":935387,"threads_started":2,"wal-append.queue_time_us":866238}
I20260709 13:07:25.785869 19604 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:25.789409 19600 consensus_meta.cc:287] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 1.609s	user 0.005s	sys 0.004s
I20260709 13:07:25.717830 19620 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:25.799000 16631 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:25.812398 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:25.793900 19564 consensus_meta.cc:287] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.000s
I20260709 13:07:25.807050 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.808614 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.800268 19351 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:25.795686 19602 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.780s	user 0.008s	sys 0.000s
I20260709 13:07:25.800149 16561 raft_consensus.cc:2368] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6.
I20260709 13:07:25.817642 16635 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.809520 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.820444 17188 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:25.795284 19611 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:25.799477 19639 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:25.800019 19623 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:25.821839 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.823901 17188 pending_rounds.cc:85] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 6
I20260709 13:07:25.759285 19616 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:25.842784 17188 pending_rounds.cc:107] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:25.843889 17188 raft_consensus.cc:2889] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.830327 17179 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:25.811982 19552 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:25.845026 19616 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.843067 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.846863 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:25.851891 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.854647 17187 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:07:25.851182 16637 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.821168 19351 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.808202 19466 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.820011 19600 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.845644 19552 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.869170 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.870488 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.872931 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.872934 16562 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:25.872594 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.847205 19623 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.876856 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.879245 19466 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:25.882664 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.883599 16562 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:25.886385 16565 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:25.873410 19351 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.886988 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.887655 16562 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:25.888419 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.889348 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.889832 16562 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:25.890573 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.891068 16562 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:25.851121 19611 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.842398 19602 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.885432 19599 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:25.882912 16637 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:25.821830 19620 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.899420 16635 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:25.900586 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:25.884559 19600 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:25.870839 19147 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.914623 19623 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:25.846323 19639 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.822692 19564 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.944018 16562 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:25.939590 16639 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:25.946688 19620 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.947359 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:25.947954 16637 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:25.900770 19603 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.950474 19603 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:25.926132 19599 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.936439 19609 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.953538 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.953604 16562 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:25.951251 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:25.959996 17179 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:25.963449 16487 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:25.968359 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.969121 17179 raft_consensus.cc:2393] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:25.970395 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:25.974047 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.925935 19643 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.952900 19639 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.990100 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.939939 19510 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.988108 16603 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:25.991024 17180 raft_consensus.cc:2410] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:25.952553 19603 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:25.991569 16603 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:25.990168 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.955204 19602 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:25.993703 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.995680 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:25.995316 19604 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.998072 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:25.966449 19640 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:25.998651 17180 raft_consensus.cc:2376] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8. Re-sending same reply.
I20260709 13:07:25.974318 19620 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:25.996341 17179 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:25.993377 19536 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.001187 16603 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:26.003008 16603 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:25.957319 19147 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.007978 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 610) took 1955 ms. Trace:
I20260709 13:07:26.011983 19466 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.016180 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.002329 19640 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:26.017697 16634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2053) took 2519 ms (client timeout 1829 ms). Trace:
I20260709 13:07:26.016010 17184 rpcz_store.cc:276] 0709 13:07:24.052802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.053051 (+   249us) service_pool.cc:224] Handling call
0709 13:07:24.064717 (+ 11666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.078507 (+ 13790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.078538 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.078970 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.435658 (+356688us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:24.435693 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.435749 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.007149 (+1571400us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b240030b348. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332249c4 00007f0633222acb 00007f06333dddc9 00007f06333dda55 00007f06333dcfb0 00007f0636053488 00007f0636053be8 00007f063602b398 00007f063602676a 00007f0636025bb6
0709 13:07:26.007691 (+   542us) raft_consensus.cc:1685] finished
0709 13:07:26.007710 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.007922 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1654,"raft.queue_time_us":15060,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":357085568,"thread_start_us":356290,"threads_started":1,"wal-append.queue_time_us":845940}
I20260709 13:07:26.018224 19640 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.004271 19602 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.004338 19620 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.020205 16529 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:26.021196 19620 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:26.021687 19604 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.021884 19147 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.022269 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:26.026226 16454 connection.cc:256] RPC call timeout handler was delayed by -1.7126387830001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:07:26.026968 16454 connection.cc:256] RPC call timeout handler was delayed by -1.4723296050000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260709 13:07:26.028762 19641 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.029172 19641 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:26.030020 19641 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.031029 19641 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.032456 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2050) took 2535 ms. Trace:
I20260709 13:07:26.032608 19616 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:26.018086 16634 rpcz_store.cc:269] 0709 13:07:23.498261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.886126 (+387865us) service_pool.cc:224] Handling call
0709 13:07:26.017492 (+2131366us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b54003264d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:26.017598 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22603136}
I20260709 13:07:26.038290 16640 rpcz_store.cc:276] 0709 13:07:23.497405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.062296 (+564891us) service_pool.cc:224] Handling call
0709 13:07:24.062536 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.304714 (+242178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.304742 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.304780 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:24.304810 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.032265 (+1727455us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54003f1954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:26.032306 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.032406 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556520704}
I20260709 13:07:26.042587 16529 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:26.043622 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.044083 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.044601 17179 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:26.045516 16603 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:26.029896 19611 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.061360 19516 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.051208 19532 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:07:26.061904 19516 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.062628 19532 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.062971 19532 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:26.063560 19452 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.059067 19607 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.063741 19532 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.065862 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.059005 19469 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.066041 19607 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.060279 19648 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.065650 19452 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.066449 16485 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.067062 19648 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.057509 19639 consensus_queue.cc:1059] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:26.068646 19452 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.068969 19639 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:26.069096 19648 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.050081 19629 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.069839 19629 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.071187 19564 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:26.071801 19629 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.058041 19457 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.073294 16485 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:26.067171 19608 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:26.074448 19608 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.075001 19607 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.075639 19457 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.076902 19608 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.050911 19600 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.067021 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.069365 19639 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:26.089712 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.090231 16488 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.088987 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.087991 17179 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:26.057920 19616 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.057134 19604 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.101775 19604 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:26.102188 19604 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.102641 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.091775 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.088657 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.104144 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.104832 16489 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:26.104737 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.105618 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.105850 16490 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:26.057176 19510 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.994156 19643 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.106777 19510 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.108021 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.108549 19643 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.108690 19510 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.100023 16488 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:26.101142 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.109627 19639 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.110777 19639 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.114230 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:26.114701 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.032693 19351 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.117515 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:26.073917 19623 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.089401 19516 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.077574 19457 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.115984 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.131163 16483 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:26.126626 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:26.115044 16488 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:26.119285 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:26.125500 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.126010 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:26.130069 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:26.115311 19589 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.135782 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.114591 19645 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.138604 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.114244 19533 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:07:26.140209 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.119922 19532 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.140175 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.143162 16484 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.145861 19351 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:26.147558 19658 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:26.150898 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.151037 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2080) took 2084 ms. Trace:
I20260709 13:07:26.152108 16566 rpcz_store.cc:276] 0709 13:07:24.066117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.068270 (+  2153us) service_pool.cc:224] Handling call
0709 13:07:24.077268 (+  8998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.345947 (+268679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.345975 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.346013 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.346046 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.150845 (+1804799us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540006dbd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:26.150886 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.150988 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617470848}
I20260709 13:07:26.157369 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.157975 16566 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:26.159242 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.159696 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.159868 16566 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:26.162067 16486 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 5: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:26.139379 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:26.163180 19620 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:26.163395 17184 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.164971 19536 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:26.165452 19517 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:26.165946 19536 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:26.166379 19536 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:26.167663 17185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 618) took 1993 ms. Trace:
I20260709 13:07:26.167189 19536 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.168991 19536 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.174304 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.165906 19517 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:26.168079 17185 rpcz_store.cc:276] 0709 13:07:24.174000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.176816 (+  2816us) service_pool.cc:224] Handling call
0709 13:07:26.167473 (+1990657us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400610dd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:26.167578 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546598656}
I20260709 13:07:26.179330 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.151503 19589 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.185459 19517 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.186570 19517 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.187441 19524 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.187958 19589 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.165571 19571 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.195431 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.195574 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2078) took 2130 ms. Trace:
I20260709 13:07:26.153659 19645 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.196372 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:26.228721 19670 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:26.196813 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.174978 16566 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:26.229619 16490 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:26.230407 16484 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 5.
I20260709 13:07:26.230655 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.197135 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.196029 16559 rpcz_store.cc:276] 0709 13:07:24.065589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.065872 (+   283us) service_pool.cc:224] Handling call
0709 13:07:24.066104 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.141507 (+ 75403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.141535 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.141572 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:24.141604 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.195351 (+2053747us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b5400019854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:26.195393 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.195496 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173005184}
W20260709 13:07:26.246742 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.204941 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:26.248126 16485 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:26.249099 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:26.249809 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 44935.4us
I20260709 13:07:26.252717 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:26.249810 16566 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:26.258688 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:26.224294 19669 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 13:07:26.260480 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:26.225534 19620 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:26.259423 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.265933 16566 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:26.266042 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.269686 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.259189 19589 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.276062 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.303076 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.262203 19640 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.263412 19623 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:26.304219 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.307749 16484 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.307956 16490 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:26.276437 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.277830 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.205862 19599 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.308537 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.308918 16488 raft_consensus.cc:2376] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9. Re-sending same reply.
I20260709 13:07:26.313650 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:26.314853 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.315616 16566 raft_consensus.cc:2410] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:26.317878 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:26.324282 16490 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:26.301890 19589 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.346532 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:26.346688 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.347333 17185 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:26.348869 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.349424 16490 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:26.310200 19640 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.351166 17186 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.351938 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 1790) took 1962 ms. Trace:
I20260709 13:07:26.354604 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:26.347401 16484 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:26.318926 19606 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.359712 16565 rpcz_store.cc:276] 0709 13:07:24.389497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.632272 (+242775us) service_pool.cc:224] Handling call
0709 13:07:26.351733 (+1719461us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540007d0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:26.351867 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488676224}
I20260709 13:07:26.317510 19524 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:26.320591 19610 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.323838 19623 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:26.361490 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.367146 16565 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:26.363407 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.364524 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.360805 17186 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:26.360790 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:26.369537 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.347600 19589 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.372221 16484 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:26.368741 16490 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:26.367873 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.372169 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:26.374068 17185 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:26.376731 16565 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:26.376806 16562 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.377632 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.379930 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.380787 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.359649 19640 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.381194 16565 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:26.385401 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:26.386097 16565 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.390229 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2086) took 2320 ms. Trace:
I20260709 13:07:26.390594 16558 rpcz_store.cc:276] 0709 13:07:24.069720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.113536 (+ 43816us) service_pool.cc:224] Handling call
0709 13:07:24.147396 (+ 33860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.397838 (+250442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.390029 (+1992191us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000d3ed4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:26.390178 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557257088}
I20260709 13:07:26.394367 16565 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:26.395255 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:26.395843 16565 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.396636 16605 leader_election.cc:400] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6.
I20260709 13:07:26.396984 16605 leader_election.cc:403] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.399408 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:26.400228 17185 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:26.401033 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:26.405915 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.408027 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.382920 19561 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.409590 19561 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.409664 17184 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:26.410003 19561 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.411021 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.411163 16605 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.422937 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.422993 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:26.405550 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:26.424907 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.429349 16562 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:26.429812 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.430380 16561 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:26.434171 16561 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:26.435047 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.435528 16561 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:26.436440 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.436919 16561 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:26.439380 19623 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.440400 16483 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:26.431933 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.444460 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:26.444615 19567 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.445478 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.445710 19567 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.446009 19571 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.446408 19571 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:26.446743 19571 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.375397 19524 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.447852 19653 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:26.448374 19679 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:07:26.448588 16566 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.449890 19524 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.447996 19082 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.448377 19653 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.452811 19082 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:26.452538 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.383353 19620 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.664700 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1812) took 3908 ms. Trace:
I20260709 13:07:26.715811 19466 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.716487 19466 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.712862 16455 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:26.717190 19466 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.718003 19632 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.462412 19604 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:26.666061 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.631224 19667 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.746s	user 0.002s	sys 0.000s
W20260709 13:07:26.719947 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.491999 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 131293us
W20260709 13:07:26.726920 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.724267 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.720736 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2054) took 3222 ms. Trace:
I20260709 13:07:26.469378 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:26.592489 19683 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:26.728106 16490 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:26.456446 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:26.624437 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2090) took 2209 ms. Trace:
W20260709 13:07:26.452827 19678 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:26.663373 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 617) took 2489 ms. Trace:
I20260709 13:07:26.481303 17186 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.729861 19643 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.662927 19515 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.594022 16564 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:26.550685 19606 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:26.731053 17188 rpcz_store.cc:276] 0709 13:07:24.173762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.188531 (+ 14769us) service_pool.cc:224] Handling call
0709 13:07:24.188768 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.849906 (+1661138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.663128 (+813222us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540005cdd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:26.663301 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3744791424}
I20260709 13:07:26.478556 16565 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:26.660681 19642 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:26.609665 19621 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 1.840s	user 0.000s	sys 0.027s
I20260709 13:07:26.732807 16487 rpcz_store.cc:276] 0709 13:07:22.756072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.778612 (+ 22540us) service_pool.cc:224] Handling call
0709 13:07:25.239085 (+2460473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.966161 (+727076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.614022 (+647861us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400289954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:26.664489 (+ 50467us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b5400289950. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:26.664614 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7323142784}
I20260709 13:07:26.725005 19466 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.733565 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 517) took 2670 ms. Trace:
W20260709 13:07:26.684607 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.734133 17183 rpcz_store.cc:276] 0709 13:07:24.063149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.063254 (+   105us) service_pool.cc:224] Handling call
0709 13:07:24.063565 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.066340 (+  2775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.066384 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.102962 (+ 36578us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.401043 (+298081us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:24.401089 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.401148 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.609070 (+2207922us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:26.733322 (+124252us) raft_consensus.cc:1685] finished
0709 13:07:26.733341 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.733512 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9699,"raft.queue_time_us":2780,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":11396,"spinlock_wait_cycles":5482240,"thread_start_us":248699,"threads_started":1,"wal-append.queue_time_us":504471}
W20260709 13:07:26.736339 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.736598 19645 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.461501 19571 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.737996 16560 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:26.738121 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.739045 16485 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:26.472999 16566 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
W20260709 13:07:26.716254 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 270831us
I20260709 13:07:26.695572 16483 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:26.535190 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:26.538473 17182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 619) took 2364 ms (client timeout 1955 ms). Trace:
I20260709 13:07:26.488907 16529 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:26.502954 16561 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:26.716599 16484 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:26.618201 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2082) took 2549 ms. Trace:
W20260709 13:07:26.502898 16636 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1201) took 2530 ms (client timeout 2193 ms). Trace:
W20260709 13:07:26.783987 16636 rpcz_store.cc:269] 0709 13:07:23.972248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.991766 (+ 19518us) service_pool.cc:224] Handling call
0709 13:07:26.502714 (+2510948us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540015ca54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:26.502829 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3237221760}
I20260709 13:07:26.463383 16558 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
W20260709 13:07:26.750499 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 294111us
I20260709 13:07:26.785634 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:26.786993 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 355631us
W20260709 13:07:26.778092 17182 rpcz_store.cc:269] 0709 13:07:24.174272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.175490 (+  1218us) service_pool.cc:224] Handling call
0709 13:07:26.538216 (+2362726us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400415ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:26.538371 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176377088}
I20260709 13:07:26.793428 16559 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.794898 16566 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:26.797662 16566 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:26.799109 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 256901us
W20260709 13:07:26.535331 19681 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:07:26.729744 19082 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.727689 16632 rpcz_store.cc:276] 0709 13:07:23.498522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.063569 (+565047us) service_pool.cc:224] Handling call
0709 13:07:24.095506 (+ 31937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.095954 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.095983 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.114154 (+ 18171us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.689491 (+1575337us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800478fc0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:07:25.808426 (+118935us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:25.808467 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.808545 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.630654 (+822109us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:26.720478 (+ 89824us) raft_consensus.cc:1685] finished
0709 13:07:26.720505 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.720639 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8197,"raft.queue_time_us":98,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10183,"spinlock_wait_cycles":93006080,"thread_start_us":118760,"threads_started":1,"wal-append.queue_time_us":1759544}
I20260709 13:07:26.732084 16564 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:26.802246 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:26.728969 16563 rpcz_store.cc:276] 0709 13:07:24.415100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.817597 (+402497us) service_pool.cc:224] Handling call
0709 13:07:25.699876 (+882279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.703022 (+  3146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.624225 (+921203us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b5400018e50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:26.624374 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027730816}
I20260709 13:07:26.812065 16566 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:26.803983 17186 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:26.463418 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 57941us
I20260709 13:07:26.815727 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:26.805754 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.782442 16557 rpcz_store.cc:276] 0709 13:07:24.068820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.068927 (+   107us) service_pool.cc:224] Handling call
0709 13:07:24.069166 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.153293 (+ 84127us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:24.419323 (+266030us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.792161 (+372838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.792212 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:24.792257 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.227882 (+1435625us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b1800471580. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:26.617972 (+390090us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b540040e054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:26.618018 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.618144 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6178,"prepare.queue_time_us":480524,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2645,"raft.queue_time_us":36450,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":12378,"spinlock_wait_cycles":209125504,"thread_start_us":632098,"threads_started":2,"wal-append.queue_time_us":439591}
I20260709 13:07:26.429340 19536 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.809746 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:26.457669 19602 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.824219 19602 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:26.824306 19469 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.824783 19469 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:26.825302 19469 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.825665 16557 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:26.828294 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.824718 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:26.832032 19602 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.835673 18818 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.837898 18818 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:26.838714 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.839497 18818 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.839949 18818 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.840088 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.840342 18818 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.840857 19658 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.841305 19658 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:26.842128 19658 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.847353 19536 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6.
I20260709 13:07:26.850776 19602 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.837227 19469 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:26.852485 17186 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:26.717005 19653 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.503376 19517 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.859115 17186 pending_rounds.cc:85] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 7
I20260709 13:07:26.790783 19516 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.791235 19632 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:26.629074 19589 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.459594 19561 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:26.888471 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86288.7us
I20260709 13:07:26.898258 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:26.899303 19469 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.899515 19643 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.899891 19643 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:26.900243 19643 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.899315 17153 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:26.905918 19687 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.906320 19687 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.906639 19687 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.859860 19690 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.908102 19690 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:26.908485 19690 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.893260 19686 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.912599 19686 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.912943 19686 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.917304 19599 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.917716 19561 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.884547 19517 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:26.890241 17186 pending_rounds.cc:107] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:26.690445 19640 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.791785 19567 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.859210 19645 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:26.920149 17186 raft_consensus.cc:2889] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.962340 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 516) took 2899 ms. Trace:
I20260709 13:07:26.962827 19640 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:26.963281 19336 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:07:26.946705 17180 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:26.962671 17186 rpcz_store.cc:276] 0709 13:07:24.062868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.064151 (+  1283us) service_pool.cc:224] Handling call
0709 13:07:24.074969 (+ 10818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.351086 (+2276117us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400507ba0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648d1c0 00007f063648e231 00007f063648ad8f 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c
0709 13:07:26.962098 (+611012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.962287 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986647936}
W20260709 13:07:26.966862 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44204.4us
I20260709 13:07:26.937377 19604 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.933521 19567 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:26.933775 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:26.891705 19466 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:26.950824 19571 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:26.957700 16565 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:26.970947 16565 pending_rounds.cc:85] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 4
I20260709 13:07:26.944128 19606 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.943486 19643 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.945935 19602 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:26.947690 19589 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:26.928028 19517 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.971210 16565 pending_rounds.cc:107] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:26.988832 16565 raft_consensus.cc:2889] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.975688 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:26.976468 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:26.990216 16559 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:26.991690 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:26.994859 19367 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.995246 19367 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:26.995594 19367 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.006108 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:26.992312 19600 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.979758 19656 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:26.977605 19567 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.013266 16488 raft_consensus.cc:2376] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9. Re-sending same reply.
W20260709 13:07:27.029706 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 254333us
I20260709 13:07:27.031270 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:27.032465 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:27.000952 18818 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.034970 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.033792 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:26.987700 19690 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:26.990674 19687 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.041066 16488 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:27.038030 19640 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.043664 19640 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.044472 19082 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.045656 19640 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.046487 19082 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:27.047021 19082 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:27.047415 19082 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:27.047220 19686 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.049181 19686 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:27.038645 19604 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.043159 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:27.029827 19600 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:27.055691 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 316815us
W20260709 13:07:27.056083 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 299729us
I20260709 13:07:27.037712 19602 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.063781 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.067716 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:27.007308 19457 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.071661 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:27.079638 17180 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:27.072485 17183 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.072793 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.072956 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:27.073406 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.073606 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.082737 16487 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.074002 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.072516 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.083614 16484 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.074654 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.084539 16490 raft_consensus.cc:2368] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:27.076958 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.085414 16486 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.078661 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.087175 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.087699 16488 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.067288 19602 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.042625 19571 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:07:27.091184 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.092267 16485 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:27.088358 19457 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:27.104331 19457 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.045677 19367 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.106869 19367 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:27.108894 18818 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.109385 19690 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.103659 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:27.110502 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 293926us
I20260709 13:07:27.113327 16484 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:27.114506 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.122479 16488 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:27.123926 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.090736 19602 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.126104 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.147807 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.150712 16482 raft_consensus.cc:2368] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:27.202180 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.203605 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.217837 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.177656 19515 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.220242 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.221012 16488 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:27.221957 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.114418 19082 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.178313 19571 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:07:27.242270 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.246073 19571 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.246587 19571 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.250425 19687 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.255039 19536 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.255558 19536 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.257486 19653 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.259459 19653 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:27.264854 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.265380 16561 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.266115 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:27.266708 16559 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:27.265393 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.227531 19515 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.268400 19457 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.269164 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.269716 16562 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.270068 19515 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.270193 19457 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.274395 16561 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:27.278546 19571 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:27.257498 19536 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:27.280545 19694 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:27.282557 19602 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:27.291190 16530 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.566s (SENT) [suppressed 50 similar messages]
I20260709 13:07:27.293056 16486 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:27.293638 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:27.298411 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.308956 16562 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:27.216758 19517 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.310848 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:27.312844 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.322690 16482 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:27.298067 19693 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:27.317343 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.324375 16560 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.317898 19687 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.318976 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.243722 19697 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.347194 16486 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
W20260709 13:07:27.350533 16606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.006s	sys 0.052s
W20260709 13:07:27.350934 16606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.006s	sys 0.052s
W20260709 13:07:27.352419 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 309323us
I20260709 13:07:27.353843 16488 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:27.321681 19604 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:27.366119 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 288312us
I20260709 13:07:27.369156 16560 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:27.324673 19336 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.382414 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:27.384581 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.330178 19687 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.389818 16487 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
W20260709 13:07:27.394048 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 279687us
I20260709 13:07:27.395613 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.400492 16482 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:27.395684 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.416242 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.394124 19687 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.397154 19561 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.395951 19571 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.440819 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.393184 19336 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:27.364616 19695 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:07:27.445037 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.454246 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.400166 19697 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:27.468993 19697 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.456357 16487 raft_consensus.cc:2368] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:27.458388 19336 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:27.463267 19699 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:07:27.463876 19712 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:27.475349 19712 consensus_queue.cc:1243] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:27.464658 19571 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.477415 19571 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:27.465564 19709 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:27.466435 19517 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.467626 19604 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.396631 19567 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:07:27.479221 19600 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.394454 19466 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:07:27.481560 19561 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:27.492406 19602 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:27.494692 16560 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:27.495241 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.501665 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.456743 16488 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:27.509097 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.491707 19643 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:27.534458 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.537477 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.536669 19515 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.543540 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.543605 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.544365 16487 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:27.541029 19561 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:27.547091 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.519888 19600 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:27.550459 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.552194 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:27.555328 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 164166us
I20260709 13:07:27.536532 19580 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:27.545300 19515 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.560660 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.561194 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:27.562700 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.564580 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.564899 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.565312 16487 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:27.568009 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.574337 16487 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:27.574733 16487 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:27.575409 16487 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.576516 16487 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.554994 19600 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.585049 16454 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:27.587829 19687 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.589887 19687 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.596210 19653 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:27.596604 19653 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:27.597352 19653 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.600660 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.605067 16562 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.607846 19717 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.613054 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:27.613847 16488 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
W20260709 13:07:27.620563 16530 leader_election.cc:336] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.912s (SENT)
I20260709 13:07:27.621027 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:27.621738 18818 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.626503 19653 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:27.653554 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.656145 16562 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
W20260709 13:07:27.661593 16385 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 128) took 16203 ms (client timeout 15000 ms). Trace:
I20260709 13:07:27.662880 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:27.667353 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 119803us
W20260709 13:07:27.667900 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 58780.9us
I20260709 13:07:27.677201 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:27.677757 16560 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:27.670382 16487 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:27.671622 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.672272 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.681258 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.682870 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:27.683413 16565 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:27.687968 16566 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
W20260709 13:07:27.689249 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 283128us
I20260709 13:07:27.696214 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:27.696391 16604 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.533s (SENT)
I20260709 13:07:27.696866 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:27.697455 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:27.698663 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 314658us
I20260709 13:07:27.699893 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.700467 16635 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:27.701272 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.701920 16639 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:27.714452 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:27.714236 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.715161 16633 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:27.715402 16632 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.716358 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.716406 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.718886 19600 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.721315 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.722406 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.724706 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:27.727972 19580 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:27.728545 19580 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:27.719579 19600 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:27.729326 19645 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:27.729404 19580 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.733847 16386 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 5, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 5 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.732393 19600 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.777973 16386 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 5 to 7, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 7 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:27.779572 16386 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.780807 16386 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.785712 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.789861 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:27.789729 16386 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 9, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:27.790373 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 91157.5us
I20260709 13:07:27.789315 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.791294 16639 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:27.791819 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 95442.7us
I20260709 13:07:27.791663 16386 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 6, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.790376 16560 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.793370 16638 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:27.793084 16386 catalog_manager.cc:5697] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 8, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.794776 16386 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 8, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 8 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:27.792841 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.789373 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:27.796814 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.797833 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.798501 16637 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
W20260709 13:07:27.800220 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.801331 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.800235 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.800889 16386 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.803053 16386 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 5 to 6, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.804297 16386 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 7, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 7 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.805999 17188 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:27.808077 16633 raft_consensus.cc:2368] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:27.808511 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.809188 16639 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:27.679318 19709 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:27.822365 16633 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:27.819868 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.819021 16454 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:27.821405 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.823740 16639 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.821833 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.823225 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.824923 16631 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:27.825711 16636 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:27.826385 17182 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:27.825954 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.827395 16386 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 5, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 5 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:27.675629 16385 rpcz_store.cc:269] 0709 13:07:11.458224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.458478 (+   254us) service_pool.cc:224] Handling call
0709 13:07:27.661486 (+16203008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:25.147087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:25.555496 (+408409us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:25.555546 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:07:25.555565 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:25.556331 (+   766us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:25.556404 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:25.556431 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:25.557116 (+   685us) tablet.cc:701] Row locks acquired
0709 13:07:25.557161 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:07:25.557332 (+   171us) write_op.cc:270] Start()
0709 13:07:25.586614 (+ 29282us) write_op.cc:276] Timestamp: P: 1783602445557270 usec, L: 0
0709 13:07:25.615963 (+ 29349us) op_driver.cc:348] REPLICATION: starting
0709 13:07:25.719035 (+103072us) log.cc:844] Serialized 2398 byte log entry
0709 13:07:26.149710 (+430675us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b180008eae0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:27.071022 (+921312us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.480316 (+409294us) write_op.cc:301] APPLY: starting
0709 13:07:27.480391 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.480570 (+   179us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.480589 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.493165 (+ 12576us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.493378 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:07:27.493421 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:27.493641 (+   220us) log.cc:844] Serialized 53 byte log entry
0709 13:07:27.493799 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.493901 (+   102us) write_op.cc:454] Released schema lock
0709 13:07:27.493939 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:27.494282 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.494308 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":494248,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":409052,"apply.run_cpu_time_us":2192,"apply.run_wall_time_us":13941,"num_ops":6,"prepare.queue_time_us":695256,"prepare.run_cpu_time_us":37925,"prepare.run_wall_time_us":906810,"raft.queue_time_us":669060,"raft.run_cpu_time_us":21358,"raft.run_wall_time_us":312552,"replication_time_us":1446038,"spinlock_wait_cycles":4781440,"thread_start_us":1169867,"threads_started":4,"wal-append.queue_time_us":275125}]]}
I20260709 13:07:27.825919 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:27.807947 19602 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.837208 16635 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:27.791544 19711 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:27.855014 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 63768.3us
I20260709 13:07:27.867005 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:27.861542 16632 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:27.785209 19696 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:07:27.860538 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:27.868495 17186 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.864437 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.869406 16635 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.808367 19697 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.860592 17180 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:27.865804 16560 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
W20260709 13:07:27.872625 16604 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.726s (SENT)
I20260709 13:07:27.829651 16386 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.871941 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.872510 16605 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:27.878455 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:27.879397 16386 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 6, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.880236 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.880765 16386 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.881887 16386 catalog_manager.cc:5697] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 6, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.884343 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:27.885871 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 157238us
I20260709 13:07:27.885442 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:27.883309 16386 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.890415 16386 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 5, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 5 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:27.892513 16530 leader_election.cc:336] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 2.079s (SENT)
I20260709 13:07:27.893157 17186 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:27.888860 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.867484 19687 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.888875 16638 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:27.888713 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:27.896461 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.897024 16631 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:27.895998 16386 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 8, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.892931 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:27.898767 16386 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 8, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:27.831645 19709 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.902228 16386 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.900727 19645 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:27.910710 16565 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:27.918998 19713 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.920750 19713 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.921110 19713 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.920457 16386 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 6, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:27.922278 16386 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.924705 16386 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 2 to 7, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 7 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:27.926513 16635 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:27.926851 16386 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:27.885983 19624 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.879076 19515 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:27.911531 19690 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:07:27.883607 19707 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.935567 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.933089 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.932560 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.936784 16639 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:27.937425 16638 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:27.936892 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.939430 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:27.940305 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.940328 16639 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.941006 16632 raft_consensus.cc:2376] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6. Re-sending same reply.
I20260709 13:07:27.931226 16386 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.860028 19604 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:27.894951 19602 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.885670 19722 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.923319 19466 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:27.947809 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 128834us
I20260709 13:07:27.942472 16386 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 7, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 7 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:27.955077 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.962810 16636 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:27.888334 19720 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.963539 19720 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.963078 16386 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
W20260709 13:07:27.943562 16530 leader_election.cc:336] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 2.190s (SENT)
I20260709 13:07:27.888955 19623 consensus_queue.cc:1059] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:07:27.895061 19560 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:07:27.960130 16638 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:27.869407 19711 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:27.991433 19623 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:27.991820 19623 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:27.992100 19457 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:27.992595 19623 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.923004 19082 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:07:27.932188 19571 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.994613 19717 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:27.994994 19571 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.916558 19517 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.995968 19517 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:27.996373 19517 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.904003 19658 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.966424 16386 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 8, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 8 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.001435 19711 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:28.002435 16633 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.952751 19515 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:27.909776 19687 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:27.978904 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.911713 19620 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:27.917105 19696 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:07:27.917729 19700 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:28.014305 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:27.882117 19697 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.016026 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:28.016613 19697 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:28.017011 19687 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:27.904637 19686 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:27.983189 19735 consensus_queue.cc:1059] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:28.020747 19719 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:28.023017 19709 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:27.963918 19720 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.910687 19367 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:27.991039 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.000809 16386 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 1 to 5, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 5 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.008404 16557 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:27.962213 19466 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.013029 16558 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:28.015059 16638 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:28.025089 16633 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
W20260709 13:07:27.977581 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 109803us
W20260709 13:07:28.029788 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 46373.4us
I20260709 13:07:28.037583 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:28.040380 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:28.040839 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:28.042529 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:28.042860 17188 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:28.042948 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.012912 19658 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:28.047782 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:28.051262 19726 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.388s	user 0.005s	sys 0.000s
I20260709 13:07:28.032140 16639 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:28.053128 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.053696 16639 raft_consensus.cc:2368] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9.
I20260709 13:07:28.054370 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.054231 19713 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.058454 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:28.059149 17180 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:28.059486 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.060671 16634 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:28.061553 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:28.065166 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 142075us
I20260709 13:07:28.065497 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.068174 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.040047 19466 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.066680 16636 raft_consensus.cc:2376] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6. Re-sending same reply.
I20260709 13:07:28.071040 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:28.071664 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:28.080776 16562 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:28.072379 16566 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:28.013080 19515 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:28.067927 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:28.077018 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.077984 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.082675 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.088387 16488 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:28.088938 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:28.090087 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:28.093334 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.094756 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.096367 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:28.098944 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.106024 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.066109 19600 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:28.069276 18818 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:28.108351 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61121.1us
I20260709 13:07:28.108439 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.115410 16636 raft_consensus.cc:2376] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7. Re-sending same reply.
I20260709 13:07:28.109807 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.116801 16487 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.113046 17182 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:28.111757 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.048866 19082 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:28.086791 19733 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:28.098048 19721 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:28.104501 19336 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:28.097489 19367 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:28.151463 16487 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:28.078388 19735 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:28.091584 19709 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:07:28.058177 19658 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.108848 19686 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:28.160979 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:28.162634 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 76833.3us
I20260709 13:07:28.163738 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.195454 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:28.078713 19700 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:28.195950 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.112030 19602 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.112102 19722 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.091311 19653 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:28.158545 16488 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:28.188660 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:28.191123 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 79843.4us
I20260709 13:07:28.108805 19711 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:07:28.192720 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.194939 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.123260 19600 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:07:28.212569 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.196983 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.111914 19604 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:07:28.197657 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:28.198668 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:28.168128 19571 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:28.178399 19695 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.169696 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.229480 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.230443 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.201120 19732 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:28.213596 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.129467 19697 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:28.189378 19336 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:28.192986 19367 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:28.264405 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.264750 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.174431 19703 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:07:28.213416 16634 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:28.225824 19739 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.286368 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.200124 19567 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:28.235685 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.289309 16638 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:28.209244 19624 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.260478 19755 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:28.263090 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.198668 19536 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:28.287468 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.234915 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.201344 19741 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:07:28.299103 16640 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:28.300266 16634 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:28.301200 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.299666 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:28.302486 16634 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:28.285748 19713 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:28.304904 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:28.290412 19739 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:28.296373 19757 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:28.333889 16638 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 11. Ops: []
I20260709 13:07:28.311137 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.338361 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.339593 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.341380 16640 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:07:28.342428 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.342901 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.343567 16485 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:28.345908 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:28.347270 19747 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:07:28.348443 19749 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:07:28.349738 19744 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:28.309310 19517 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.296442 19624 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.391319 16638 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:28.388571 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:28.405040 16632 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:28.311000 19721 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:28.460214 16483 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:28.460749 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 366033us
I20260709 13:07:28.458060 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.311094 19687 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.459748 16490 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:28.456148 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 93627.4us
W20260709 13:07:28.462313 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 285558us
I20260709 13:07:28.463850 16603 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:28.466728 16638 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:28.468405 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.468984 16484 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:28.469707 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.470624 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.471140 16637 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.344594 19515 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:28.473881 16455 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.539s (SENT)
I20260709 13:07:28.471428 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.372445 19734 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:28.476759 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.476960 17186 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:28.409458 19686 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:28.376319 19658 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:28.484761 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.482039 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.479003 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:28.483618 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.484887 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.485282 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.482613 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.355931 19580 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:07:28.466109 19643 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:28.491609 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:28.489800 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.553711 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.554524 16484 raft_consensus.cc:2368] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:28.493834 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:28.555511 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:28.556239 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62510.1us
I20260709 13:07:28.556906 19722 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:28.557731 19722 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:28.558178 19722 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:28.558401 19743 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:07:28.480034 19604 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.559810 19604 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:28.561800 19604 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:28.562245 19604 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:28.562530 19604 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:28.478238 19703 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.564966 19624 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:28.565876 19686 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.344619 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:28.352566 19367 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.567278 16488 raft_consensus.cc:606] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:28.567636 16485 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:28.568353 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.568715 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.569268 19722 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:28.569806 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.570843 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.382629 19466 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:28.548972 16487 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:28.573182 16488 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:28.460230 19721 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:28.494680 16603 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:28.549870 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:28.576028 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 81433.6us
W20260709 13:07:28.575644 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 101791us
I20260709 13:07:28.571895 16485 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:28.481559 19734 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:28.352108 19739 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:28.563231 19604 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.386075 19336 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.576936 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:28.628274 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 51401.1us
I20260709 13:07:28.486099 19653 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:28.614148 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:28.617123 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:28.612939 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:28.584877 16484 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:28.610291 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.597704 19703 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:28.479996 19697 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 13:07:28.598109 19719 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.624218 16639 raft_consensus.cc:2368] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8.
I20260709 13:07:28.615505 19643 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:28.573776 19687 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:28.643503 19561 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.642565 19604 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:28.646942 19720 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
I20260709 13:07:28.635149 19653 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.631845 16490 raft_consensus.cc:2376] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6. Re-sending same reply.
I20260709 13:07:28.649523 19561 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:28.552244 19571 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.677083 19768 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.681430 19561 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.682578 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:28.683265 17185 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:28.646726 19734 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:28.691416 19734 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.646996 19770 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:28.692039 19770 consensus_queue.cc:1243] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:28.692451 19748 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:07:28.677429 17183 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.697114 19653 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:28.647740 19721 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.702332 19721 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.674880 19517 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:28.677039 19697 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:28.656013 19720 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:28.737697 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 124861us
W20260709 13:07:28.753618 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.793172 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.793615 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:28.799623 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 187571us
W20260709 13:07:28.800329 16455 leader_election.cc:336] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.826s (SENT)
I20260709 13:07:28.826128 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:28.801071 16455 leader_election.cc:336] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.829s (SENT)
I20260709 13:07:28.839756 16634 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.840674 16636 raft_consensus.cc:2368] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9.
I20260709 13:07:28.804852 19466 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:28.834028 19703 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:28.872287 19780 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:28.684321 19643 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.885867 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1235) took 1046 ms. Trace:
I20260709 13:07:28.855342 19580 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.863957 19785 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.929885 19733 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:28.904541 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 107471us
I20260709 13:07:28.934298 16633 rpcz_store.cc:276] 0709 13:07:27.839929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.871719 (+ 31790us) service_pool.cc:224] Handling call
0709 13:07:28.885688 (+1013969us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540043ab54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:28.885807 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286969088}
W20260709 13:07:28.938104 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.856534 16455 leader_election.cc:336] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.965s (SENT)
I20260709 13:07:28.952237 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:28.952459 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 95952.9us
I20260709 13:07:28.953051 16633 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:28.953567 16455 leader_election.cc:336] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 2.031s (SENT)
I20260709 13:07:28.954010 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:28.954241 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:07:28.955547 16455 leader_election.cc:336] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 2.130s (SENT)
I20260709 13:07:28.960088 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:28.961238 16455 leader_election.cc:336] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 2.235s (SENT)
I20260709 13:07:28.961601 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:28.966184 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.972275 19580 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:28.974437 19580 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:28.978133 17183 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:28.984388 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.005549 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.006641 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.008047 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:29.011320 16557 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:29.012287 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:29.012987 16562 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:29.012938 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:29.011597 16564 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:29.013604 16561 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:29.015228 17182 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:29.015494 16561 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:29.015775 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:29.016374 16483 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:29.016485 16561 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.013967 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:29.018208 16559 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.979964 19741 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.976788 19770 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.008183 19754 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.012344 19719 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.015977 19713 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.017510 19733 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.013410 19658 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.012182 18818 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:29.039459 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.045681 16559 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:29.046362 16562 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.031138 19766 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:29.053323 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 857868us
W20260709 13:07:29.053983 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.054237 16530 leader_election.cc:400] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:29.054562 16530 leader_election.cc:403] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.055168 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:29.056445 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:29.064299 19752 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.599s	user 0.006s	sys 0.001s
I20260709 13:07:29.058647 19600 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.067010 19600 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.067366 19600 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.067704 16482 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.068058 16482 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:29.068687 16482 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.069713 16482 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.069897 19751 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.033950 19733 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.033654 19658 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.072994 19733 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.073414 19658 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.037083 18818 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.076114 19720 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:29.076499 18818 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.028605 19703 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.081023 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:29.081710 17184 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:29.086122 19798 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.051s	user 0.002s	sys 0.001s
I20260709 13:07:29.088729 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:29.083611 19772 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.466s	user 0.003s	sys 0.005s
I20260709 13:07:29.081607 19623 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.106369 17180 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:29.106751 19707 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.107165 19707 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:29.108913 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2122) took 1035 ms. Trace:
I20260709 13:07:29.109301 16563 rpcz_store.cc:276] 0709 13:07:28.073149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.073267 (+   118us) service_pool.cc:224] Handling call
0709 13:07:28.073565 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:28.173702 (+100137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.173734 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:28.174239 (+   505us) log.cc:844] Serialized 52 byte log entry
0709 13:07:28.331624 (+157385us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:28.356192 (+ 24568us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.002203 (+646011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.108526 (+106323us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b54000d3ed4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:29.108567 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.108612 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:29.108707 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.108857 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":618637,"prepare.queue_time_us":13610,"prepare.run_wall_time_us":50235,"raft.queue_time_us":657665,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":16045,"spinlock_wait_cycles":212527872,"thread_start_us":119428,"threads_started":1,"wal-append.queue_time_us":266059}
I20260709 13:07:29.110638 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:29.111424 18818 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.111785 18818 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.112128 18818 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.112366 19738 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:29.113063 19707 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.114391 19707 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.114347 19737 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.117591 19737 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:29.118292 18818 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.120090 18818 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.122948 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.059190 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:29.092938 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:29.132261 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 73135.1us
I20260709 13:07:29.133288 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.134896 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:29.142168 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:29.142802 18818 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.143296 16560 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.144017 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:29.145922 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.146000 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.146627 16637 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:29.118384 19737 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:29.152284 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 145710us
I20260709 13:07:29.153021 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.153774 19734 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.154161 18818 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.155324 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:29.155989 18818 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:29.156489 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 54318.5us
I20260709 13:07:29.156934 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:29.157584 18818 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.157866 18818 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:29.158125 18818 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.160431 17180 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
W20260709 13:07:29.157336 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 203160us
I20260709 13:07:29.164597 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:29.131754 16482 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:29.168627 16482 pending_rounds.cc:85] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 6
I20260709 13:07:29.168883 16482 pending_rounds.cc:107] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:29.169095 16482 raft_consensus.cc:2889] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.172508 16530 leader_election.cc:400] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:29.172770 16530 leader_election.cc:403] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.154207 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.180589 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.190079 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.168233 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:07:29.213511 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 71959us
I20260709 13:07:29.214394 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:29.214704 16455 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.219259 16560 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:29.157306 16603 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:29.139714 19733 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:29.223690 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 66440.4us
I20260709 13:07:29.139627 19696 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.225509 19515 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:29.213121 19751 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.228018 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:29.227110 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62574.4us
I20260709 13:07:29.227246 16637 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:29.272903 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 44272.3us
W20260709 13:07:29.276876 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.157498 19722 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:29.223708 19735 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:29.134761 19600 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:29.295732 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 67770.4us
I20260709 13:07:29.278656 16604 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:29.297823 17179 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.279460 18818 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.213850 19738 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.219910 19658 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.300153 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:29.229107 19697 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.213933 19717 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:29.303311 16455 leader_election.cc:336] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 2.215s (SENT)
I20260709 13:07:29.213696 19734 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.224640 19797 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.228840 19720 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.273927 19723 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.270541 19696 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:29.220829 19712 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:07:29.221804 19732 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:07:29.304754 19536 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.292582 19722 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:07:29.309020 19750 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:29.223526 19457 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:07:29.292904 19751 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:29.330504 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.305027 19645 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.331852 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 163684us
I20260709 13:07:29.271135 19733 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:29.228699 19516 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:07:29.310503 19697 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:29.336508 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 57908.4us
I20260709 13:07:29.406469 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:29.407533 16604 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:29.316152 19658 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.315235 19794 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:07:29.337491 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:29.337904 18818 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.307056 19703 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:29.320884 19643 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.335024 19536 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.334971 19712 consensus_queue.cc:1243] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:29.370714 19645 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.374073 19600 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.338899 19722 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.448199 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:29.449434 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:29.438097 19746 raft_consensus.cc:2764] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:29.450522 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:29.451102 16491 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:29.453606 19658 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.327597 19466 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:29.322402 19623 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:07:29.337126 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 122817us
I20260709 13:07:29.459617 19720 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:29.460155 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2095) took 1260 ms. Trace:
W20260709 13:07:29.416467 19802 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:29.432529 16482 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:07:29.460644 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:29.461659 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:29.462095 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.462226 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:29.462698 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:29.463415 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:29.368873 19751 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.410487 19697 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.463613 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.464653 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:29.434826 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.465270 16631 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:29.465512 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.419631 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:29.435997 18818 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:29.436436 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:29.427137 19786 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.556s	user 0.000s	sys 0.002s
W20260709 13:07:29.439666 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 102244us
I20260709 13:07:29.437671 19516 consensus_queue.cc:1243] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:29.440508 19732 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.409925 19733 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.438434 19643 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.445134 19536 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.446995 19645 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.460539 16636 rpcz_store.cc:276] 0709 13:07:28.200054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.213410 (+ 13356us) service_pool.cc:224] Handling call
0709 13:07:29.459950 (+1246540us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54002fc454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:29.460091 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388038400}
I20260709 13:07:29.462582 16633 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.469177 16560 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.465961 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.474045 18818 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:29.502857 16631 raft_consensus.cc:2410] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:29.474442 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.417002 19604 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.368573 19793 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.430833 19696 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.443830 19803 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.515785 19803 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.516983 16631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:29.517362 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:29.517518 16631 raft_consensus.cc:606] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:29.517841 19803 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.517863 16631 raft_consensus.cc:614] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.518429 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:29.490442 19600 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.523541 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.524084 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.524612 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.525729 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.525626 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:29.526738 16637 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:29.526913 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.527429 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.528095 16637 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:29.528748 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.528833 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.529343 16637 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:29.530231 16637 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.525547 19536 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.535399 18818 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.535945 19516 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.536571 19516 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.536816 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:29.537127 19516 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.537472 16560 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:29.538187 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:29.460120 19720 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:29.506456 16486 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:29.506726 19806 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:29.507171 19812 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:29.496695 19658 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.497440 19771 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.510464 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.554230 19771 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.554929 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:29.555935 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:29.556396 19771 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.556792 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:29.556995 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:29.514678 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2105) took 1162 ms. Trace:
I20260709 13:07:29.557299 16636 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:29.505962 19809 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:29.519371 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:29.540023 16561 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:29.540709 16564 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.560019 19751 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.560423 16483 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.560608 16631 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:29.542387 16559 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.562045 16566 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.562932 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:29.543061 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.564145 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:29.564788 16560 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:29.535535 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.545143 16486 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:29.549919 16558 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:29.515729 19696 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.572971 19767 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.550341 19720 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.500144 19643 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.560675 16640 rpcz_store.cc:276] 0709 13:07:28.352217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.353756 (+  1539us) service_pool.cc:224] Handling call
0709 13:07:28.354041 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.405762 (+ 51721us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:28.647920 (+242158us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.003988 (+356068us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.004460 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.004596 (+   136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:29.009516 (+  4920us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.154617 (+145101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.154692 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.416574 (+261882us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:29.514478 (+ 97904us) raft_consensus.cc:1685] finished
0709 13:07:29.514507 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.514625 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223604,"prepare.queue_time_us":342145,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":257985,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":24048,"spinlock_wait_cycles":27206016,"thread_start_us":517178,"threads_started":3,"wal-append.queue_time_us":204785}
I20260709 13:07:29.585870 16640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:29.586400 16640 raft_consensus.cc:606] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:29.586712 16640 raft_consensus.cc:614] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.553367 19733 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.606504 19733 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.553519 19722 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.609557 19722 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:29.570181 16483 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:29.611639 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:29.612257 16483 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.612833 16640 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:29.571053 19803 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.571026 16486 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.616864 16486 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.561898 19751 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.562181 19658 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:29.553540 19797 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:29.627283 16486 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:29.629932 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 394) took 1367 ms. Trace:
I20260709 13:07:29.630249 16486 rpcz_store.cc:276] 0709 13:07:28.262967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.263072 (+   105us) service_pool.cc:224] Handling call
0709 13:07:28.263333 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.506354 (+1243021us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54000f6a20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648d1c0 00007f063648e231 00007f063648ad8f 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c
0709 13:07:29.629692 (+123338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.629882 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50503552}
I20260709 13:07:29.584854 19812 raft_consensus.cc:697] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:29.631358 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:29.631953 16486 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:29.632239 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.610687 19536 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:29.633507 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:29.640940 16560 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.614319 19641 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:29.642740 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:29.611644 19600 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:29.645709 16565 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:07:29.643949 16636 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:29.628506 19658 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.615178 19766 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:29.659931 16560 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:29.662701 16483 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:29.663677 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:29.680526 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.693874 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 200359us
I20260709 13:07:29.694414 16483 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.696285 16485 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:29.694478 16530 connection.cc:256] RPC call timeout handler was delayed by -1.2704429949999394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2763s for a response
W20260709 13:07:29.662539 19624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.007s	sys 0.027s
W20260709 13:07:29.697103 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1476828609999075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:07:29.701231 16559 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:07:29.705631 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1344661529999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:07:29.706072 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0634429949999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2993s for a response
W20260709 13:07:29.706349 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0234151339999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:07:29.656111 19641 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.656960 19580 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:29.707093 16486 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:29.656533 19600 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.721954 19813 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.723886 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:29.724520 16559 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:29.705619 19624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.007s	sys 0.029s
I20260709 13:07:29.723099 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.662590 19797 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:29.722909 19751 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.833827 19751 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.794567 16483 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:29.836208 19797 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:29.837842 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.835244 19813 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:29.760246 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.835428 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 112955us
I20260709 13:07:29.672610 19812 consensus_queue.cc:237] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.732707 16561 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:29.860023 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.858116 19785 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.820957 19697 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.863629 19785 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.865058 16483 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.869081 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.840720 19600 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.854207 19466 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.856153 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 390) took 1815 ms. Trace:
I20260709 13:07:29.872171 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.873402 18818 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.873073 16635 rpcz_store.cc:276] 0709 13:07:28.041091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.299676 (+258585us) service_pool.cc:224] Handling call
0709 13:07:28.333282 (+ 33606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.335807 (+  2525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.335830 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.336233 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.822673 (+1486440us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b1800499780. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:07:29.854041 (+ 31368us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:29.854082 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.854163 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.855859 (+  1696us) raft_consensus.cc:1685] finished
0709 13:07:29.855888 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.856091 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19281,"raft.queue_time_us":3098,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":11723,"spinlock_wait_cycles":12789504,"thread_start_us":31188,"threads_started":1,"wal-append.queue_time_us":1501482}
I20260709 13:07:29.789896 19536 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.790020 19696 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:29.879866 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:29.882558 16483 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:07:29.864235 19751 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.891355 16483 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:29.873699 19818 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.883927 19536 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.894095 19536 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.895179 19697 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.889706 19696 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.897643 19696 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.899129 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:29.899703 16561 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:29.874696 19733 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.900995 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 533) took 1228 ms. Trace:
I20260709 13:07:29.901304 19733 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.901331 17188 rpcz_store.cc:276] 0709 13:07:28.672467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.672656 (+   189us) service_pool.cc:224] Handling call
0709 13:07:28.672953 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.851493 (+178540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.851544 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.513662 (+662118us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b2c000077c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:07:29.513998 (+   336us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.692232 (+178234us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:29.874031 (+181799us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.874585 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.874662 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.900740 (+ 26078us) raft_consensus.cc:1685] finished
0709 13:07:29.900828 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.900946 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665,"raft.queue_time_us":29929,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":1830,"spinlock_wait_cycles":5586688,"thread_start_us":531298,"threads_started":3,"wal-append.queue_time_us":320491}
I20260709 13:07:29.880404 19600 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.905821 19600 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.906468 16482 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.880185 19732 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.907689 19600 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.908514 16482 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:29.910763 19813 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.912060 16562 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:29.877714 19466 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.920532 19734 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.935168 16486 raft_consensus.cc:606] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:29.927405 16483 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:29.928869 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2115) took 1072 ms. Trace:
I20260709 13:07:29.930311 16488 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:29.930972 19686 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.933401 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:29.901841 19733 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:29.940881 19733 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.941505 19785 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:29.942624 19797 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.912328 19641 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.898936 19658 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.936898 16488 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:29.966259 16488 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.935554 16486 raft_consensus.cc:614] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.967491 16488 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:29.945683 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65899.8us
I20260709 13:07:29.969413 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:29.959167 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.935478 19734 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:29.937284 16633 rpcz_store.cc:276] 0709 13:07:28.856108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.976208 (+120100us) service_pool.cc:224] Handling call
0709 13:07:29.462418 (+486210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.501695 (+ 39277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.928701 (+427006us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54002fc450. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:29.928817 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117604736}
I20260709 13:07:29.971660 19766 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:29.972445 19766 consensus_queue.cc:1243] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:29.972903 19766 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.973217 19766 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:29.974016 19766 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.974387 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:29.974622 19658 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:29.975061 19766 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.975200 19658 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.975697 19658 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:29.976277 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.977185 16558 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.977018 19600 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.977237 19643 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.977865 19600 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:29.976496 19658 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:29.978314 19600 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.981773 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.977545 19515 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:29.965401 19821 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:07:29.969370 19755 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.986819 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.987926 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:29.990443 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:29.991971 16488 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:29.992339 16488 pending_rounds.cc:85] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 4
I20260709 13:07:29.992522 16488 pending_rounds.cc:107] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:29.992810 16488 raft_consensus.cc:2889] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.985026 19813 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:07:29.996647 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:29.987859 19515 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.005213 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:29.989213 19751 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.000560 19709 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:30.001082 19723 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.944535 19686 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:29.990235 19732 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.009047 17188 raft_consensus.cc:2368] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:29.986893 19755 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.010217 17180 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:29.996924 19457 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:30.011337 19709 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.018499 19755 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.019130 19709 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:30.000516 19734 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.021440 19734 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.012187 19643 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.015523 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.015944 19367 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:30.016181 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:30.022792 19823 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 13:07:30.023340 17183 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:30.016346 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.025134 19367 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.027135 19367 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:30.012996 19723 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:30.028806 17188 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:30.060899 18818 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.069702 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.043301 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:30.030788 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.028676 17182 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.072958 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:30.042389 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.074988 18818 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:30.073092 19732 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:30.078392 19732 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.010521 19797 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.087692 18818 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.094005 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2096) took 1882 ms. Trace:
I20260709 13:07:30.094465 16634 rpcz_store.cc:276] 0709 13:07:28.211188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.302932 (+ 91744us) service_pool.cc:224] Handling call
0709 13:07:28.839580 (+536648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.840206 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.093827 (+1253621us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54003264d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:30.093951 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233583872}
W20260709 13:07:30.072981 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.097113 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.099354 17179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 649) took 1234 ms. Trace:
W20260709 13:07:30.103820 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.090549 19643 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.104354 19711 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.150599 19711 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:30.151288 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.121884 19737 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.125036 19686 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.156989 19711 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.158538 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.158703 16484 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:30.159107 17186 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:30.160118 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:30.160828 19561 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.161293 19711 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.161749 19711 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.162132 19711 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.164537 19739 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.129978 19797 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.130903 19751 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.132278 19733 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.169418 16632 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:30.169872 19733 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.137377 16488 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:30.092881 19785 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:30.138048 16483 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:30.138621 16482 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:30.175225 16490 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:30.177019 19600 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.143707 17179 rpcz_store.cc:276] 0709 13:07:28.865123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.868206 (+  3083us) service_pool.cc:224] Handling call
0709 13:07:28.868496 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.304486 (+435990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.099175 (+794689us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54004a6d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:30.099306 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986915200}
I20260709 13:07:30.160990 16454 leader_election.cc:400] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:30.180176 16454 leader_election.cc:403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:30.139199 16634 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:30.142614 16637 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:30.180997 16637 pending_rounds.cc:85] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 6
I20260709 13:07:30.181241 16637 pending_rounds.cc:107] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:30.181468 16637 raft_consensus.cc:2889] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.149695 19643 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.104242 19735 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:30.225899 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:30.227195 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:30.229434 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:30.236286 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:30.196965 19759 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.236920 16482 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:30.116530 19723 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:30.261157 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 264562us
I20260709 13:07:30.262308 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.234232 19737 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:07:30.234386 19766 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:30.242532 19600 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.265393 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:30.295043 16633 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:30.267645 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.273690 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.296053 16632 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:30.296758 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.298112 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:30.298992 19813 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.299270 19751 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.299625 19813 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.300169 19813 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.305786 16561 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.305895 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.272043 19723 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.248417 19700 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:07:30.309747 19643 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.293759 19367 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.281075 19812 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.311916 19711 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.312904 19766 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:30.306799 19813 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.317553 19759 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:30.320267 16566 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:30.320276 16565 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:30.322594 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.362689 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.363350 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.323467 19775 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.323612 16487 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:30.325673 19804 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.945s	user 0.002s	sys 0.000s
I20260709 13:07:30.329107 16563 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:30.329867 16564 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:30.331892 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:30.383355 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:30.334564 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:30.384861 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:30.336351 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.386317 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:30.387297 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.336970 19696 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:30.338394 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.307631 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.307384 19733 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:30.388701 19733 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:30.389690 19733 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.388100 19696 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:30.340343 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.391227 19696 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.392412 19696 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.343070 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.393913 16638 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:30.352155 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.364990 16559 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:30.380319 19803 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.347463 19709 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.349575 19768 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.380882 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.350826 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:30.400907 16636 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:30.404279 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 53545.8us
I20260709 13:07:30.378086 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.405767 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2111) took 1550 ms. Trace:
I20260709 13:07:30.406152 16639 rpcz_store.cc:276] 0709 13:07:28.855098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.855210 (+   112us) service_pool.cc:224] Handling call
0709 13:07:28.863307 (+  8097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.863574 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.863599 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.873651 (+ 10052us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.276039 (+402388us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:29.276076 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.276136 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.325153 (+1049017us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:30.398567 (+ 73414us) raft_consensus.cc:1685] finished
0709 13:07:30.398586 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.405702 (+  7116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155253,"raft.queue_time_us":44756,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10555,"spinlock_wait_cycles":12502272,"thread_start_us":301245,"threads_started":1,"wal-append.queue_time_us":394125}
I20260709 13:07:30.351909 19766 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:30.406498 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:30.420888 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 249685us
I20260709 13:07:30.351698 19367 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.429488 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:30.419721 16483 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:30.430958 19536 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.420894 19703 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.439707 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.413339 19845 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.441713 19812 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.443897 19536 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.447126 19600 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:30.447896 19813 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:30.430835 19658 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.453361 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.398300 19775 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.406849 19803 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.411158 19768 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.460712 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:30.462803 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 231103us
I20260709 13:07:30.462010 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.410706 19709 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.468266 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.472787 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.474037 16638 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:07:30.474484 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.475004 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.475595 16638 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:30.477560 16632 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.478111 16455 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:30.464473 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.483433 17183 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:30.486119 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.486750 16529 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.454360 19703 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:30.484342 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.491122 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.510917 16633 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:30.511325 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:30.510514 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:30.512212 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:30.512506 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.513819 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:30.466883 19813 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:30.514133 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:30.468079 19845 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.535244 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:30.535941 16482 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:30.537189 19845 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.536510 19848 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:30.557348 19844 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:30.538365 19813 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.561589 19739 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.534862 19641 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.562088 19712 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.562904 19656 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:30.455108 19766 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.566104 19745 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:30.567364 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 399) took 1432 ms. Trace:
I20260709 13:07:30.594376 16631 rpcz_store.cc:276] 0709 13:07:29.134551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.518838 (+384287us) service_pool.cc:224] Handling call
0709 13:07:29.519063 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.561005 (+ 41942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.567146 (+1006141us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b54000fc3d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:30.567315 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94892800}
I20260709 13:07:30.567497 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:30.595661 17186 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.569265 19788 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:30.570700 19812 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:30.572402 19839 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.585s	user 0.003s	sys 0.000s
I20260709 13:07:30.578388 19709 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.534157 19686 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:30.514652 19643 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:30.548596 19703 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.579382 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.606254 17183 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:30.562994 19367 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:30.562140 19711 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.579167 19855 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.599711 19766 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.591588 19712 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:30.610515 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 205586us
I20260709 13:07:30.594169 19745 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:30.569262 19818 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:30.615005 17186 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:30.616580 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:30.618069 19709 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.618551 19709 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:30.619472 19709 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.622308 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:30.622750 19697 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:30.623034 19785 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.623488 19785 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.623339 19697 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.624022 19785 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.591343 19739 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.624107 19536 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:30.626044 19739 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.617002 19712 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.657588 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:30.626345 19697 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.635044 19711 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:30.670713 19768 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.618482 19745 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.685021 19768 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:30.694046 19745 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.695811 19751 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.703678 19845 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.694445 19768 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:30.712558 19785 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.716185 19785 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.712767 19768 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.718344 19739 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.725180 19835 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:30.725629 19835 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:30.726553 19835 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.727558 19835 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.762604 16485 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:30.764582 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:30.764935 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:30.536840 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:30.767706 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:30.769138 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:30.537406 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54139.8us
I20260709 13:07:30.599359 16565 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:30.774709 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.778162 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.627120 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:30.781175 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 154001us
I20260709 13:07:30.787509 18818 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.789518 19536 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.719718 19739 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.797031 19536 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:30.798831 19536 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.803751 19751 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:30.804039 19733 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.807458 16633 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.807721 16637 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:30.807636 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.810051 19732 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.811000 19711 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:30.808552 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.813933 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:30.815021 19732 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.815418 19732 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.815764 19732 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.818485 19697 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:30.828109 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1887) took 2358 ms. Trace:
I20260709 13:07:30.828689 16487 rpcz_store.cc:276] 0709 13:07:28.469341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.573326 (+103985us) service_pool.cc:224] Handling call
0709 13:07:28.619867 (+ 46541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.364012 (+1744145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.811603 (+447591us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54002e31d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:30.827881 (+ 16278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3917661440}
I20260709 13:07:30.828200 19733 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.832823 19733 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.845211 19733 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.851120 19367 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:30.851702 19690 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:07:30.852916 19686 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:30.852291 19561 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:30.862072 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:30.869427 19775 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.870965 19735 raft_consensus.cc:993] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:07:30.871683 19735 raft_consensus.cc:1081] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
W20260709 13:07:30.891016 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76636us
I20260709 13:07:30.898479 16482 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:30.899485 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:30.903889 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 90115us
I20260709 13:07:30.902027 19803 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.913082 16491 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:30.913203 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54268 (request call id 13) took 1271 ms. Trace:
I20260709 13:07:30.913569 16486 rpcz_store.cc:276] 0709 13:07:29.642179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.723745 (+ 81566us) service_pool.cc:224] Handling call
0709 13:07:30.912846 (+1189101us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002d6c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636485853 00007f063b45360a 00007f06349d97d4 00007f06349d9762 00007f06349d9691 00007f06349d960c 00007f06349d88c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:30.913000 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230752512}
W20260709 13:07:30.916697 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.916914 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:30.918231 19367 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:30.912528 16485 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.920083 19367 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:30.922926 19853 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.306s	user 0.000s	sys 0.000s
I20260709 13:07:30.923285 16483 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:07:30.932413 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.934325 19732 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.935883 19735 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.944552 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.943775 19735 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.948390 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.946682 19735 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:30.950174 16633 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.936429 19866 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.952172 19866 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.955349 19866 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:30.937076 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.941859 19466 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.956714 19866 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:30.957617 19866 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.958422 19768 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.959539 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:30.960443 19866 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.963541 19782 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.967710 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 455018us
I20260709 13:07:30.965368 19697 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.968317 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44164.4us
I20260709 13:07:30.973379 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:30.981534 19785 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:30.982339 19785 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:30.983980 19697 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.986429 19697 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:30.987010 19835 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:30.989641 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:30.991003 19866 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.991829 19782 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:30.992762 19785 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:31.012663 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.014194 19697 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:31.015254 19697 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.015595 19697 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:31.016444 16636 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:31.016682 18818 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:31.016752 19697 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.017887 18818 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.018291 18818 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:31.018584 19697 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.016330 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.023208 19567 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.023115 19845 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.025177 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:31.015503 19835 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:31.019205 18818 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.032501 19845 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.020911 16604 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:31.023736 19567 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:31.006775 19785 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:31.040262 19686 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:31.040750 19561 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:31.041929 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:31.042888 19643 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.043339 19643 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.043711 19643 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.048681 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.049631 19835 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.050177 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.051353 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:31.052117 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 540756us
I20260709 13:07:31.055727 19835 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.056052 19466 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.056746 19466 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.057898 19732 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.058949 19466 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:31.061232 19466 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:31.061762 19792 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:31.062852 19466 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.063220 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:31.063256 19466 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:31.068512 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.066429 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.069216 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.071241 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.071842 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:31.033288 19712 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.073482 16487 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:31.074862 18818 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.077493 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.077697 16482 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:31.078744 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.077530 16490 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:07:31.079579 16490 pending_rounds.cc:85] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 3
I20260709 13:07:31.038026 19367 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:31.081918 16485 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:07:31.082140 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.084117 16486 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:31.079916 16490 pending_rounds.cc:107] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:31.085208 16490 raft_consensus.cc:2889] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.072546 19711 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.087393 16483 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:31.075280 19835 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.087466 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:31.090390 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 94124us
I20260709 13:07:31.087448 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.087893 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.089148 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.092265 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.092514 19878 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:31.093734 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.094528 16561 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:31.094790 16491 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:31.094609 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.097585 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.100488 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.100284 16482 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:31.097493 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.105659 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:31.106115 16485 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:31.106349 16565 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:31.105804 19875 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:07:31.108837 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:31.109665 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.111824 17183 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:31.100150 19782 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.114432 16487 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
W20260709 13:07:31.116326 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.116549 16633 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:31.116428 19686 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.118654 19686 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.119017 19686 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.120761 17182 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:31.087886 19567 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:31.127735 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 71936.8us
I20260709 13:07:31.131466 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.131271 19782 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.140094 19782 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.142059 19782 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:31.110265 19466 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.144977 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.146117 19567 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.146611 16557 raft_consensus.cc:2410] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:31.143508 19835 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.155776 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:31.159008 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54506.5us
I20260709 13:07:31.160205 19845 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.160943 19845 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.148298 19782 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:31.150884 19835 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.161600 19782 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.166378 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:31.161645 19835 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.168030 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.169554 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.170306 16561 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:31.171588 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.172493 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:31.170228 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 69860.1us
I20260709 13:07:31.178342 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.175338 18818 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.184418 19732 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.184974 19732 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.185657 18818 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.186620 16564 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:31.188001 18818 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.188970 19466 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.186872 19732 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:31.189530 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53959.6us
I20260709 13:07:31.190448 19732 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:31.191267 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.151960 19712 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.192552 19803 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:31.191969 19732 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:31.193171 19803 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.193897 19643 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.195152 19803 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.196152 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.196346 19643 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.198550 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.198889 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:31.199493 16631 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.201117 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.201730 16485 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:31.202692 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.202930 17179 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.203413 16482 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:31.200529 19643 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.208076 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.217188 18818 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:31.219985 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 48982.4us
I20260709 13:07:31.231770 16631 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:31.195650 19803 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.163694 19782 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.238582 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.233022 19845 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.247128 19845 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.247925 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.248620 16635 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:31.249280 19517 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:07:31.169852 19735 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:31.254698 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 46386.2us
I20260709 13:07:31.148424 16388 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.255466 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:31.205915 19643 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:31.191948 19868 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:31.258623 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.264545 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.281594 16558 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:31.282342 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 50808.4us
I20260709 13:07:31.285858 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.289369 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.289335 16633 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:31.291393 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:31.237283 19686 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.192199 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:31.299144 16487 raft_consensus.cc:606] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:31.303764 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:31.279197 19733 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.306249 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.263074 19803 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.310948 16487 raft_consensus.cc:614] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.310799 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:31.277171 19735 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.312764 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:31.321391 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.322566 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.322806 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:31.324002 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.324586 16488 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:31.324999 16482 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.325955 16488 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:31.326141 16482 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.327473 16482 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:31.265507 19868 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.329500 16388 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:31.333235 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 158240us
I20260709 13:07:31.336048 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:31.337284 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:31.338089 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:31.338558 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 54392.2us
I20260709 13:07:31.339357 19813 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:07:31.341332 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:31.342478 19686 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.318087 16557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:07:31.317926 19367 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:31.344987 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.344465 16557 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.349969 16557 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.360349 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.336499 19768 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.334301 19697 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.367744 16455 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.348747 19782 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:31.349231 19367 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.370865 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:31.378022 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:31.378638 16487 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.381547 19735 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.383499 19803 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.384408 19782 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:31.385530 19782 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.386008 16487 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:31.366551 19768 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.392517 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:31.393836 16565 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:31.369166 19517 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.401361 17153 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:31.404628 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:31.373888 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.374574 19367 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:31.409641 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 116880us
I20260709 13:07:31.412576 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.414355 16605 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:31.396579 19768 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:31.419034 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.421059 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 79104.3us
I20260709 13:07:31.396057 19866 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.422597 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.361043 19643 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.438325 19877 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.438895 19877 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.439216 19877 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:31.440056 19886 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:07:31.418962 19889 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:07:31.428925 19697 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:31.444832 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 90336.7us
W20260709 13:07:31.420121 19892 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:31.413355 19517 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:31.413795 19775 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.460475 19775 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:31.460904 19775 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.460994 19517 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.445608 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:31.463339 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.461591 16558 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:31.438422 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:31.464008 16558 pending_rounds.cc:85] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 8
I20260709 13:07:31.464167 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.464347 16558 pending_rounds.cc:107] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:31.464706 16558 raft_consensus.cc:2889] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:31.444753 19893 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:31.464370 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.472596 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.483647 16561 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:31.476171 19690 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.491526 16558 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:31.474795 19686 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.474474 19656 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:07:31.499213 19895 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:31.499778 19895 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:31.498257 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 70659.9us
I20260709 13:07:31.499944 19656 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.460166 19835 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.503232 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:31.503961 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:31.504367 16388 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 5 to 7, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 7 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:31.505457 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 239) took 6463 ms. Trace:
I20260709 13:07:31.507253 19712 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.509964 19868 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.516955 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.517699 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.517985 19641 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.532543 16631 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:31.495769 19690 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.540732 16558 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:31.540840 16557 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.547006 16563 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.515532 19656 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:31.533613 19712 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:31.545101 19690 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.564946 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.568943 16557 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.537365 19785 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:31.580684 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.584649 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.585518 19895 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.585641 19703 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.586589 19766 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.587177 19641 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:31.587951 19739 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:31.589782 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:31.587078 19766 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.588478 19739 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:31.606243 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55342.7us
I20260709 13:07:31.607211 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:31.611470 19895 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:31.611929 19567 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:31.615947 19877 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.617966 19877 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:31.623989 19845 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:31.624747 19711 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.625180 19711 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.625536 19711 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.626497 19845 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:31.629213 19656 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.630367 19656 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.611945 19755 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.632896 19755 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.633461 19695 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:31.633865 19695 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:31.634894 19755 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.634697 19695 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.640902 16388 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.642762 16388 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.612156 19895 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.649070 19835 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.649422 19895 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.651022 19686 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:31.656642 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:31.522130 16386 rpcz_store.cc:276] 0709 13:07:25.042128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.133905 (+ 91777us) service_pool.cc:224] Handling call
0709 13:07:31.505239 (+6371334us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:28.692703 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:28.693252 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:28.693296 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:28.693317 (+    21us) tablet.cc:662] Decoding operations
0709 13:07:28.696820 (+  3503us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:28.696876 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:28.696902 (+    26us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:07:28.931170 (+234268us) tablet.cc:701] Row locks acquired
0709 13:07:28.931187 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:07:28.935484 (+  4297us) write_op.cc:270] Start()
0709 13:07:28.944275 (+  8791us) write_op.cc:276] Timestamp: P: 1783602448931294 usec, L: 0
0709 13:07:28.944298 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:28.972236 (+ 27938us) log.cc:844] Serialized 11520 byte log entry
0709 13:07:29.374496 (+402260us) op_driver.cc:464] REPLICATION: finished
0709 13:07:29.609269 (+234773us) write_op.cc:301] APPLY: starting
0709 13:07:29.609348 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:29.609889 (+   541us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:29.610037 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:29.674011 (+ 63974us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:29.674355 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 13:07:29.674396 (+    41us) write_op.cc:312] APPLY: finished
0709 13:07:29.674852 (+   456us) log.cc:844] Serialized 200 byte log entry
0709 13:07:29.675007 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.675212 (+   205us) write_op.cc:454] Released schema lock
0709 13:07:29.675270 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:29.700287 (+ 25017us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.707506 (+  7219us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7860,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":234479,"apply.run_cpu_time_us":5903,"apply.run_wall_time_us":85690,"num_ops":30,"prepare.queue_time_us":462891,"prepare.run_cpu_time_us":30315,"prepare.run_wall_time_us":342245,"raft.queue_time_us":249560,"raft.run_cpu_time_us":41602,"raft.run_wall_time_us":156524,"replication_time_us":423847,"thread_start_us":437479,"threads_started":4,"wal-append.queue_time_us":62475,"wal-append.run_cpu_time_us":13886,"wal-append.run_wall_time_us":1648604}]]}
I20260709 13:07:31.663040 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:31.663621 16484 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.663820 19877 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.663192 16636 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.663558 16634 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:31.663684 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:31.663960 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:07:31.666617 16488 raft_consensus.cc:606] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:31.666923 16488 raft_consensus.cc:614] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.672504 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.665884 16632 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.665174 16484 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:31.675511 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:31.677747 16561 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.680192 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:31.612607 19567 consensus_queue.cc:1243] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:31.689628 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.691282 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:31.685559 19917 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:07:31.692616 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.694969 16561 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:31.701968 18818 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:31.703226 18818 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.704257 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.705914 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.706157 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.706694 16559 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:31.701646 16484 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.707145 19703 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.689801 19732 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.687350 19733 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.690356 19643 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.689067 19835 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.709484 16484 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.716141 18818 consensus_queue.cc:1243] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:31.708881 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:31.748638 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.701753 16388 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.756654 18818 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.756973 18818 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:31.757048 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.703187 19813 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:31.709156 19695 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.709295 19845 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.709018 19735 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.763384 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:31.764097 18818 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.765029 16566 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.665534 19712 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.718271 19367 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.766794 19908 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.767220 19868 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:31.766993 19775 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.847558 18818 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.767764 19869 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:31.759826 19703 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:31.769335 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 149256us
I20260709 13:07:31.754928 19643 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:31.761231 19813 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:31.848753 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 78955.1us
I20260709 13:07:31.849602 16557 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.843029 16388 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 6 to 7, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 7 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.852811 16605 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:31.775080 19755 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:31.865520 19739 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.865415 19755 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.774632 19877 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:31.856993 19813 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.866999 19466 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.867398 19466 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:31.868227 19466 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.869311 19466 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.869926 16388 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 5 to 8, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:31.839985 19732 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:31.872517 19732 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.874426 19732 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.871582 16388 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 3 to 4, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.877835 19913 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.878252 19913 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:31.879050 19913 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.881138 19813 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.882946 19813 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:31.855764 16561 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:31.857404 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:31.856189 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:31.858937 19745 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:31.860232 19911 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:31.862310 19785 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.851967 19735 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:31.864199 19898 log.cc:927] Time spent T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:07:31.864516 19908 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.887430 17182 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:31.923940 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.900939 16566 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:31.883203 19755 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:31.879595 16388 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 4 to 6, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 6 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:31.909875 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 53750.4us
W20260709 13:07:31.912204 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 323360us
I20260709 13:07:31.773298 19733 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:31.919907 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.942204 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:31.944213 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 271414us
W20260709 13:07:31.942252 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 235208us
I20260709 13:07:31.941817 16388 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 3 to 7, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 7 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.943276 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.949647 16635 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
W20260709 13:07:31.951702 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 300302us
I20260709 13:07:31.956225 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:31.963059 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.855489 19925 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:07:31.951370 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.963730 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.971980 16637 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:31.948843 19913 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.971143 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 113820us
I20260709 13:07:31.972179 16634 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:31.911245 19868 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.975148 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.955385 19739 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.922245 19877 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.922784 19869 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:31.992926 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:31.995973 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:31.994633 19755 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.997110 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:31.984165 19745 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.998786 19703 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:31.999648 19517 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.999876 19867 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.001276 19910 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:32.002454 19918 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:07:31.983480 19766 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.020655 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:31.983312 19866 consensus_queue.cc:1059] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:32.017313 19755 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:32.036921 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64761.6us
I20260709 13:07:32.024372 19739 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.035727 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.038869 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:32.038992 19927 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:07:32.040581 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:32.023737 19923 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:32.043864 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69463us
I20260709 13:07:32.044742 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:32.056955 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:32.017992 19934 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.984722 19643 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.039652 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:32.040169 19755 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.066018 16558 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:32.066648 16566 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:32.063421 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:32.068956 16639 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:32.068364 16489 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:32.058211 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76760us
W20260709 13:07:32.069489 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 60705.2us
I20260709 13:07:32.068320 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.073980 16561 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.025950 19745 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:32.080533 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 83486.5us
I20260709 13:07:32.077217 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:32.082926 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:32.061595 19367 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:32.091097 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 46439.4us
I20260709 13:07:32.068666 19766 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.080499 19866 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.127418 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:32.129104 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45017.3us
I20260709 13:07:32.104975 19766 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:32.128373 19690 consensus_meta.cc:287] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
W20260709 13:07:32.143934 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 47353.2us
I20260709 13:07:32.113351 19735 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:32.175519 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.177526 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:32.126288 19866 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:32.137135 19845 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.140292 19643 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.195922 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.081041 19923 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.145583 19766 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.199158 19735 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:32.200508 19745 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:32.201401 19931 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:07:32.204212 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 97495.1us
I20260709 13:07:32.204274 16484 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:32.205375 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.209024 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:32.258328 16490 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.258626 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:32.259344 16484 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:32.282145 16632 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.002s
I20260709 13:07:32.282666 16632 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:32.192677 19866 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:32.289459 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 206590us
I20260709 13:07:32.289594 16564 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.184131 19733 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:32.182965 19775 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.290645 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.180554 19690 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.282079 19877 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:32.315429 16484 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:32.289285 19868 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:32.324255 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 63569.3us
I20260709 13:07:32.294660 19869 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.334029 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:32.337116 19940 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.337579 19940 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:32.337921 19940 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.339107 19942 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.211s
W20260709 13:07:32.340287 19935 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:07:32.340636 19933 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:07:32.341814 19926 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:07:32.289918 19924 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.265s
I20260709 13:07:32.345908 19712 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.320123 19367 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.350817 19367 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.352892 19367 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.353084 16490 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:32.354589 19916 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:32.389889 16489 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:32.396520 19938 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.393857 19951 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:07:32.398312 19712 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:32.398695 19712 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:32.399497 19712 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.400813 19712 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.355698 19916 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:32.405646 19695 consensus_meta.cc:287] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.000s
I20260709 13:07:32.406014 19916 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:32.408035 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.416070 19768 consensus_meta.cc:287] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.963s	user 0.009s	sys 0.001s
I20260709 13:07:32.416483 19768 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.418493 19768 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:32.419433 19938 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:32.420487 19938 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:32.423386 19711 consensus_meta.cc:287] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.002s
I20260709 13:07:32.429562 16561 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:32.437203 16488 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:32.438745 16564 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:32.441232 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:32.436735 19656 consensus_meta.cc:287] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.000s
I20260709 13:07:32.442389 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.442979 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.444235 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.445482 16561 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:32.425134 19690 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.449045 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.449326 16557 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:32.449347 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.452095 19927 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:32.455286 19927 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:32.455461 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 348132us
I20260709 13:07:32.423768 19711 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.460255 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:32.461369 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:32.461910 17183 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:32.463828 19923 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:32.470036 16557 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:32.472299 19945 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.472790 19945 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.476197 19966 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:32.476676 19966 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.478714 19966 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.479148 19966 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.481003 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:32.481550 16484 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 6.
I20260709 13:07:32.484593 16483 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:32.485775 19867 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.486137 19867 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:32.486873 19867 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.489125 19927 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:32.491029 19945 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.479557 19966 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.494743 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:32.495839 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:32.497360 19895 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.497611 19963 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.498705 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:32.497315 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:32.565330 16557 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:32.566732 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:32.570003 16374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 68605.8us
I20260709 13:07:32.570186 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.501457 19963 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.570778 19963 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:32.571116 19963 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.571350 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.574193 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:32.563112 19966 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.578282 19866 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.580376 19940 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.580299 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:32.587172 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:32.589227 19940 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.592569 19963 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.594201 19766 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.567328 19867 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.626708 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:32.627295 16491 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:32.607107 19965 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.586292 19948 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:32.608385 19866 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.600095 19945 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.612008 19966 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:32.612610 19711 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:32.614634 19927 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:32.617695 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.691401 16565 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:32.619539 19732 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:32.620190 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.620316 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:32.620949 19925 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.621368 19835 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.621937 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:32.623690 19878 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:32.715740 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.690791 19966 consensus_queue.cc:1243] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:32.710831 19866 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:32.652671 19965 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:32.713613 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 93361.8us
I20260709 13:07:32.722159 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:32.723304 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:32.595858 19755 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:32.714927 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 93062us
W20260709 13:07:32.653179 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 448125us
I20260709 13:07:32.717394 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:32.719632 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 371293us
I20260709 13:07:32.730597 18818 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.716023 19733 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:32.720070 19561 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:32.693030 19945 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.739128 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:32.743132 17182 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:32.741664 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:32.744616 17183 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:32.709800 19927 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.715188 19732 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.748775 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.750133 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:32.726823 19965 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.725426 19942 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:07:32.753346 16559 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:32.718014 19835 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.764537 19932 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:32.733423 19867 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.761457 16557 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:32.761987 19733 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:32.725849 19866 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.711895 19948 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.769869 19755 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.722487 19925 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:32.771364 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47045.5us
I20260709 13:07:32.750926 19561 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:32.727404 19878 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.783262 16565 pending_rounds.cc:85] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:07:32.787034 16565 pending_rounds.cc:107] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:32.787281 16565 raft_consensus.cc:2889] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.788605 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:32.786440 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.789842 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:32.793068 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.793610 16560 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.793211 19733 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:32.797890 19972 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:07:32.798642 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 57347.1us
I20260709 13:07:32.800559 19945 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:32.806315 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.808058 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.808573 16640 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:32.811992 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:32.812606 16561 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:32.813597 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.785843 19766 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:32.785697 19877 raft_consensus.cc:2764] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:32.822772 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.823311 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.826803 18818 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:32.821784 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:32.823885 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:32.782208 19561 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:32.866767 16639 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.870412 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:32.819763 19567 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.871841 19949 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:07:32.874164 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:32.875015 18818 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:32.885618 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 63919.2us
I20260709 13:07:32.886363 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:32.888455 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.859593 19963 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:32.893419 16560 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:32.893493 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:32.868345 19942 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.874485 19766 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.887331 19567 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:32.898201 19877 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:32.965284 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 67411.7us
W20260709 13:07:32.966066 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.121726 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 235444us
I20260709 13:07:33.058935 16636 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:32.901072 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:33.130729 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:33.130950 16604 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:33.071664 19845 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.132426 19845 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.133414 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.133883 16485 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:33.134300 19845 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.136026 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.138465 16640 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:33.022888 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:33.141642 16491 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:33.142211 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:33.168499 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.145787 16635 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:33.165431 16558 raft_consensus.cc:2393] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:33.011426 19930 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.353s
I20260709 13:07:33.070250 19986 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.238034 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:33.170639 17183 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:33.113550 19945 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.283911 16490 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:33.113637 19908 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.128881 19877 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:33.361426 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 230552us
I20260709 13:07:33.375965 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:32.903160 19988 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.127744 19866 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.093127 19703 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:33.284300 19987 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.911980 19766 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.363675 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:32.903007 19709 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.525s
I20260709 13:07:33.382944 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:33.237741 19927 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.138785 19942 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.246s
I20260709 13:07:33.357739 19845 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.368140 19982 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.131276 19925 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.383455 19877 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.412916 16566 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:33.421521 16437 auto_rebalancer.cc:893] Removing replace marker failed: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:33.422839 19989 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
I20260709 13:07:33.379097 19466 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.387436 19733 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:33.430990 16437 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:33.431133 19732 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.407232 19987 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:33.438962 16437 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:07:33.493256 16531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.010s	sys 0.073s
I20260709 13:07:33.428104 19927 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.569917 19966 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.438534 19925 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.438858 19733 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:33.570536 19966 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.571039 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1295) took 1368 ms. Trace:
I20260709 13:07:33.571450 16638 rpcz_store.cc:276] 0709 13:07:32.202361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.204287 (+  1926us) service_pool.cc:224] Handling call
0709 13:07:32.294972 (+ 90685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.744132 (+449160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.744161 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.749381 (+  5220us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.871373 (+121992us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:32.871412 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.871474 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.570835 (+699361us) raft_consensus.cc:1685] finished
0709 13:07:33.570855 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.570984 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":393803,"raft.queue_time_us":426285,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4832,"thread_start_us":174992,"threads_started":2,"wal-append.queue_time_us":270690}
I20260709 13:07:33.571017 19733 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.574663 19766 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.412161 19703 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.576944 19703 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:33.387513 19945 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.579859 19945 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:33.580207 19992 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
W20260709 13:07:33.580929 19977 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.533s	user 0.001s	sys 0.001s
I20260709 13:07:33.434002 19878 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.427172 19845 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.383958 19986 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.632369 19910 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:33.633544 19910 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.639495 19910 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.499416 19866 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.526502 19908 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.526167 19987 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.569813 19990 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.673296 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.580374 19945 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.500797 19785 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 13:07:33.675805 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.681416 16631 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:33.566310 19930 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.432637 19982 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.677390 16635 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:33.501696 19466 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:33.678820 19983 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
I20260709 13:07:33.573158 19966 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.678202 16638 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:33.692615 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.676235 19934 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:33.707870 17151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.013s	sys 0.021s
W20260709 13:07:33.684657 17153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.007s	sys 0.019s
W20260709 13:07:33.708726 17153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.007s	sys 0.019s
I20260709 13:07:33.685621 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.670974 19948 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.689901 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.570647 19925 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.678951 19845 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.699285 19982 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:33.700023 19986 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.705020 19466 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:33.677301 19866 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:33.706830 19994 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:07:33.585983 19927 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.676921 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.709005 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 577032us
I20260709 13:07:33.684800 19990 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.734031 19938 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.734557 19938 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.688824 19945 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:33.709009 16530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.017s
W20260709 13:07:33.737890 16530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.018s	sys 0.017s
I20260709 13:07:33.720755 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.739423 16635 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:33.699966 19567 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:33.721215 17152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.001s	sys 0.038s
I20260709 13:07:33.721997 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 431) took 1583 ms. Trace:
I20260709 13:07:33.677727 19908 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:33.722324 16560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.009s	sys 0.027s
I20260709 13:07:33.741017 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.736153 19991 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:07:33.709609 17151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.013s	sys 0.021s
I20260709 13:07:33.729936 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.737035 19965 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.966s	user 0.008s	sys 0.002s
I20260709 13:07:33.710472 19733 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.742458 16631 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:33.740792 16482 rpcz_store.cc:276] 0709 13:07:32.131560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.132324 (+   764us) service_pool.cc:224] Handling call
0709 13:07:32.132569 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.456156 (+323587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.456182 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.456216 (+    34us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:32.456240 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.714960 (+1258720us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002995d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:33.715007 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.715121 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743808768}
I20260709 13:07:33.744843 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.715544 16563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.017s	sys 0.023s
W20260709 13:07:33.740687 17152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.001s	sys 0.038s
W20260709 13:07:33.741902 16560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.010s	sys 0.027s
W20260709 13:07:33.745800 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 618397us
I20260709 13:07:33.746634 16454 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:33.726680 16638 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:33.707738 19934 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:33.748760 16563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.018s	sys 0.024s
I20260709 13:07:33.750664 16455 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:33.754683 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:33.757212 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:33.747516 16637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.008s	sys 0.005s
W20260709 13:07:33.747740 16633 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.006s	sys 0.008s
W20260709 13:07:33.768676 16633 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.007s	sys 0.008s
I20260709 13:07:33.760922 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:33.756881 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:33.772691 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.766358 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 390463us
I20260709 13:07:33.767053 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:33.761399 16637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.009s	sys 0.005s
W20260709 13:07:33.743301 19932 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.012s	sys 0.024s
W20260709 13:07:33.769287 16639 consensus_meta.cc:287] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.894s	user 0.008s	sys 0.000s
I20260709 13:07:33.769812 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:33.773418 16638 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:33.773898 16565 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:33.784682 16639 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
W20260709 13:07:33.785799 19999 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:33.787838 16563 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:33.789755 19866 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:33.792991 19971 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 1.067s	user 0.009s	sys 0.015s
I20260709 13:07:33.780372 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:33.768198 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:33.753489 19986 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:33.816200 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:33.811705 16532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.007s	sys 0.007s
W20260709 13:07:33.818779 16532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.008s	sys 0.007s
I20260709 13:07:33.818874 16482 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:33.798907 16631 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:33.821045 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.816200 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.768581 19966 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:33.812476 19952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.001s	sys 0.021s
I20260709 13:07:33.767444 19845 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.836758 19845 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.838791 19845 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.840230 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1296) took 1033 ms. Trace:
I20260709 13:07:33.840538 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.841372 16488 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:33.842473 19641 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.842943 19641 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:33.829277 19952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.001s	sys 0.021s
I20260709 13:07:33.827488 19986 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.847443 19990 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.855691 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.856819 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.857779 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.858294 19925 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.862401 19934 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:33.862776 19985 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.963s	user 0.000s	sys 0.008s
I20260709 13:07:33.863776 19927 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.864413 19921 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:33.865098 19945 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:33.864898 19921 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.866240 19733 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.866804 19921 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:33.867678 19908 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:33.868113 19998 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:07:33.875751 19835 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.840622 16634 rpcz_store.cc:276] 0709 13:07:32.807213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.807337 (+   124us) service_pool.cc:224] Handling call
0709 13:07:32.817705 (+ 10368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.868730 (+ 51025us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:33.240253 (+371523us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.682988 (+442735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.683032 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.683081 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.840028 (+156947us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54002c8654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:33.840070 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.840173 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39665,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5879,"raft.queue_time_us":108,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5254,"spinlock_wait_cycles":116887936,"thread_start_us":793379,"threads_started":2}
I20260709 13:07:33.877794 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.879541 19711 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.879936 19711 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:33.880447 16529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.034s	sys 0.058s
W20260709 13:07:33.880847 16529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.034s	sys 0.058s
I20260709 13:07:33.796602 19766 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.744499 19965 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.771667 19963 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.829617 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.784212 19932 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.013s	sys 0.024s
I20260709 13:07:33.827207 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.830461 16562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.006s	sys 0.008s
I20260709 13:07:33.830863 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.831372 19993 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.832216 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:33.898383 16562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.006s	sys 0.008s
I20260709 13:07:33.827128 20000 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.898413 16636 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:33.905747 16632 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:33.826452 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.887835 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:33.886540 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.906955 16482 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:33.898893 16490 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:33.907198 16491 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:33.905646 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.898968 16483 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:33.823397 19813 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.909097 16488 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:33.912827 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:33.911255 16482 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:33.912024 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.913829 16485 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:33.915365 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:33.825529 19966 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:33.914302 19766 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:33.780858 19869 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:07:33.922223 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:33.918063 19733 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.923622 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.924237 16490 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:33.847450 19986 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.917977 19766 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.929105 19766 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:33.933065 19877 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.921844 19925 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.941027 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:33.905567 19963 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.923915 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:33.923245 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 148914us
I20260709 13:07:33.943913 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:33.907476 19932 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:07:33.940371 19929 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.013s	sys 0.021s
W20260709 13:07:33.954694 19929 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.013s	sys 0.021s
I20260709 13:07:33.944739 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 412) took 1132 ms. Trace:
I20260709 13:07:33.913163 19813 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.957872 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:33.918358 19938 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:33.918182 19945 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.923259 19966 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.941897 19733 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.973888 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:33.972595 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.008836 19910 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.009035 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.015399 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.034898 16632 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:34.035928 16557 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:33.993134 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:34.016808 16605 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.028s	sys 0.018s
W20260709 13:07:34.036504 16605 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.028s	sys 0.018s
I20260709 13:07:34.018538 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:33.954960 19962 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.913491 20000 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:33.977556 19945 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:33.996737 19733 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.041435 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.020004 16565 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:34.020548 16489 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:33.919221 19993 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.972914 19813 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.947222 19963 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.977217 19835 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:34.034920 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62404.4us
I20260709 13:07:34.036649 16631 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:34.037062 16634 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:33.947903 19877 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:34.037456 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 646029us
I20260709 13:07:34.040685 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.052814 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:33.955224 16562 rpcz_store.cc:276] 0709 13:07:32.792730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.797123 (+  4393us) service_pool.cc:224] Handling call
0709 13:07:32.797408 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.810291 (+ 12883us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:32.887239 (+ 76948us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.906848 (+1019609us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.907117 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.907223 (+   106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.907255 (+    32us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:33.907307 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.918364 (+ 11057us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5400116f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:33.918405 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.925191 (+  6786us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28211,"prepare.queue_time_us":59472,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":16096,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":12689,"spinlock_wait_cycles":71469312,"thread_start_us":995436,"threads_started":2}
I20260709 13:07:33.956550 19567 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:07:34.008720 19845 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:34.050120 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 106303us
I20260709 13:07:34.054613 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:34.053750 19835 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.051273 19910 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.056700 19835 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.057793 19949 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.058358 19949 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.059242 19949 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:33.925297 19711 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.034461 19697 raft_consensus.cc:2764] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:34.061723 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:34.016772 19986 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.063552 16640 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:34.029034 19908 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.078924 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:34.041706 19945 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:34.061131 20007 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:34.042222 20006 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.086068 20006 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.086537 20006 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.086670 19965 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.088644 19965 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:34.085532 19910 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.089365 19910 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.089212 19965 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.089870 19910 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.091142 19965 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.088701 19641 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.092216 19910 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.092885 19910 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.093356 19910 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.095592 19910 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.068614 19845 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.099614 19845 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.100865 20000 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.083474 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:34.101080 19987 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:34.092278 19979 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:34.085472 19993 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.115016 19927 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.111861 19984 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.112851 19987 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.116775 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.114195 19641 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:34.117403 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.117573 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.116097 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1255) took 1493 ms. Trace:
W20260709 13:07:34.108808 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 56078.8us
I20260709 13:07:34.118196 16489 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:34.082391 19934 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.120559 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:34.121011 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.049479 19962 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.058015 20013 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:34.109138 19703 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.129169 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.103087 19986 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.130656 16558 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.131098 19986 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.131734 19845 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.132138 19845 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.132509 19845 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.131954 16489 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.135887 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:34.137530 16482 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:34.153555 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.154122 16490 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.118409 16486 rpcz_store.cc:276] 0709 13:07:32.622555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.623234 (+   679us) service_pool.cc:224] Handling call
0709 13:07:32.623583 (+   349us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:32.623967 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.623994 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:32.624649 (+   655us) log.cc:844] Serialized 78 byte log entry
0709 13:07:32.750711 (+126062us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:32.801956 (+ 51245us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.802154 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.802217 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.993248 (+1191031us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b180049a1a0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:34.115833 (+122585us) raft_consensus.cc:1685] finished
0709 13:07:34.115918 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.116038 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64253,"prepare.queue_time_us":58509,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":10696,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":7168,"spinlock_wait_cycles":8356096,"thread_start_us":125687,"threads_started":1,"wal-append.queue_time_us":181124}
I20260709 13:07:34.125504 19641 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.160728 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.162714 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:34.163589 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:34.164361 20000 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.164709 20008 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.165233 20008 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.165565 20008 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.166440 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.167006 16640 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:34.168018 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:34.174566 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.101531 19908 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.184381 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.187237 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.206233 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.207492 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 435) took 1334 ms. Trace:
I20260709 13:07:34.128285 19703 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:34.210664 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 427672us
I20260709 13:07:34.207481 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:34.211866 16482 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
W20260709 13:07:34.207840 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 478508us
I20260709 13:07:34.102767 19932 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.218909 16490 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:34.219712 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.221418 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:34.186841 19948 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.224602 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:34.225160 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:34.164749 20000 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.228916 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.208144 16633 rpcz_store.cc:276] 0709 13:07:32.872986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.875063 (+  2077us) service_pool.cc:224] Handling call
0709 13:07:32.875297 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.875483 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:33.784335 (+908852us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.207220 (+422885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.207264 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:34.207299 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.207356 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.207446 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46717,"prepare.queue_time_us":145292,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":4333,"raft.queue_time_us":33675,"thread_start_us":1260186,"threads_started":2,"wal-append.queue_time_us":387809}
I20260709 13:07:34.230122 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.149369 19986 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:07:34.232976 18818 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.213188 19703 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.212257 19768 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:34.207537 19975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.023s
I20260709 13:07:34.236378 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.218906 19561 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.221475 19993 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.242117 16486 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:34.226874 19948 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.244526 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.249233 16490 raft_consensus.cc:1217] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[4.2-8.4]   Dedup: 4.2->[6.3-8.4]
I20260709 13:07:34.244127 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.231120 20000 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.249238 16635 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:34.252326 16490 pending_rounds.cc:85] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 2
I20260709 13:07:34.255414 16490 pending_rounds.cc:107] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 13:07:34.254580 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 170822us
I20260709 13:07:34.252295 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:34.255702 16490 raft_consensus.cc:2889] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.230679 20015 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.240113 19934 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.258112 20036 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:34.258652 19925 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.258875 20026 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.250736 19993 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.254665 19948 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.269574 20026 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.266222 19766 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.261113 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1902) took 1116 ms. Trace:
I20260709 13:07:34.271945 19993 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.300009 16560 rpcz_store.cc:276] 0709 13:07:33.145080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.169319 (+ 24239us) service_pool.cc:224] Handling call
0709 13:07:33.169610 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.745963 (+576353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.745996 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.753059 (+  7063us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.206446 (+453387us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.206484 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.206546 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.260916 (+ 54370us) raft_consensus.cc:1685] finished
0709 13:07:34.260942 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.261060 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":329624,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":38296,"thread_start_us":1002500,"threads_started":2,"wal-append.queue_time_us":493112}
I20260709 13:07:34.243017 19869 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.303993 19869 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.304397 19869 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.304924 19940 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.305290 19940 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:34.306107 19940 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.307250 19940 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.299943 19766 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:34.308518 19766 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.310638 19965 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:34.273554 19641 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:34.282066 19938 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:34.285326 19963 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.268042 19934 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.269340 20028 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.275802 20026 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.266122 19910 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:34.294255 19835 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.254647 20005 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:34.254747 19561 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.300661 20012 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.265527 20015 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.334374 20012 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.335740 20015 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.280398 19962 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:34.241500 19975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.014s	sys 0.023s
I20260709 13:07:34.311143 19965 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.299645 19768 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.287488 19733 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:34.298522 20010 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:34.328336 16486 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:34.331940 19561 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.332170 19869 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.333390 19993 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.347462 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:34.349997 19711 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.354698 19766 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.358669 19966 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.360467 19963 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.361773 19845 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.363569 19965 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.364143 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.365123 19733 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.345959 19768 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.345947 19938 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:34.386520 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 123526us
W20260709 13:07:34.381136 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 151073us
I20260709 13:07:34.347132 20012 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.384141 16566 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:34.388779 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.388440 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.396134 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.396490 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.390261 16557 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.391127 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.397053 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.393684 16486 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:34.394670 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.398212 17186 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:34.344729 20006 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.400799 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.404857 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.382112 19908 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.399863 16563 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.401216 16562 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:34.399296 16489 raft_consensus.cc:2410] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:34.407245 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 187373us
I20260709 13:07:34.420357 19641 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.422916 20000 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.424932 20000 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.406942 19785 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:34.426304 19785 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.426671 19785 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.428864 19966 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.392743 19878 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:34.427700 19785 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.432368 19785 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:34.434034 20023 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 13:07:34.436107 19938 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:34.440270 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51901.1us
I20260709 13:07:34.440953 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.386807 19686 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.392099 19949 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.444514 16559 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:34.394860 20005 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.445734 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:34.445807 17183 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:34.386650 19934 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:34.386909 19952 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:34.453094 16488 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.469259 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:34.452373 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 189178us
I20260709 13:07:34.444975 16489 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:07:34.462734 16564 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:34.462775 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.466882 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.472275 16635 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:34.474246 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.475335 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.475931 16558 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.460129 19686 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.477129 19686 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.479266 16561 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:34.482026 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.449539 19877 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.482656 16489 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:34.484453 19982 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:34.427628 19948 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.476867 20015 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.488332 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.499236 16489 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
W20260709 13:07:34.496403 20038 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.214s	user 0.004s	sys 0.000s
I20260709 13:07:34.496511 19703 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.496860 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.469413 20000 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.500670 17186 raft_consensus.cc:2410] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:34.500804 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.468539 19878 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:34.469657 20041 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.494936 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.507761 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.503948 16489 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.516566 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:34.518602 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:34.509826 17188 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:34.520494 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:34.523844 16635 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:34.524379 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.525126 16562 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:34.489246 19927 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.524916 16558 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:34.529541 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:34.531612 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.531913 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:34.532255 16557 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:34.525995 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.503449 20000 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.535290 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.468678 20005 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.538534 16485 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:34.514531 19990 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.543118 16489 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:34.533710 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.544782 19703 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.548735 19990 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.549448 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:34.552034 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.553045 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.554059 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.554989 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.545315 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.556051 17181 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:34.556288 20006 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.557041 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.557832 17184 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:34.560035 19993 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.561074 19766 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.561756 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.562626 17180 raft_consensus.cc:2410] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:07:34.565999 19813 consensus_meta.cc:287] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.000s
I20260709 13:07:34.566437 19813 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.566726 19686 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.504406 20015 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.569449 20015 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.528811 20013 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.572081 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:34.573040 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:34.573123 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:34.546047 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.523540 20011 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.541637 19536 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.504295 19982 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.575850 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.469383 19949 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.537842 19733 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.538085 19695 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.538645 19835 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.540241 20000 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.499928 19877 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.571302 20008 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.561697 19948 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.581398 20044 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:34.572132 20013 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:34.578693 19703 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:34.578627 20003 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.591918 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.542147 19945 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.593880 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.581615 19733 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.597635 19733 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.598295 16635 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:34.598615 19813 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.599352 16634 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.573861 19984 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:07:34.600420 16631 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:34.600494 19949 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.596486 20003 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.602222 20003 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.606707 20005 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.578699 19567 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:07:34.609072 19982 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:34.583675 19695 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.609593 19695 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.596655 20013 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.612799 19733 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.592875 16633 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:34.616886 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.585338 19845 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.617805 16560 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.589597 20026 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.619027 17179 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:34.619946 20026 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.620880 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.622058 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.622290 19869 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.620061 17188 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.623332 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.626861 17187 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:34.627024 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.627194 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 1905) took 1433 ms. Trace:
I20260709 13:07:34.627629 16564 rpcz_store.cc:276] 0709 13:07:33.194262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.195258 (+   996us) service_pool.cc:224] Handling call
0709 13:07:33.363271 (+168013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.471876 (+1108605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.627010 (+155134us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540017ff54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:34.627145 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528123136}
I20260709 13:07:34.628640 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:34.630841 19987 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:34.640164 19987 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.631455 19934 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.641089 19984 consensus_queue.cc:1243] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:34.641335 19934 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.641826 19984 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.642154 19984 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.633460 19986 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:34.634986 20005 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.642901 19984 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.642901 19990 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.639251 19877 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.636008 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.644593 17185 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:34.642174 19934 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.645253 19934 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:34.645713 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 204818us
I20260709 13:07:34.646438 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.647512 19986 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.648811 19965 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.650141 19567 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:34.650916 19567 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:34.651207 19952 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.651717 19567 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.653365 19932 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.651734 19952 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.654592 19703 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:34.655625 19703 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:34.655249 19952 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.655915 19755 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.656376 19755 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.656726 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:34.657249 19697 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:34.656633 19942 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:34.658293 19536 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:34.658633 19536 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.658730 19703 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.659521 19536 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.660579 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.665899 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:34.668134 16638 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:34.670203 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:34.670840 17185 pending_rounds.cc:85] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 9
I20260709 13:07:34.671154 17185 pending_rounds.cc:107] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:34.678769 16529 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.652638 19984 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.679997 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:34.682083 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.683842 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.671361 17185 raft_consensus.cc:2889] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.685957 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.686522 16489 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:34.688575 16491 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:34.688874 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.689779 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:34.690177 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:34.692227 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.692812 16490 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.695225 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.695775 16482 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.696641 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:34.697594 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.698493 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.700507 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.701918 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.702512 16489 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:34.703562 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.704555 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.704756 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.704928 16631 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:34.705258 16634 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.705870 16483 raft_consensus.cc:2368] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:34.693425 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:34.704391 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.708506 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.708603 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.708830 16635 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.710635 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:34.660683 19536 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.653685 19963 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.719099 19963 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.720103 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.721416 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.647522 19908 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.722234 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.722688 20028 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:34.722983 16484 raft_consensus.cc:2410] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:34.654601 19567 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:34.725850 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.733042 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.661150 19932 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.718219 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:34.661795 19940 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:34.727672 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.728111 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:34.728375 20047 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:34.728693 20015 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.683068 19697 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.718024 19938 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.699934 20041 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:34.740573 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.749145 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:34.741537 16491 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:34.738992 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.749970 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.741503 16633 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:34.750211 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.751050 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.747066 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:34.751602 16633 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.751762 16559 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.747643 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.716377 20005 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.731411 19755 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.718552 19965 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.727005 19766 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.750592 16561 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:34.696144 20004 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:07:34.730502 19686 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.694804 20044 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:34.755195 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:34.694628 19878 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:07:34.756433 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 183460us
I20260709 13:07:34.706096 19845 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:07:34.757031 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:34.713721 19561 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:34.784292 19561 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:34.784647 19561 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:34.785351 19561 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.786545 19561 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.754318 20002 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.787948 16563 raft_consensus.cc:2393] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:34.788946 20052 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:34.747485 20015 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:34.791021 20015 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.793089 16633 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:34.797086 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.798203 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.801790 16633 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:34.802541 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.763990 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:34.734318 20028 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:34.804441 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.740460 20012 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.805219 20003 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.804410 20028 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.807322 20003 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.659638 19703 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.739645 19932 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.703627 19877 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:34.740723 19866 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.775449 16490 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:34.838248 16559 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:34.778056 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:34.749079 19938 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.783548 19845 consensus_queue.cc:1243] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:34.846170 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.790735 19766 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:34.759044 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:34.763199 16635 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:34.807960 17181 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.805418 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:34.833938 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.810726 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.820348 16634 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:34.777984 19965 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:34.726387 20011 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:34.768442 19940 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:34.744550 19835 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:34.843158 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 65186.4us
I20260709 13:07:34.849710 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.790761 20008 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:34.849323 17152 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:34.857739 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:34.848197 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.859092 16563 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:34.839244 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:34.853083 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.853758 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.838279 20003 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.839905 19755 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.846000 19938 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.864391 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.865330 16640 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:34.852350 19536 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.867033 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:34.846652 19866 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.003614 19866 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:34.869486 19766 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.864993 19835 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:34.870581 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.871053 20055 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:34.871624 19921 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.871977 20045 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.935947 16560 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:34.872033 20011 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:34.964530 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:34.927120 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:35.028112 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 101075us
I20260709 13:07:34.926858 16633 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:34.838264 19567 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:34.939112 19768 consensus_meta.cc:287] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.000s
I20260709 13:07:34.925364 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.030488 16490 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:34.930876 19788 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.939499 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.866993 19641 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.758122 20041 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.936841 20013 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:34.965255 19965 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.044401 20013 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:35.045043 16638 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.927759 20000 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.049635 20000 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.050863 19695 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.065665 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.056802 16638 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:35.171924 16484 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.070614 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.071518 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:34.950241 16565 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:34.991200 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:34.991811 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:35.001160 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:35.005774 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.097025 16636 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.062667 19733 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.006668 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:35.007211 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 140246us
I20260709 13:07:35.012379 16635 raft_consensus.cc:2410] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:35.013491 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:35.015020 16482 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:35.017444 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:35.014730 19536 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.031813 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:35.032259 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.032630 19788 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.183703 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:35.033496 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:35.033919 19768 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.035117 20041 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.037119 19952 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.038599 19641 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:35.039203 20011 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:35.040966 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:35.026086 20015 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.042553 16560 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.055081 19697 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.275978 19697 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.056658 19877 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.927105 19755 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.174691 16485 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.076035 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:35.281497 16490 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:35.281603 16483 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:35.005829 16491 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:35.176226 19766 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.175304 16640 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.056841 19940 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:35.119128 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.138389 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:35.284042 16486 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:35.165658 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:35.109903 16637 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:07:35.176843 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.134353 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.166384 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:35.286531 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.286695 16564 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
W20260709 13:07:35.287628 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 153372us
I20260709 13:07:35.092600 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:35.289709 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:35.289938 16631 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:35.141746 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:35.291133 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 149449us
I20260709 13:07:35.144028 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:35.120127 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 126268us
W20260709 13:07:35.293110 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 149162us
I20260709 13:07:35.292476 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:35.166496 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:35.174546 16454 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.033005 19962 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:35.247099 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 215390us
I20260709 13:07:35.301779 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.247298 16559 raft_consensus.cc:2368] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:35.303545 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.247398 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:35.250108 16632 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.228344 19934 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:35.251236 19768 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.254850 16487 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:35.248775 19788 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.258780 16484 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:35.072805 19986 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.076747 19567 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.133451 19984 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.333509 19984 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.099674 19938 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.336256 19711 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.336644 19711 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:35.337160 19934 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.337908 19984 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.260151 19813 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.338613 19984 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:35.119541 19932 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.069278 19703 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.339105 19813 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:35.339547 19813 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.057849 19835 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.308622 19940 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.342597 19940 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.342938 19940 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.112349 19963 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:35.110280 20054 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.470s	user 0.000s	sys 0.002s
I20260709 13:07:35.099570 19878 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:35.126072 20057 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:07:35.066254 20005 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.063776 20012 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.345686 16563 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.134436 19982 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:35.346396 19982 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:35.101423 19945 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.265945 16489 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:35.067318 19987 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.101899 19785 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:35.325076 20013 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:07:35.347761 19785 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:35.296916 16561 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.247697 16566 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 4.
I20260709 13:07:35.307291 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:35.308521 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.271070 20011 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:35.309837 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 135329us
I20260709 13:07:35.318460 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:35.271225 19641 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.280285 19877 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:35.324013 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:35.300953 19965 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.325907 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:35.326546 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:35.327090 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:35.330453 19949 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.330353 16389 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 4 to 5, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 5 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.331519 19866 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.332940 20015 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.289636 19766 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.337462 19938 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:35.098516 19695 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.344521 19878 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:35.354843 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 46393.1us
I20260709 13:07:35.315392 16640 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:35.337090 19711 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.294416 20063 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.371497 17183 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.335162 19697 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.397092 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:35.378134 16561 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:35.380503 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 56573.7us
I20260709 13:07:35.307611 20034 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:35.385463 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:35.339102 19934 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:35.387841 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.348021 19984 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:35.362774 19965 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:35.365113 16389 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 1 to 9, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 9 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.318547 19948 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.327600 19908 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:35.428072 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 124313us
I20260709 13:07:35.383536 16562 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:35.431631 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:35.386850 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:35.398145 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.432394 17182 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:35.432943 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.400254 17181 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:35.318356 19942 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:07:35.400130 20034 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:35.362027 19733 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.388640 17179 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:35.397362 19697 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:35.411876 16530 leader_election.cc:400] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:35.441409 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:35.383975 19963 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:35.417496 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 236) took 8420 ms. Trace:
I20260709 13:07:35.413656 16389 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:35.383766 20056 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:35.406144 20015 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.403352 19984 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:35.417835 19965 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.425352 20028 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:35.448899 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 66283.7us
I20260709 13:07:35.449019 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.471702 20034 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.424233 19934 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:35.444500 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 5 to 10, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:35.487951 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 90926.4us
I20260709 13:07:35.449190 20041 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.489595 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.347191 19982 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:35.462685 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 215344us
I20260709 13:07:35.442760 16388 rpcz_store.cc:276] 0709 13:07:26.984210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.984425 (+   215us) service_pool.cc:224] Handling call
0709 13:07:35.404133 (+8419708us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:32.780143 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:32.780816 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:32.780865 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:07:32.780882 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:32.781925 (+  1043us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:32.781999 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:32.782026 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:07:32.898782 (+116756us) tablet.cc:701] Row locks acquired
0709 13:07:32.911196 (+ 12414us) write_op.cc:260] PREPARE: finished
0709 13:07:33.023575 (+112379us) write_op.cc:270] Start()
0709 13:07:33.089897 (+ 66322us) write_op.cc:276] Timestamp: P: 1783602453009382 usec, L: 0
0709 13:07:33.094295 (+  4398us) op_driver.cc:348] REPLICATION: starting
0709 13:07:33.565771 (+471476us) log.cc:844] Serialized 4298 byte log entry
0709 13:07:34.432896 (+867125us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:34.587435 (+154539us) op_driver.cc:464] REPLICATION: finished
0709 13:07:34.982373 (+394938us) write_op.cc:301] APPLY: starting
0709 13:07:34.991441 (+  9068us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:35.013483 (+ 22042us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:35.013522 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:35.022446 (+  8924us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:35.022801 (+   355us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:07:35.022852 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:35.023209 (+   357us) log.cc:844] Serialized 83 byte log entry
0709 13:07:35.024345 (+  1136us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.024475 (+   130us) write_op.cc:454] Released schema lock
0709 13:07:35.024542 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:35.024941 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.024968 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":157882,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":359751,"apply.run_cpu_time_us":6815,"apply.run_wall_time_us":60147,"num_ops":11,"prepare.queue_time_us":337649,"prepare.run_cpu_time_us":44211,"prepare.run_wall_time_us":1598423,"raft.queue_time_us":84236,"raft.run_cpu_time_us":39845,"raft.run_wall_time_us":324411,"replication_time_us":1446479,"spinlock_wait_cycles":72244096,"thread_start_us":1069683,"threads_started":4,"wal-append.queue_time_us":600406}]]}
I20260709 13:07:35.450047 16605 leader_election.cc:400] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:35.494522 16604 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:35.494776 16605 leader_election.cc:403] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.483530 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:35.484429 16640 pending_rounds.cc:85] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 3
I20260709 13:07:35.495458 16640 pending_rounds.cc:107] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:35.495725 16640 raft_consensus.cc:2889] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.488746 16389 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:35.496341 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:35.486150 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:35.477265 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.443651 20074 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.450601 19942 consensus_queue.cc:1243] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:35.442600 19963 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:35.485014 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:35.516553 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:35.517768 16639 raft_consensus.cc:2368] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:35.503273 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:35.503379 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61857.1us
I20260709 13:07:35.519361 16638 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.450556 19948 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:35.489930 19835 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:35.514590 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:35.514456 16389 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 8 to 10, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:35.494055 19962 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:35.526964 16389 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 7 to 9, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 9 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.530928 16389 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 10, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.528548 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:35.437222 19877 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.518538 19768 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:35.518623 19966 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.539068 19697 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:07:35.542160 20005 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:35.542546 20005 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:35.542879 20005 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.547981 20013 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:35.548281 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:35.521875 19963 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.529232 20083 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:35.560304 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.535606 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:35.534970 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:35.537173 16389 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.540596 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:35.469956 19878 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.564383 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:35.535091 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.570565 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:35.514358 20080 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.559032 16638 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:35.515648 20076 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:35.550247 19711 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.524588 19984 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.566669 16389 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 8, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 8 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.567170 20040 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:35.562855 16562 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:35.530404 20012 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.573557 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:35.579142 16637 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.538774 19962 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.531113 20082 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.643918 17183 raft_consensus.cc:2368] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
I20260709 13:07:35.539659 19835 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:35.536065 19934 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:35.584966 16631 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:35.562943 19755 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.538877 19768 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:35.571940 19948 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:35.634271 16389 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 6 to 7, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 7 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.633042 19766 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.664143 16389 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 5 to 6, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 6 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.563131 20026 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:07:35.561916 20083 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:35.576152 20015 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:35.661414 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.680435 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.659030 16529 leader_election.cc:400] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
I20260709 13:07:35.643576 20034 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.641620 19952 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.582068 19932 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.667131 16389 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.665364 19768 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.681018 16529 leader_election.cc:403] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.588151 20075 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:35.588337 19986 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:35.588104 19878 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.594735 19942 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:07:35.695958 16485 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:35.652112 20012 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.668154 19934 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:35.675544 20083 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.683728 19948 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:35.690107 19952 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.717528 20075 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.698215 20015 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:35.669770 19813 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.736819 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:35.740473 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 180259us
W20260709 13:07:35.724823 20078 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:07:35.735185 19835 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.732168 19932 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.744694 19952 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:35.747464 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:35.732075 20079 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 13:07:35.728085 20081 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:35.777985 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:35.777946 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 200717us
I20260709 13:07:35.733044 19711 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.786087 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:35.716058 19788 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.739845 19986 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:35.784965 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.746939 19966 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.793443 16631 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.794396 16638 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.794826 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:35.726130 19940 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.730270 19641 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.782264 20082 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.804533 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:35.808023 17187 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.809552 19965 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.811717 19965 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.812158 19966 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:35.811937 20015 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.796758 19755 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.788131 20091 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:35.814625 17183 raft_consensus.cc:2368] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9.
I20260709 13:07:35.795145 19990 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:35.808838 19948 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.827265 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 455) took 1022 ms. Trace:
I20260709 13:07:35.831182 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.827625 16636 rpcz_store.cc:276] 0709 13:07:34.804926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.268011 (+463085us) service_pool.cc:224] Handling call
0709 13:07:35.283987 (+ 15976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.284284 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.284307 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.299416 (+ 15109us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.404065 (+104649us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:35.404104 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.404164 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.827076 (+422912us) raft_consensus.cc:1685] finished
0709 13:07:35.827096 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.827211 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":974,"raft.queue_time_us":762,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":49709,"threads_started":1,"wal-append.queue_time_us":151104}
I20260709 13:07:35.836659 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.837256 16488 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:35.837687 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 348137us
I20260709 13:07:35.838359 16454 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:35.839623 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.803448 19934 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.808845 20005 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:35.819836 20091 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:35.850066 16454 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:35.857468 20101 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.854198 16489 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.853309 16488 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
W20260709 13:07:35.835098 19567 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:07:35.862444 16530 leader_election.cc:400] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:35.862470 16454 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:35.865190 19965 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.861323 20080 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:35.866245 20075 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:35.866123 20080 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.868623 20080 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.819115 19966 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.864635 16530 leader_election.cc:403] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.848724 19962 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:35.874944 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:35.863655 20091 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:35.879555 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 51855us
I20260709 13:07:35.855228 20082 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.885197 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:35.853996 20094 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:35.885272 16490 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:07:35.886319 16488 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:35.888342 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:35.888851 19962 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:35.889394 19962 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:35.889973 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.890232 19962 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:35.890883 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.870639 19755 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.887784 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:35.892500 16488 raft_consensus.cc:2368] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:35.894223 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:35.894522 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.885751 20012 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.884508 19813 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:35.924070 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:35.922369 20093 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:35.870832 19986 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.193917 16562 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:35.878559 20101 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:36.176282 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:36.176357 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 246211us
W20260709 13:07:36.179384 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 285437us
I20260709 13:07:35.874598 20096 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:36.181102 16557 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:36.184046 16561 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.194514 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:36.201731 16490 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.196353 16559 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.200763 16488 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:36.205391 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:36.206403 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:36.207546 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:36.208236 16488 raft_consensus.cc:2368] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9.
I20260709 13:07:36.175648 20075 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.208904 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:36.212770 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:36.214382 16488 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:36.182778 19990 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:36.181497 20087 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:36.198880 20089 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.369s	user 0.000s	sys 0.009s
I20260709 13:07:36.191272 19567 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.214994 20096 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.222646 19567 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.223161 19966 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:36.223585 19963 consensus_meta.cc:287] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.674s	user 0.014s	sys 0.014s
I20260709 13:07:36.224005 19963 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.224670 19567 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.224876 20096 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:36.225983 19963 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.227375 20005 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.200896 20099 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:36.198257 20082 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.184352 20094 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:36.218464 16487 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:07:36.219743 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:36.218158 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:36.235121 16490 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:36.240155 16483 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:36.217139 19641 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:36.251271 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:36.248647 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:36.217772 19788 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:36.258067 20088 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.260288 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:36.261859 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:36.244028 20102 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:36.263091 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:36.221266 20075 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:36.268013 20100 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:36.255357 19940 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.238343 20087 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.265561 20088 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:36.274289 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 72897.5us
I20260709 13:07:36.239391 19785 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.283417 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:36.264751 20102 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:36.289744 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:36.243466 20082 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.268826 19986 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:36.268715 20103 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:36.270219 20013 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:36.303848 20013 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.303866 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:36.270538 20095 consensus_queue.cc:1059] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:36.281597 20096 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:36.312729 20102 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.276494 20063 consensus_queue.cc:1059] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:36.313767 20082 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.307356 20094 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.315784 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:36.316280 20103 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:36.306229 19934 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.319324 20101 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:36.324791 20075 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:36.325515 19878 consensus_meta.cc:287] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.016s
I20260709 13:07:36.327634 20087 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.333531 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:36.297910 19986 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:36.305985 20013 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:36.338627 20034 consensus_meta.cc:287] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.649s	user 0.035s	sys 0.040s
I20260709 13:07:36.308977 19641 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.364369 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:36.354013 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:36.370256 20102 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.375980 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:36.363785 19986 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.371946 20108 raft_consensus.cc:3055] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.376715 20108 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:36.372337 20075 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:36.377745 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:36.361857 20083 consensus_meta.cc:287] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.624s	user 0.000s	sys 0.014s
I20260709 13:07:36.373080 20091 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.377424 16604 leader_election.cc:400] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10.
I20260709 13:07:36.336895 19785 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:36.359274 19932 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.013s
W20260709 13:07:36.377738 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 134723us
I20260709 13:07:36.378579 16483 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:36.372174 20103 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:36.361400 19768 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.645s	user 0.006s	sys 0.010s
I20260709 13:07:36.291884 19990 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.336056 19536 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:07:36.433214 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 57079.1us
W20260709 13:07:36.434597 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.423264 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.390790 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.392225 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.440411 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.389919 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:36.441335 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.442261 16565 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:36.442216 16604 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:36.378180 20034 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.377226 20013 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.444258 16604 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:36.444607 16562 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:36.377238 20087 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.339035 20096 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.447587 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:36.448205 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:36.449836 19984 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.452502 16604 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:36.450338 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:36.449887 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:36.454798 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:36.464520 17184 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:36.422772 19940 raft_consensus.cc:2764] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:36.421321 19641 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:36.451261 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:36.363703 19934 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.452790 16482 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:36.422927 19932 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
I20260709 13:07:36.464929 16483 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:36.469599 20013 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:36.470106 20108 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.471285 20091 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.472071 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:36.472107 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:36.477013 20111 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:36.443079 16560 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:36.379074 20082 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:07:36.447479 20075 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:36.485162 16604 leader_election.cc:400] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9.
I20260709 13:07:36.485459 16604 leader_election.cc:403] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:36.423216 19768 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.485895 19641 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.487074 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:36.487247 19768 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:36.488903 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:36.489900 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:36.490196 19768 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.490759 16484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:36.491258 16484 raft_consensus.cc:606] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:36.493091 16604 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:36.468242 19567 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:36.499044 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:36.497629 16604 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:36.492736 19949 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:36.500032 16483 raft_consensus.cc:2368] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
I20260709 13:07:36.499970 19536 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:36.508355 19536 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:36.509181 19536 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.512007 20075 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.512419 20075 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.423336 20083 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.514820 20083 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.512813 20075 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.481833 20013 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.522354 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:36.500216 20108 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.512341 19932 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.528529 16484 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.525290 19878 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:07:36.538811 19878 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.539141 19878 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:36.539978 19878 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.541002 19878 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.523433 20013 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.547459 16557 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:36.520591 20114 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:07:36.553407 16632 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:36.554483 19877 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.564250 20075 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.566191 20075 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.567880 20005 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.568272 20005 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:36.569023 20005 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.554514 16564 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.571833 17187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 688) took 1276 ms. Trace:
I20260709 13:07:36.572250 17187 rpcz_store.cc:276] 0709 13:07:35.295509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.307471 (+ 11962us) service_pool.cc:224] Handling call
0709 13:07:35.354532 (+ 47061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.808426 (+453894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.571560 (+763134us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54005d11d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:36.571729 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042537344}
I20260709 13:07:36.579650 16486 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:36.572168 19934 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.547766 19932 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.581781 16558 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:36.825888 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.721372 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:36.829071 16374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 107751us
I20260709 13:07:36.791896 19785 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:36.839984 19984 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.840555 19984 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.840694 19785 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.842630 19984 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.842778 19785 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.819707 20013 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.855274 20013 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.860782 19932 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:36.585987 19940 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:36.921551 19940 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:36.921391 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.922274 16559 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:36.922648 19940 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.923691 19940 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.616461 20114 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.925264 20114 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.925541 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.597009 20040 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:36.878597 16560 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:07:36.927520 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.927168 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:36.883474 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.927208 20114 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:36.930653 20102 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:36.717671 19536 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.584695 19986 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.717461 19877 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.933136 19536 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.899961 19785 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:36.934098 19785 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.918921 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1346) took 1436 ms. Trace:
I20260709 13:07:36.937808 16640 rpcz_store.cc:276] 0709 13:07:35.482213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.483872 (+  1659us) service_pool.cc:224] Handling call
0709 13:07:35.484193 (+   321us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:35.532149 (+ 47956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.532192 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:35.532819 (+   627us) log.cc:844] Serialized 78 byte log entry
0709 13:07:35.669481 (+136662us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:35.697085 (+ 27604us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.918199 (+1221114us) spinlock_profiling.cc:243] Waited 932 us on lock 0x7b180045d660. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f0639e833c7 00007f06364959a7 00007f06364a50bf 00007f06364a5038
0709 13:07:36.918379 (+   180us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.918584 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.918650 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.918737 (+    87us) raft_consensus.cc:1685] finished
0709 13:07:36.918749 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.918867 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1191632,"prepare.queue_time_us":1248849,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":828,"raft.queue_time_us":12377,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":39534,"spinlock_wait_cycles":2143104,"thread_start_us":80655,"threads_started":1,"wal-append.queue_time_us":234256}
I20260709 13:07:36.921655 16558 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.940055 19932 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.789104 19878 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.940239 19940 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.940809 19878 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.937651 19785 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.638494 19768 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9.
I20260709 13:07:36.927498 20040 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:36.792374 20075 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:36.940529 19932 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.943297 20075 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.944766 19932 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:36.591364 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.942816 20040 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.946293 20040 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.942881 19878 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:36.949132 19536 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.950768 20099 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:36.951159 20099 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:36.941249 19940 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.937633 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 694) took 1201 ms. Trace:
I20260709 13:07:36.945755 20075 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:36.952363 16632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1352) took 1447 ms (client timeout 1603 ms). Trace:
W20260709 13:07:36.953711 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.955174 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.953608 17183 rpcz_store.cc:276] 0709 13:07:35.736453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.736570 (+   117us) service_pool.cc:224] Handling call
0709 13:07:36.937455 (+1200885us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b54004cc554. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:36.937563 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140981120}
I20260709 13:07:36.955762 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:36.954185 16632 rpcz_store.cc:269] 0709 13:07:35.485845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.485956 (+   111us) service_pool.cc:224] Handling call
0709 13:07:36.932799 (+1446843us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003264d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:36.932889 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349498240}
I20260709 13:07:36.956640 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.955979 19878 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.955874 16562 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:36.957517 19878 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.933459 19877 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.960247 19878 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.960668 19877 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.961834 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:36.962018 19986 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:36.962350 16558 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.962678 19877 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.963114 19877 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:36.962461 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.964993 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.965714 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.966077 16562 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:36.966250 16559 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:36.965214 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.968307 19768 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.968539 20013 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:36.968732 20011 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.969049 20013 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:36.970554 19982 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.971026 20013 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:36.968755 19768 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.976016 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:36.976116 16640 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.976296 16558 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:36.968997 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:36.977293 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:36.977841 16559 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.978483 19536 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:36.979038 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:36.979547 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.981109 20083 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:36.981789 20083 consensus_queue.cc:1243] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:36.982194 20082 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:36.982559 20082 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:36.981590 20094 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:36.982120 20080 raft_consensus.cc:993] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:07:36.987407 16632 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:36.981601 19768 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:36.991655 16559 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:36.988312 20082 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.994263 20082 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.996093 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:36.996841 16640 raft_consensus.cc:2410] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:37.000236 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.000770 16637 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:36.983760 19938 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:37.003123 16632 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:36.984596 19785 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:37.002276 20094 consensus_queue.cc:1243] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:36.983093 19536 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.002168 20028 raft_consensus.cc:1081] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:07:37.009802 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.002723 19938 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:37.017429 19945 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.017963 19945 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:36.980510 20099 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.021437 19536 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.006938 19785 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.025447 19785 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.027964 20099 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.030076 19940 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.030239 20096 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:37.031813 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.031983 16559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:07:37.032485 16559 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.032801 16559 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.033046 19945 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:37.036273 19938 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.037211 19938 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.084832 20013 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.085304 20013 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.037940 19768 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:37.086601 19768 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.038358 19697 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.038720 19695 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:37.087819 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:37.087935 20028 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:37.038693 16559 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.090169 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:37.040364 16560 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:37.041008 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.041472 19536 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.094347 19536 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.094928 20013 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.094295 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.096397 19536 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.097064 20005 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.097548 19768 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.098067 19697 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.098608 17180 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:37.099488 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.100063 19697 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.042585 19785 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.098028 20013 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.100853 20013 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.101251 20013 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.101686 20028 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.052660 19877 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.064025 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.108047 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.064566 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:37.108610 16483 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:37.108947 16490 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.068388 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.069027 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.111675 16487 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:37.064121 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.112483 16486 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:37.074610 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:37.113348 16489 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:37.079023 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.079030 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:37.080155 20094 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.080663 20082 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:37.107344 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:37.128789 16454 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:37.090986 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50050.7us
I20260709 13:07:37.091298 16558 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.091881 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:37.130352 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:37.091904 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.088294 19695 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.093299 19982 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.093762 16559 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.101326 19945 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:37.137315 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.137596 16603 leader_election.cc:400] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9.
I20260709 13:07:37.137995 16483 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:37.138772 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:37.139220 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:37.101778 19785 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.104377 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.104475 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.055958 20080 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:37.228493 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 124153us
W20260709 13:07:37.228710 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86280.1us
I20260709 13:07:37.045325 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2191) took 2281 ms. Trace:
I20260709 13:07:37.116858 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.229246 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.229725 17181 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:37.144294 16489 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:37.123140 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.230906 16488 raft_consensus.cc:2410] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:37.230801 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.231397 16489 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:37.232167 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.232672 16489 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:37.128821 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.084285 20011 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.127233 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:37.240165 17185 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.244231 16491 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:37.140112 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:37.245080 16486 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.238798 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.226926 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.238879 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.251084 16486 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:37.253791 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.262009 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.258095 16490 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:37.265327 17183 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:37.266047 16487 raft_consensus.cc:2393] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 6: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:37.267457 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:37.267988 17183 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.229502 16634 rpcz_store.cc:276] 0709 13:07:34.764122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.041594 (+277472us) service_pool.cc:224] Handling call
0709 13:07:35.041943 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.416235 (+374292us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:35.449925 (+ 33690us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.549714 (+ 99789us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.562979 (+ 13265us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.566218 (+  3239us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:35.566449 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.593648 (+ 27199us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.593848 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.228143 (+634295us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b180043b2e0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:36.898570 (+670427us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b180043b2e0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419
0709 13:07:37.045025 (+146455us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54000b2f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:37.045073 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.045119 (+    46us) raft_consensus.cc:1685] finished
0709 13:07:37.045131 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.045271 (+   140us) inbound_call.cc:177] Queueing success response
0709 13:07:37.078360 (+ 33089us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b180043b2e0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
Metrics: {"mutex_wait_us":64641,"prepare.queue_time_us":14888,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":89,"raft.queue_time_us":63543,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":3096,"spinlock_wait_cycles":707479680,"thread_start_us":142857,"threads_started":2,"wal-append.queue_time_us":192759,"wal-append.run_cpu_time_us":2484,"wal-append.run_wall_time_us":1095423}
I20260709 13:07:37.128077 19938 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.285533 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 458) took 1457 ms. Trace:
I20260709 13:07:37.292263 16482 rpcz_store.cc:276] 0709 13:07:35.828194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.828293 (+    99us) service_pool.cc:224] Handling call
0709 13:07:35.848517 (+ 20224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.480464 (+631947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.285341 (+804877us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54000e8654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:37.285492 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1389289344}
I20260709 13:07:37.284433 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:37.239115 16530 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.603s (SENT) [suppressed 31 similar messages]
I20260709 13:07:37.294334 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 442) took 1077 ms. Trace:
I20260709 13:07:37.139515 19940 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.294684 16557 rpcz_store.cc:276] 0709 13:07:36.208502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.208693 (+   191us) service_pool.cc:224] Handling call
0709 13:07:37.285676 (+1076983us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001c8c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:37.285737 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634014080}
I20260709 13:07:37.296216 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.297637 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.298162 16640 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:37.298702 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.298924 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.299348 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:37.240111 20086 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.299397 16634 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:37.240202 19536 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:37.243848 19697 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:37.300252 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.136101 19877 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:07:37.263720 19768 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.263273 19703 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.262916 19934 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:37.291285 20075 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:37.139734 20082 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.244047 20080 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:37.264635 19945 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:37.136574 20094 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.304095 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.309952 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.305171 17152 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:37.308355 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.310988 17182 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:37.304251 20034 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:37.309252 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.311299 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.310554 17179 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:37.313849 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.314553 16639 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:37.314653 16640 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
W20260709 13:07:37.315609 20134 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:07:37.297904 20028 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:37.316138 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.317474 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:37.317507 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.316823 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.320596 16640 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:37.301599 20086 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.322975 16634 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:37.324189 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.325266 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:37.306075 19768 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.310657 19703 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.295123 19938 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.300634 19940 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.322330 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.316174 20093 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.356230 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.329166 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:37.358054 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.358436 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.338073 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 209342us
I20260709 13:07:37.359473 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.360409 16557 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:37.327854 20086 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.377640 19940 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:37.333735 19536 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:37.318849 20115 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.383716 17187 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:37.384125 17181 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:37.329857 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:37.362025 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:37.375602 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:37.360015 16640 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
I20260709 13:07:37.385968 16640 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.376966 20080 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.342160 19703 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.305486 19697 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.338217 20114 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:37.340170 19768 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.316347 20075 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.389930 16640 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:37.408275 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 95518.1us
I20260709 13:07:37.409118 16603 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.393487 16454 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:37.410048 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:37.410187 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.395213 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.395584 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.394754 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.411409 16562 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:37.394042 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.394961 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.412534 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.413198 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.378291 20111 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.411486 16561 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:37.417402 16563 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:37.417985 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.418561 16558 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:37.423072 16562 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:37.423439 16562 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:37.428404 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:37.391459 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 152321us
I20260709 13:07:37.414796 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.415009 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.407595 19835 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.424150 16562 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.435493 20028 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:37.407372 20034 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:37.436439 16566 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:37.382791 19965 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:37.437422 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.415859 20114 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:37.430781 20080 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:37.440987 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.417444 20103 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:37.440043 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 46622.4us
I20260709 13:07:37.391501 19934 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:37.446962 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 457) took 1620 ms. Trace:
I20260709 13:07:37.378787 20093 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.415779 20111 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.450369 17183 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:37.440245 16562 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.471055 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:37.472577 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.479686 19940 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:07:37.448833 19697 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:37.481199 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 71068.7us
I20260709 13:07:37.441428 19835 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.471488 16485 rpcz_store.cc:276] 0709 13:07:35.827855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.828008 (+   153us) service_pool.cc:224] Handling call
0709 13:07:35.828312 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.828501 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.828525 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.100804 (+1272279us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:07:37.101195 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.295162 (+193967us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.295196 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.295257 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.446702 (+151445us) raft_consensus.cc:1685] finished
0709 13:07:37.446720 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.446910 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3633408,"thread_start_us":193612,"threads_started":1,"wal-append.queue_time_us":221902}
I20260709 13:07:37.482581 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:37.487969 16603 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.443238 20144 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:37.494481 20103 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:37.465864 20146 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.557389 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.557780 19938 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:37.558697 20139 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.574419 16482 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:37.560102 19785 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.574420 20146 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:37.577814 19785 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.578253 19785 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.556743 20144 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.578605 19785 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.577992 20146 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.580667 20146 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.583173 20144 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.497211 16483 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:37.583920 16483 pending_rounds.cc:85] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:07:37.584141 16483 pending_rounds.cc:107] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:37.584352 16483 raft_consensus.cc:2889] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:37.585265 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.496337 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.586416 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:37.493680 19877 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.588060 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:37.588819 20148 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.589074 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.407202 19945 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.592545 20148 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.592926 20148 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.596412 19877 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.598308 19877 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.583742 20144 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.501653 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.493351 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55998.8us
I20260709 13:07:37.600693 20013 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.534204 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:37.602389 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 68289.8us
I20260709 13:07:37.600700 20075 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.624606 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:37.636922 16633 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:37.555889 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 68005.8us
I20260709 13:07:37.556720 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:37.640062 16491 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:37.445247 19986 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:37.493808 20145 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.567705 16604 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:37.573154 17180 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:37.577817 16561 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:37.481516 20111 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.599045 20144 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.601528 16605 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:37.498741 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.602142 20148 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.604058 20096 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.605384 20093 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:37.439078 20092 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:07:37.607602 20082 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.598788 19877 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.571344 19703 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.608760 20094 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:37.508641 19697 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.604138 19813 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.612972 16562 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:37.480707 20028 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:37.480649 20114 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.509202 19536 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.495043 20137 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.614118 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.556208 19835 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.616295 20103 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:37.602586 20013 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:37.621505 19934 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:37.640774 16635 raft_consensus.cc:2410] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:07:37.640137 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:37.642050 17185 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:37.643070 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:37.642256 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.643322 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:37.498924 16486 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:38.292200 20155 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:37.698930 20011 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.293095 20011 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.641120 20095 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:38.245289 19785 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.000s
I20260709 13:07:38.294344 16562 pending_rounds.cc:85] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 4
I20260709 13:07:38.294687 16562 pending_rounds.cc:107] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:38.293952 19785 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.296599 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:38.297242 16566 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:38.297876 20144 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:38.299063 16631 raft_consensus.cc:2368] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
W20260709 13:07:37.653054 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 85411.1us
I20260709 13:07:38.299778 19697 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.300948 20140 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.301383 17185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 540) took 1176 ms. Trace:
I20260709 13:07:38.301474 20140 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:38.302322 16487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.006s	sys 0.011s
W20260709 13:07:38.302709 16487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.006s	sys 0.011s
W20260709 13:07:38.054668 16632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.030s
W20260709 13:07:38.303165 16632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.011s	sys 0.035s
W20260709 13:07:38.155356 20153 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
I20260709 13:07:38.250447 19878 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.305111 19878 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.306618 20148 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:38.307333 19878 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:38.307896 19878 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.308391 19878 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:38.157800 19768 consensus_meta.cc:287] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.743s	user 0.004s	sys 0.002s
I20260709 13:07:37.673277 20145 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.310799 19768 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:38.162472 20080 consensus_meta.cc:287] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.688s	user 0.002s	sys 0.002s
I20260709 13:07:38.312469 16488 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:38.312582 20145 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:38.312868 16488 pending_rounds.cc:85] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:07:37.719461 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:37.674252 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.650312 16633 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:38.314412 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.299065 16559 raft_consensus.cc:2410] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:37.644179 19986 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:38.036463 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.022s	sys 0.026s
W20260709 13:07:38.317180 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.022s	sys 0.043s
W20260709 13:07:37.692624 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.313162 16488 pending_rounds.cc:107] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:38.318352 16488 raft_consensus.cc:2889] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:37.644454 20075 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.666s
I20260709 13:07:38.320885 20156 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.321430 20156 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.322490 20028 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.323427 20156 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.323772 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:38.324393 16486 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
W20260709 13:07:38.099148 16564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.024s
I20260709 13:07:38.299880 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:38.313654 16491 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:38.256510 16561 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.016s
W20260709 13:07:38.326038 16561 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.000s	sys 0.017s
I20260709 13:07:38.326464 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:38.303746 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 480) took 1295 ms. Trace:
I20260709 13:07:38.318105 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:38.328801 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:38.327481 16632 rpcz_store.cc:276] 0709 13:07:37.008011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.008148 (+   137us) service_pool.cc:224] Handling call
0709 13:07:37.091110 (+ 82962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.091284 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:37.129683 (+ 38399us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.303466 (+1173783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.303513 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.303553 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.303607 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.303699 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5168,"prepare.queue_time_us":39114,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":12230,"raft.queue_time_us":108959,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1168170,"threads_started":2,"wal-append.queue_time_us":567407}
I20260709 13:07:38.329335 17183 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
W20260709 13:07:38.325104 16564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.008s	sys 0.027s
W20260709 13:07:38.299989 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.881595 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:38.295006 16562 raft_consensus.cc:2889] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:38.299618 16631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1361) took 1255 ms (client timeout 1504 ms). Trace:
I20260709 13:07:38.301782 17185 rpcz_store.cc:276] 0709 13:07:37.124502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.127036 (+  2534us) service_pool.cc:224] Handling call
0709 13:07:38.301255 (+1174219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.334530 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:38.300383 19697 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.347936 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:38.350997 17187 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:37.980842 20089 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:07:38.053051 20041 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:37.922739 20134 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:07:38.300491 20137 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.293478 20011 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.978976 20024 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:38.334867 20095 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:38.353232 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:38.355227 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 712181us
I20260709 13:07:38.389880 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:38.390266 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:38.390841 16487 raft_consensus.cc:606] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:38.391865 16487 raft_consensus.cc:614] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:38.346271 20156 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.333829 16631 rpcz_store.cc:269] 0709 13:07:37.043874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.065340 (+ 21466us) service_pool.cc:224] Handling call
0709 13:07:37.639930 (+574590us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:38.299565 (+659635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59745536}
I20260709 13:07:38.324514 20028 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:38.356832 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 755523us
I20260709 13:07:38.401152 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:38.293843 19703 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.359409 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:38.359759 20157 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.361743 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:38.346022 20151 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:37.980677 20126 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:07:38.318058 19986 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.411285 19986 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.411774 19986 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.413579 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1366) took 1368 ms. Trace:
I20260709 13:07:38.413959 16634 rpcz_store.cc:276] 0709 13:07:37.044927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.329792 (+284865us) service_pool.cc:224] Handling call
0709 13:07:38.413409 (+1083617us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003a2d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:38.413526 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2378856192}
I20260709 13:07:38.378513 17182 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:38.385887 17187 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
W20260709 13:07:38.353217 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.416610 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.417135 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.335415 19945 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:38.411310 19982 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:38.417709 19945 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.418200 19982 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:38.418955 19982 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.420044 19982 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.334708 20094 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:38.339598 20082 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.397264 19942 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.429654 20094 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.432333 16487 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:07:38.432696 16487 pending_rounds.cc:85] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 3
I20260709 13:07:38.432907 16487 pending_rounds.cc:107] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:07:38.433111 16487 raft_consensus.cc:2889] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.433554 20094 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:38.434312 16487 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:38.434748 19965 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.435139 19965 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.435480 19965 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.436976 19695 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:38.437840 17180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 702) took 1132 ms. Trace:
I20260709 13:07:38.438201 17180 rpcz_store.cc:276] 0709 13:07:37.305337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.305704 (+   367us) service_pool.cc:224] Handling call
0709 13:07:38.437697 (+1131993us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400610dd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:38.437788 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583033728}
I20260709 13:07:38.405030 20156 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.441512 20156 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:38.403065 20160 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.426187 20142 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:38.446856 20142 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.447228 20142 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.331708 20155 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:38.397876 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 63423.5us
I20260709 13:07:38.402125 17188 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
W20260709 13:07:38.447129 20135 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.118s	user 0.003s	sys 0.013s
W20260709 13:07:38.453033 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 63239.2us
I20260709 13:07:38.409997 16483 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:38.339644 19813 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.384727 20041 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.424840 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:38.445014 19785 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.385234 19877 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:38.423422 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:38.474498 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 51161.4us
I20260709 13:07:38.409128 20028 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.427771 20151 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.355859 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:38.452013 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:38.473232 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:38.404088 16491 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:38.452126 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:37.655727 20086 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.455531 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:38.482898 17188 raft_consensus.cc:2393] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:38.484329 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:38.484989 17180 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.457154 20160 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.456079 16529 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:38.445458 19987 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.391518 20095 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:38.471764 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46988.3us
I20260709 13:07:38.650980 19785 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:38.443193 20082 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.651882 19703 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:38.652266 19703 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:38.653267 20082 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.653079 19703 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.654199 19703 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.392594 20024 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.484340 16565 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:38.456203 16530 leader_election.cc:400] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
W20260709 13:07:38.657032 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 200949us
W20260709 13:07:38.657172 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 201162us
I20260709 13:07:38.542850 16490 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:38.540056 20041 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.561267 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1965) took 1497 ms. Trace:
I20260709 13:07:38.540092 19940 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:38.662503 16484 rpcz_store.cc:276] 0709 13:07:37.063371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.063471 (+   100us) service_pool.cc:224] Handling call
0709 13:07:37.063766 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.081159 (+ 17393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.081187 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.081618 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.280100 (+198482us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:37.280141 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.280208 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.446634 (+1166426us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:38.561006 (+114372us) raft_consensus.cc:1685] finished
0709 13:07:38.561028 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.561211 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17009,"raft.queue_time_us":28663,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":16503,"spinlock_wait_cycles":21622528,"thread_start_us":198144,"threads_started":1,"wal-append.queue_time_us":220323}
I20260709 13:07:38.445442 19942 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.479655 20145 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.549075 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 452) took 1016 ms. Trace:
I20260709 13:07:38.685549 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:38.540970 19813 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.541496 19768 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:38.660147 19987 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:38.537333 19877 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.539525 20011 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.479094 20141 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:38.544096 20160 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.477854 20013 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:38.541333 20151 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.551930 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1325) took 1055 ms. Trace:
I20260709 13:07:38.550014 20155 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.561750 19945 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:38.547683 19878 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:38.541977 19835 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.479405 19695 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.483690 20165 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:38.479267 19984 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.479326 16604 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:38.745108 16637 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:38.745448 16637 pending_rounds.cc:85] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 5
I20260709 13:07:38.745649 16637 pending_rounds.cc:107] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:38.745872 16637 raft_consensus.cc:2889] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.660436 16490 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:38.661762 16489 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:38.668202 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:38.748744 16562 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:38.680876 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 451) took 1148 ms. Trace:
I20260709 13:07:38.681480 16638 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:38.684512 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1319) took 1174 ms. Trace:
I20260709 13:07:38.682520 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 455) took 1149 ms. Trace:
I20260709 13:07:38.684893 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1980) took 1114 ms. Trace:
W20260709 13:07:38.686038 16635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2199) took 2892 ms (client timeout 3079 ms). Trace:
I20260709 13:07:38.686764 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:38.687249 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 340069us
I20260709 13:07:38.690207 16631 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:07:38.692430 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:38.717597 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:38.692003 16557 rpcz_store.cc:276] 0709 13:07:37.532801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.532901 (+   100us) service_pool.cc:224] Handling call
0709 13:07:38.548366 (+1015465us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b5800174c98. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:38.548577 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.548767 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.548793 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.548834 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:38.548862 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.548913 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.549023 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152241536}
I20260709 13:07:38.750800 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:38.725206 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:38.728447 16634 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:38.749858 16482 rpcz_store.cc:276] 0709 13:07:37.495428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.495546 (+   118us) service_pool.cc:224] Handling call
0709 13:07:38.669865 (+1174319us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54000cc1d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:38.669962 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29335424}
I20260709 13:07:38.730611 16632 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:38.751694 16566 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:38.683676 19940 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:38.733902 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.750514 16635 rpcz_store.cc:269] 0709 13:07:35.793532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.793687 (+   155us) service_pool.cc:224] Handling call
0709 13:07:38.663466 (+2869779us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540043b554. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:38.685978 (+ 22512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4216361728}
I20260709 13:07:38.751431 16565 rpcz_store.cc:276] 0709 13:07:37.532512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.532632 (+   120us) service_pool.cc:224] Handling call
0709 13:07:38.680744 (+1148112us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540007dfd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:38.680822 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438223488}
I20260709 13:07:38.733987 16639 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:38.728431 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:38.786900 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58549.3us
I20260709 13:07:38.733017 16488 rpcz_store.cc:276] 0709 13:07:37.497008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.497325 (+   317us) service_pool.cc:224] Handling call
0709 13:07:37.497570 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.318783 (+821213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.551683 (+232900us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54002d6c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:38.551873 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873377152}
I20260709 13:07:38.739295 16636 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:38.693470 20170 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.683933 20005 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:38.749944 16564 rpcz_store.cc:276] 0709 13:07:37.533481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.580116 (+ 46635us) service_pool.cc:224] Handling call
0709 13:07:37.580357 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.580535 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:37.580797 (+   262us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.682195 (+1101398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.682252 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.682296 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.682356 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.682464 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25149,"prepare.queue_time_us":7240,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":80594,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"thread_start_us":1075627,"threads_started":2,"wal-append.queue_time_us":719822}
W20260709 13:07:38.750277 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 271006us
W20260709 13:07:38.755123 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.760406 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 308333us
I20260709 13:07:38.750178 16483 rpcz_store.cc:276] 0709 13:07:37.566059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.585066 (+ 19007us) service_pool.cc:224] Handling call
0709 13:07:38.680256 (+1095190us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54002d7b54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:38.680370 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895573760}
I20260709 13:07:38.789292 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:38.803165 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:38.805294 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:38.733841 20013 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.798575 16490 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.740981 20141 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:38.810520 16490 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.729895 19813 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:07:38.731616 20115 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:07:38.729503 19965 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.744056 20165 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.807503 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:38.819233 20166 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:38.798097 19940 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:38.820604 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.825584 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:38.826550 16490 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:38.801587 19768 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.828001 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:38.806779 20092 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:38.831278 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 351459us
I20260709 13:07:38.808214 20013 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:38.837085 16490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1332) took 1274 ms (client timeout 1692 ms). Trace:
I20260709 13:07:38.810387 19878 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.820256 20082 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.809643 20041 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.841902 16604 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:38.784556 19695 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.903240 16485 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:38.833321 20137 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:38.909755 16563 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:38.913081 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.903568 16484 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:38.828890 19945 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.756675 20095 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:38.799316 19984 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:38.816768 20155 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:38.912849 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.068332 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.819898 20086 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:38.868216 16490 rpcz_store.cc:269] 0709 13:07:37.562497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.586220 (+ 23723us) service_pool.cc:224] Handling call
0709 13:07:38.542732 (+956512us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54000af3a0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648ee18 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6
0709 13:07:38.837022 (+294290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1653111168}
I20260709 13:07:38.834746 20145 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:38.833112 20165 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.923779 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:39.095146 16482 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.095261 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:38.923235 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 122775us
I20260709 13:07:38.998123 16491 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.840749 19768 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.923604 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:38.903946 20080 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:07:38.935344 16530 connection.cc:256] RPC call timeout handler was delayed by -1.11396041099988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:07:38.912027 20159 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 13:07:38.740825 20151 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:39.041805 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 254174us
I20260709 13:07:38.839716 19987 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:38.902619 19785 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:39.025192 19697 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.000s
I20260709 13:07:39.069643 16483 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:39.074770 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:39.094390 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.015s	sys 0.030s
I20260709 13:07:39.108450 16485 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
W20260709 13:07:39.108560 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.016s	sys 0.030s
W20260709 13:07:39.096215 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.809859 20170 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:39.097666 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0561561009999423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 13:07:39.100356 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.039898 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1356) took 2006 ms. Trace:
I20260709 13:07:39.114919 16638 rpcz_store.cc:276] 0709 13:07:37.033619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.039294 (+  5675us) service_pool.cc:224] Handling call
0709 13:07:37.347753 (+308459us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b5800091898. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:38.671220 (+1323467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.749649 (+ 78429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.039674 (+290025us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540043b550. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:39.039841 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3163249792}
I20260709 13:07:39.030953 20041 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:39.101934 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.116957 16490 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:39.097453 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 224197us
W20260709 13:07:39.111140 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.118618 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 279298us
I20260709 13:07:39.081959 20155 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:39.122102 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:39.122390 16487 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:39.092972 20145 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:39.127400 16490 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:39.127998 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.131174 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:39.131664 16490 raft_consensus.cc:606] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:39.132002 16490 raft_consensus.cc:614] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.097289 19768 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.135555 17185 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.102049 20184 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.098670 20140 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.151090 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.141072 16484 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:07:39.142511 17180 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.002s
I20260709 13:07:38.847321 20166 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.168473 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.145273 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.170090 16487 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:39.173708 16482 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:39.082912 19945 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.117525 19813 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:39.162690 17180 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:39.137109 20093 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.196090 20093 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.198029 20093 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:39.201901 19703 consensus_meta.cc:287] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.000s
I20260709 13:07:39.177927 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.232122 17185 raft_consensus.cc:2410] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:39.126175 20155 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.180460 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:39.233075 17188 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:39.144378 16490 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.117697 20041 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.186329 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:39.139508 20145 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.187649 19813 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.188681 20192 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.189431 20172 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
W20260709 13:07:39.190111 20186 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:39.189684 19987 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.191192 20191 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.138545 20174 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.129524 19942 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.211210 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:39.213409 19982 consensus_meta.cc:287] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.000s
I20260709 13:07:39.140523 19785 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:39.275394 19785 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:39.276232 19785 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.278126 20160 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.217239 20151 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.218688 20185 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.279284 20185 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.219403 19965 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.035384 20141 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.127943 20082 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.220433 20142 consensus_meta.cc:287] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.773s	user 0.008s	sys 0.001s
I20260709 13:07:39.220896 20182 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:39.224342 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 1978) took 1658 ms (client timeout 1916 ms). Trace:
I20260709 13:07:39.224578 19695 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.167083 20184 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.226231 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:39.227957 20005 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:39.228308 19835 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.230085 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:39.237142 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 115104us
I20260709 13:07:39.142215 20092 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.237962 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 51721.5us
W20260709 13:07:39.244910 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.245401 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.167523 20137 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.250089 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.117836 19697 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.248121 20150 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.266827 16484 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:39.186197 20011 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.269100 17180 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.268024 20165 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.274696 20170 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.507195 16487 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
W20260709 13:07:39.507915 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.506829 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:39.287601 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.350757 16633 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:39.513759 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:39.301985 17153 leader_election.cc:336] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.710s (SENT)
W20260709 13:07:39.292114 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 641307us
I20260709 13:07:39.515188 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:39.501631 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 659752us
W20260709 13:07:39.516467 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.513149 16483 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
W20260709 13:07:39.515856 16489 rpcz_store.cc:269] 0709 13:07:37.565584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.588848 (+ 23264us) service_pool.cc:224] Handling call
0709 13:07:39.224177 (+1635329us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400178c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:39.224291 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465256192}
I20260709 13:07:39.264463 20192 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:39.644761 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.506899 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 280726us
I20260709 13:07:39.266070 20191 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.672477 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:39.664670 19697 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.664285 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:39.569640 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.671330 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.675256 16558 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
W20260709 13:07:39.675632 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.676105 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.672689 20191 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:39.515105 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 213143us
I20260709 13:07:39.677467 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:39.518289 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:39.670723 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 155149us
I20260709 13:07:39.517342 16604 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:39.527817 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.476172 20111 consensus_meta.cc:287] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.127s	user 0.008s	sys 0.001s
I20260709 13:07:39.381448 19984 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.474390 19945 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.281128 19813 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.462978 20063 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.382196 20095 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.295490 20175 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:39.720151 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 202880us
I20260709 13:07:39.720744 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:39.509814 20171 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.712545 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.672940 20165 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.683527 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:39.657989 20179 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.592206 20170 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.290347 20160 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.716480 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.677802 20083 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:39.689301 20093 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.718466 17180 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:39.714170 17185 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:39.721637 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:39.734629 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51180.4us
I20260709 13:07:39.516988 20189 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.595743 20150 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:39.531445 19965 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.735872 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.737094 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:39.716769 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:39.712453 20200 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:07:39.762877 17182 raft_consensus.cc:2368] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
W20260709 13:07:39.722286 20026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.009s	sys 0.010s
I20260709 13:07:39.689074 19835 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.298352 20041 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.731594 19697 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:39.773059 16603 leader_election.cc:400] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
I20260709 13:07:39.740566 17181 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:39.682317 20197 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.717278 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.532899 19986 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.690584 20185 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.286937 20013 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.310047 19940 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:39.765525 19877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.025s	sys 0.029s
I20260709 13:07:39.740406 20160 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.746066 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:39.723763 19945 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.594619 20005 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.269881 20174 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.722885 20194 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:39.535780 20082 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:39.766924 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45347.6us
I20260709 13:07:39.773375 16603 leader_election.cc:403] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:39.786412 19877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.026s	sys 0.030s
I20260709 13:07:39.759693 20083 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.765017 19835 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:39.743083 20195 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.801872 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:39.695135 20183 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:07:39.516983 20137 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.732040 20115 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:39.746232 20165 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:39.742617 19984 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.760205 19965 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:39.764400 20026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.009s	sys 0.010s
I20260709 13:07:39.720876 20111 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.535662 20142 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:39.785550 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64877.2us
I20260709 13:07:39.884341 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:39.786906 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:39.885146 16634 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:39.531893 20092 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.743212 20170 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.789605 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:39.791501 16640 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:39.776042 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 98650.5us
I20260709 13:07:39.558454 20182 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:39.788112 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 109727us
I20260709 13:07:39.775454 19982 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.901898 19982 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.792233 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:39.794363 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 48379.4us
I20260709 13:07:39.794942 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:39.780021 19695 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.733722 20175 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.723683 20063 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.776042 20086 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:39.916703 20086 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.918134 20086 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.797996 16486 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:39.741310 20179 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.919742 20179 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.762367 20145 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.782394 20151 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.920395 20151 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.759145 19878 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.799983 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:39.920883 20170 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.896739 20111 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.762106 20189 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.901407 20183 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:39.784708 20193 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.922387 20151 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.922926 20151 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.922794 20193 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.923341 20151 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.818570 20195 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.923840 19878 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:39.924290 19878 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.924850 20193 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.881639 20191 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.925166 20195 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.925316 20175 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.923578 20189 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.912256 19695 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.926614 19695 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.927127 20013 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.798976 19986 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.928079 19986 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:39.928889 19986 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.929343 20203 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.929708 20203 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:39.930500 20203 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.831321 20041 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.839867 20192 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.848397 20024 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.832760 20174 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.849696 20166 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.801839 19942 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.933007 20182 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.914244 20083 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:39.921587 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 121779us
I20260709 13:07:39.915210 20178 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.935360 20082 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.825289 20184 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.935828 20151 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.937026 20191 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.904923 20142 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.938001 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.938560 16487 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:39.938876 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.829969 20005 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.939884 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.940150 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.940481 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.940812 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.941387 16490 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:39.941481 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.942145 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.942476 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:39.939677 19878 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.943209 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.940092 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.944085 16565 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:39.944343 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:39.944476 19878 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.822196 20160 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.923914 17188 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:39.945317 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:39.945830 16559 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.945875 16561 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:39.946794 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.946631 20151 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.947134 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.828670 19940 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.782346 20197 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.947759 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.948104 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.948554 20151 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.832547 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 467) took 1003 ms. Trace:
I20260709 13:07:39.801851 19835 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.948874 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:39.842859 20155 consensus_meta.cc:287] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.591s	user 0.002s	sys 0.003s
I20260709 13:07:39.949432 16561 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.826443 20201 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.949676 20155 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.950305 20201 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.950417 16491 rpcz_store.cc:276] 0709 13:07:38.828663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.828774 (+   111us) service_pool.cc:224] Handling call
0709 13:07:38.910770 (+ 81996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.096092 (+185322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.832330 (+736238us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b5400276ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:39.832492 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8849664}
I20260709 13:07:39.951509 20155 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.839059 19697 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.761333 20011 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:07:39.856624 19877 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:39.955025 19877 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.955991 16639 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:39.956861 19877 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:39.820650 19768 consensus_meta.cc:287] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.002s
I20260709 13:07:39.957787 19768 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.943444 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:39.960435 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.944824 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.962522 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:39.963379 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:39.960386 16484 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.959673 19768 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.923693 20063 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.888319 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:39.903767 19982 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.968261 16557 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:39.967571 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 79315.3us
I20260709 13:07:39.889164 20185 consensus_queue.cc:1059] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:39.971920 20185 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:39.879534 20165 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.972790 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:39.973629 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.892942 20114 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.972067 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:39.978902 17185 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.900049 20137 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.880963 19965 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:39.981258 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.982074 19768 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.982463 19768 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.982795 19768 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.984859 20114 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.985237 20114 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.931704 20203 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.988302 16639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:07:39.968400 19982 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.991866 19982 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.992283 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:39.993170 16639 raft_consensus.cc:606] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:39.978312 19835 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.993981 19982 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:39.994529 17183 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.988312 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:39.996809 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.997002 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:39.996409 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:39.993552 16639 raft_consensus.cc:614] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.002533 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:40.003844 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:40.004151 16557 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:39.907925 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.034194 16558 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.034515 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.035523 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.035699 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.036633 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.037171 17183 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:39.955528 17187 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:40.038378 16632 raft_consensus.cc:2410] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:39.906785 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.907091 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.905562 16631 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
W20260709 13:07:39.913159 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 138011us
I20260709 13:07:39.913952 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 448) took 2411 ms. Trace:
I20260709 13:07:39.915809 16560 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.898639 20092 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.921547 20145 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:39.756135 20093 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.939414 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.942804 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.948678 16562 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:39.801992 20150 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:39.822980 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1378) took 1098 ms. Trace:
I20260709 13:07:39.951738 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:39.802683 20194 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:39.952358 20201 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.944854 16485 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.953356 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:39.949457 20197 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.952646 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:39.939416 16564 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:39.953940 16490 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:39.952903 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.969475 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:39.970050 16484 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:39.968374 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 466) took 1140 ms. Trace:
I20260709 13:07:39.963858 16565 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.974247 16559 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:39.967952 20063 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.972261 20185 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:39.976881 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:39.977007 20165 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:39.977399 19877 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:39.882818 20141 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:40.005223 20151 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.006350 19768 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.005254 20011 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:07:40.008539 19695 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.009397 19942 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
I20260709 13:07:40.010752 17186 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:40.010906 19835 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.015201 19965 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.016490 19878 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:40.018352 20203 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:40.020321 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:40.022912 20211 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:07:40.025681 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.026515 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.030082 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.025914 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.030525 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.031746 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.032331 19697 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.032789 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.030470 20142 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:39.895452 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.037115 16557 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.286520 16486 rpcz_store.cc:276] 0709 13:07:38.828409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.828499 (+    90us) service_pool.cc:224] Handling call
0709 13:07:38.828741 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.918598 (+1089857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.968172 (+ 49574us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400259254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:39.968321 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228745600}
I20260709 13:07:40.287904 20063 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.284794 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.288749 17179 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.023618 16385 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:40.289445 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 292487us
I20260709 13:07:40.289865 16489 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.290733 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.291165 20093 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.131822 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 129) took 9302 ms. Trace:
I20260709 13:07:40.291435 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.292317 17187 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:40.284789 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.294443 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 399023us
I20260709 13:07:40.294921 20063 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.289178 20141 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.292819 16489 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.306062 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.295039 17184 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
W20260709 13:07:40.073804 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.246930 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.289297 16563 rpcz_store.cc:276] 0709 13:07:37.496093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.561002 (+ 64909us) service_pool.cc:224] Handling call
0709 13:07:37.578129 (+ 17127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.034827 (+1456698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.906971 (+872144us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540006d1d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:39.907105 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062133120}
I20260709 13:07:40.297647 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 463) took 1471 ms. Trace:
I20260709 13:07:40.304140 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:40.297971 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.287832 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.310552 16484 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.311328 16486 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.298880 16638 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:40.309465 16488 rpcz_store.cc:276] 0709 13:07:38.826490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.834141 (+  7651us) service_pool.cc:224] Handling call
0709 13:07:38.834448 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.910353 (+ 75905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.910383 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.006881 (+ 96498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.820638 (+813757us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b18000cad20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:07:39.915015 (+ 94377us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:39.915053 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.915115 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.297403 (+382288us) raft_consensus.cc:1685] finished
0709 13:07:40.297421 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.297594 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75559,"raft.queue_time_us":230624,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":17552,"spinlock_wait_cycles":16923392,"thread_start_us":94202,"threads_started":1,"wal-append.queue_time_us":1256158}
I20260709 13:07:40.313400 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.313970 16488 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:40.314709 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.315183 16488 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.295605 16482 raft_consensus.cc:2368] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
I20260709 13:07:40.287676 19877 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.299891 16483 raft_consensus.cc:2410] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:07:40.317178 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.297739 16385 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.144515 16561 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:40.300730 16633 rpcz_store.cc:276] 0709 13:07:38.724900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.725000 (+   100us) service_pool.cc:224] Handling call
0709 13:07:39.822817 (+1097817us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000fc3d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:39.822920 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377805568}
I20260709 13:07:40.317720 16565 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:40.291287 16490 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:40.318157 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.318799 16483 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:40.039827 16603 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.110291 17185 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:40.319494 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.178568 19987 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:40.334403 16557 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
W20260709 13:07:40.303638 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 283373us
I20260709 13:07:40.335273 16489 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:40.304792 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.335892 16564 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.288882 16487 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:40.305833 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.291491 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.300540 16634 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.337056 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.337314 16485 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:40.337600 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.338356 16634 raft_consensus.cc:2410] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:40.320420 16631 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.288548 16491 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:40.289707 19768 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.324856 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.321846 16483 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.333483 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.096391 16558 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:40.291743 16389 rpcz_store.cc:276] 0709 13:07:30.829772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.830110 (+   338us) service_pool.cc:224] Handling call
0709 13:07:40.131726 (+9301616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:36.229774 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:36.306522 (+ 76748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:36.308534 (+  2012us) write_op.cc:435] Acquired schema lock
0709 13:07:36.309889 (+  1355us) tablet.cc:662] Decoding operations
0709 13:07:36.329022 (+ 19133us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:36.329075 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:36.329102 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:36.330046 (+   944us) tablet.cc:701] Row locks acquired
0709 13:07:36.330061 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:07:36.330193 (+   132us) write_op.cc:270] Start()
0709 13:07:36.330296 (+   103us) write_op.cc:276] Timestamp: P: 1783602456330149 usec, L: 0
0709 13:07:36.330317 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:36.330931 (+   614us) log.cc:844] Serialized 5076 byte log entry
0709 13:07:36.868925 (+537994us) op_driver.cc:464] REPLICATION: finished
0709 13:07:36.900570 (+ 31645us) write_op.cc:301] APPLY: starting
0709 13:07:36.900646 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:36.900888 (+   242us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:36.901009 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:36.902231 (+  1222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:36.902477 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:07:36.902519 (+    42us) write_op.cc:312] APPLY: finished
0709 13:07:36.902797 (+   278us) log.cc:844] Serialized 95 byte log entry
0709 13:07:36.961185 (+ 58388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:36.961322 (+   137us) write_op.cc:454] Released schema lock
0709 13:07:36.961372 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:36.961724 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:36.961752 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":195,"mutex_wait_us":151388,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":31416,"apply.run_cpu_time_us":2940,"apply.run_wall_time_us":61148,"num_ops":13,"prepare.queue_time_us":401950,"prepare.run_cpu_time_us":84035,"prepare.run_wall_time_us":286057,"raft.queue_time_us":296757,"raft.run_cpu_time_us":1297,"raft.run_wall_time_us":37631,"replication_time_us":538442,"spinlock_wait_cycles":28544,"thread_start_us":416266,"threads_started":4,"wal-append.queue_time_us":191254,"wal-append.run_cpu_time_us":5892,"wal-append.run_wall_time_us":1456914}]]}
W20260709 13:07:40.348443 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44391.1us
I20260709 13:07:40.349200 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.349730 16489 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.354003 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:40.354328 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.354295 16530 leader_election.cc:400] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:40.355903 16530 leader_election.cc:403] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.356184 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:40.356769 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.338222 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.291921 16637 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:40.318802 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.286290 20151 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.362859 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 323103us
I20260709 13:07:40.362094 16484 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:40.368832 16489 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:40.361207 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.369865 20170 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:40.370110 19768 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.370225 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.341492 16486 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:40.339237 19986 raft_consensus.cc:2764] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:40.343333 16631 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.358620 16485 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.348018 20165 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.359845 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.342053 16385 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:40.354975 16487 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:40.320164 19982 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.340276 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 363439us
I20260709 13:07:40.372767 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.367321 16488 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:40.375708 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.376673 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:40.377302 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.378052 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.366251 16564 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:40.230808 20114 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.320533 20202 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:40.295264 20175 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:07:40.332948 20137 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:40.380089 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.462380 16490 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:40.462402 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.366791 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.370692 19768 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.340718 20082 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:07:40.473116 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 106402us
I20260709 13:07:40.359103 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.382906 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.355401 19835 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:07:40.378970 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.481150 17188 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:40.481509 16486 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:40.384977 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.385056 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.482930 16639 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.483240 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.386118 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.388852 20156 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.386842 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.387172 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.485713 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.355546 19940 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.384063 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.487946 16631 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:40.353379 20155 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.449340 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.484221 16640 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:40.388651 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:40.369297 20151 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.360777 20182 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:40.388197 20162 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:07:40.455193 16557 raft_consensus.cc:2368] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:40.456272 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.505080 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.457306 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:40.353380 20011 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:40.507706 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 50443.6us
I20260709 13:07:40.458097 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.509779 16561 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.452705 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:40.510823 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58187.8us
I20260709 13:07:40.459508 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.459965 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:40.380370 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.502562 20115 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:40.464344 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.366886 20040 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.466140 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.522158 16632 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.373865 19945 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.381709 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.355356 20197 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:07:40.493125 19942 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:40.487775 20082 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.353780 19733 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:07:40.320719 20142 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.526268 20082 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.526969 20142 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:40.527500 20142 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:40.474557 16634 raft_consensus.cc:2410] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:07:40.341142 19785 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.344885 19987 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.476913 16490 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:40.480671 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.486024 16633 raft_consensus.cc:2368] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8.
I20260709 13:07:40.486733 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.451076 20191 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:40.493854 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 105268us
I20260709 13:07:40.517124 20174 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.493733 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.483618 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.494760 16636 raft_consensus.cc:2368] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:40.294569 20185 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.467383 20192 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.496541 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.494464 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.453819 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.471891 20005 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.453734 20166 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:40.570542 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.570986 20174 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:40.571941 20174 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.473017 20193 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:40.573326 20193 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.575220 20193 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.576808 20005 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.578769 20005 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:40.480911 20202 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:40.461227 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.580034 16484 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.585877 19987 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.593299 16484 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:40.492714 20145 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.512737 16638 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.512908 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:40.600121 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 126366us
I20260709 13:07:40.600567 16564 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:40.561398 19835 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:40.487737 19940 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:40.460690 19982 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.518049 16489 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:40.471515 20137 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.464222 16559 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:40.519991 16456 leader_election.cc:400] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:40.521005 16561 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:40.563735 19965 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.522682 17186 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:40.523379 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.527349 16385 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 4 to 8, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.524591 20115 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:40.565253 20192 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:40.531523 19768 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.540553 20194 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.544205 19695 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.518127 19697 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.514346 20013 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:40.523908 20040 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.547602 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 165949us
I20260709 13:07:40.549260 16483 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:40.471529 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 107499us
I20260709 13:07:40.638262 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.507586 20011 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:40.468664 20165 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.556025 16565 raft_consensus.cc:2368] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8.
I20260709 13:07:40.626833 20141 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.495113 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.634379 16385 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.648629 16631 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:40.566391 16490 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:40.566201 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 112454us
I20260709 13:07:40.495949 20156 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.565634 16635 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:40.567126 16640 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.568025 16566 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:40.652611 20063 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.653389 20156 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:40.654650 20063 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.642313 20013 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.656831 16490 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:40.650650 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.659433 20137 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.642572 20011 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.660223 16385 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.661134 20141 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.663065 20013 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.663483 17179 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:40.663919 20151 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.663812 16385 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 4 to 6, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 6 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.642762 20040 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.665894 20151 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.666057 16385 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 7 to 8, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.634358 20178 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:40.668094 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:40.668910 16637 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.667629 16385 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 6 to 7, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 7 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.664656 17184 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:40.671437 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:40.597638 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:40.672422 17187 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:40.553174 19785 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.513849 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:40.673027 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 159198us
I20260709 13:07:40.549990 20142 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.601665 16604 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.624863 16487 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.627017 16456 leader_election.cc:403] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:07:40.674898 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 157411us
I20260709 13:07:40.627640 16557 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.677326 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.677434 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.677742 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.678056 16559 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:40.678296 16561 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:40.458604 16485 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:40.600075 20145 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.601609 20150 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:40.603583 19835 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:40.639412 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:40.626422 19940 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.640661 16488 raft_consensus.cc:606] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.641158 16455 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.559686 20191 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.668803 16482 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:40.602063 16484 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.672575 17188 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:40.674080 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:40.692668 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51548.1us
I20260709 13:07:40.680437 16566 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.677469 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.638370 20175 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:07:40.681805 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 80230.5us
I20260709 13:07:40.661584 20165 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:40.682271 20082 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.643177 20166 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:07:40.685150 20218 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:07:40.684988 20194 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:40.639186 20202 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.699568 19785 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.700711 19785 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.683363 20155 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
W20260709 13:07:40.682842 20215 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:07:40.681411 20178 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.703811 20178 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.683523 20137 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.639052 20184 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:40.682935 19965 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:40.704690 19965 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.705518 19697 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.705304 19835 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.706408 19835 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.706530 19965 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.707003 16486 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:40.696952 20221 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.684218 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:40.707746 20221 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:40.689117 16488 raft_consensus.cc:614] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.643916 20083 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.694748 20174 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.709781 16456 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:40.710029 20040 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.710695 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:40.686642 20151 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.671080 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:40.693351 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.718044 20174 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.719138 20041 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.695272 16604 leader_election.cc:400] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
I20260709 13:07:40.720813 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.721549 19697 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.721956 19697 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.722271 19697 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.722344 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.643040 20162 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:40.661599 20141 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.725396 20141 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.683187 20145 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.730990 19697 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.682796 19695 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:40.732345 19695 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.648334 19987 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:07:40.733266 19697 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.682013 20114 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.694564 20005 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.704383 20137 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:40.687076 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 47750.3us
I20260709 13:07:40.735611 20137 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:40.733629 20193 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:40.736640 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.738157 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.739217 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.739415 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.711081 17185 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:40.711187 19965 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.740023 16562 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:40.740368 19965 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.740476 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.740860 19965 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.740897 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.742074 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.742583 16562 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.742895 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.712733 19982 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.734130 20005 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:40.744848 20005 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.747311 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.713773 16456 leader_election.cc:400] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8.
I20260709 13:07:40.748138 16456 leader_election.cc:403] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.733202 19695 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.748816 16562 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:40.749567 16456 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:40.750174 20041 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8.
I20260709 13:07:40.750800 20041 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.692929 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:40.751814 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58941.4us
I20260709 13:07:40.740082 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:40.752954 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.742587 16557 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.736734 20193 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.753860 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:40.733831 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.754097 20193 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.754405 16565 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:40.754588 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.742084 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:40.755264 16558 raft_consensus.cc:2376] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9. Re-sending same reply.
I20260709 13:07:40.755405 19697 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:40.751832 19982 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:40.708158 20221 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.756019 19982 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:40.756433 19982 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.719245 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.759968 20137 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.761235 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.762832 20165 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.763808 19697 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.764021 20165 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:40.765311 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:40.768786 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.774652 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:40.775292 16634 raft_consensus.cc:2368] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
W20260709 13:07:40.769281 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45719.9us
I20260709 13:07:40.769232 16635 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.764555 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.692170 16385 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 1 to 8, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.770603 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.636219 20115 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.777388 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.777541 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.683010 20013 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:40.764611 20213 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:40.784626 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.786249 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.787343 16455 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.788816 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.791023 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.792738 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.795264 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.797679 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.798466 16633 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:40.765795 20083 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:40.800109 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.802091 20194 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.651571 20192 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.811887 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:40.812955 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.813143 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.819073 16640 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:40.788481 20041 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.788105 20151 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.808715 20165 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.788115 20094 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.823519 19768 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.840690 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.843070 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.823072 20083 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:40.849393 20040 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:40.785161 20142 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.850572 19940 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.851873 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.852874 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.856048 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.856345 19768 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:40.856557 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.856945 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:40.809620 20221 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:40.857874 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.837726 20165 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:40.859756 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.861423 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:40.852214 20092 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:40.861975 16638 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 5.
W20260709 13:07:40.862627 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 75363.1us
I20260709 13:07:40.862504 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.862460 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:40.862874 16483 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:40.864269 16455 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.854230 20185 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.869387 16455 leader_election.cc:400] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8.
I20260709 13:07:40.870270 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:40.872026 16455 leader_election.cc:400] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:40.864975 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:40.865398 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.864264 16484 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:40.865820 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:40.867226 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 89894.1us
I20260709 13:07:40.879117 16604 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.831518 20011 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.879417 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.879769 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.860231 20142 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.862134 20165 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.880666 16484 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:40.879846 16483 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:40.874162 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 108919us
I20260709 13:07:40.885066 16639 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.889950 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.889525 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:40.890153 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:40.908928 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:40.910703 16484 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
W20260709 13:07:40.945696 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.841470 19697 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:41.154764 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 245338us
I20260709 13:07:40.872879 20094 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:41.154891 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 264802us
I20260709 13:07:41.182524 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:40.867781 20040 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.095477 20193 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:41.171047 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.165076 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:41.177024 17184 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:41.164353 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 274437us
I20260709 13:07:40.891281 19940 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:41.189906 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:41.091639 20232 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:07:41.190620 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:41.002691 19695 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:41.084939 20202 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:41.185966 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:40.872483 20236 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.092851 20237 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.881672 20083 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:40.890408 20041 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.890554 20141 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:41.196293 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:41.219897 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.221098 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:41.221946 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:41.223044 20111 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.223289 20178 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.223869 20040 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:41.224716 20111 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.225111 20111 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.882758 20221 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:40.884960 20011 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:41.194280 19982 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.230142 19982 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:41.230623 20178 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.230837 16640 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 6: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:41.084250 16639 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
W20260709 13:07:41.203599 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 336955us
I20260709 13:07:41.189088 20194 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.233033 20194 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.233408 20194 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.887329 20145 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.237373 20145 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:41.240396 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 50569us
I20260709 13:07:40.872495 20151 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.194739 20213 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:41.253587 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.190222 20234 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:41.147607 19965 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.204432 19940 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.205437 20202 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:41.204860 20160 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:41.271027 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:41.241649 20041 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.144426 19768 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.257925 19697 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.261432 19695 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:41.280007 20202 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.247977 20237 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.262193 20011 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.273339 20213 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:41.282220 20141 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:41.286335 20041 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.301505 20221 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:41.292440 20040 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:41.260887 20235 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:07:41.284578 20160 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:41.315908 20005 consensus_meta.cc:287] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
I20260709 13:07:41.322602 20040 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.318053 20221 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:41.329176 20221 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:41.300802 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 78154.5us
I20260709 13:07:41.331429 20213 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.372157 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:41.369732 16482 raft_consensus.cc:2368] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:41.376176 16483 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:41.401532 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.516481 20193 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:41.570938 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.525942 20160 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:41.584649 16633 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:41.584892 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2241) took 1197 ms. Trace:
W20260709 13:07:41.523989 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.377315 16530 connection.cc:256] RPC call timeout handler was delayed by -1.2564357620000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2721s for a response
W20260709 13:07:41.523864 19785 consensus_meta.cc:287] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.811s	user 0.006s	sys 0.004s
I20260709 13:07:41.584275 17185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 554) took 1061 ms. Trace:
I20260709 13:07:41.380796 20263 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.608430 20263 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.605909 17185 rpcz_store.cc:276] 0709 13:07:40.522665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.522801 (+   136us) service_pool.cc:224] Handling call
0709 13:07:40.523065 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.740077 (+217012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.583712 (+843635us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54005ff0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:41.584078 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431917312}
I20260709 13:07:41.606371 20137 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.610411 20137 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:41.610989 20263 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:41.611745 20137 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.589160 20111 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.589493 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.612571 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:41.613971 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.614806 16640 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.590278 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.517120 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 1993) took 1578 ms. Trace:
I20260709 13:07:41.616063 16486 rpcz_store.cc:276] 0709 13:07:39.938816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.482118 (+543302us) service_pool.cc:224] Handling call
0709 13:07:40.679904 (+197786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.711905 (+ 32001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.497455 (+785550us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54000e7c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:41.502116 (+  4661us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000e7c50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:41.516884 (+ 14768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516180608}
I20260709 13:07:41.592054 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.617849 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:41.618366 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.620260 20137 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.622116 20262 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.622337 20041 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.623648 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:41.624487 16485 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.616775 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.625826 16634 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.595993 20194 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.619709 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:41.598294 19835 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.881s	user 0.011s	sys 0.007s
I20260709 13:07:41.585361 16639 rpcz_store.cc:276] 0709 13:07:40.387238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.483421 (+ 96183us) service_pool.cc:224] Handling call
0709 13:07:41.584507 (+1101086us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54000cb554. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:41.584705 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741309696}
I20260709 13:07:41.618669 16486 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.625106 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 482) took 1339 ms. Trace:
I20260709 13:07:41.637177 16487 rpcz_store.cc:276] 0709 13:07:40.285714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.601948 (+316234us) service_pool.cc:224] Handling call
0709 13:07:40.602181 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.674519 (+ 72338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.624626 (+950107us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54002d6254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:41.624937 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51752704}
I20260709 13:07:41.319348 20011 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:41.645179 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.640084 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.646819 16633 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:41.622583 20262 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:41.650566 16639 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
W20260709 13:07:41.376961 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 190932us
I20260709 13:07:41.661870 20194 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:41.370797 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 155740us
I20260709 13:07:41.668730 20041 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:41.323704 19965 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:41.674280 16634 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:41.667287 20262 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.663590 20111 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:41.681221 20197 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.681434 20165 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.013s
I20260709 13:07:41.684219 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:41.685689 20013 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:41.702766 16489 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:41.685958 20145 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:41.704290 20145 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.704876 20145 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:41.706488 20145 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.402973 19695 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.708015 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.709980 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:41.710760 16482 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.712795 20011 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.713891 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54268 (request call id 18) took 1336 ms. Trace:
I20260709 13:07:41.714262 16488 rpcz_store.cc:276] 0709 13:07:40.377084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.459849 (+ 82765us) service_pool.cc:224] Handling call
0709 13:07:41.713497 (+1253648us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002e31d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636485853 00007f063b45360a 00007f06349d97d4 00007f06349d9762 00007f06349d9691 00007f06349d960c 00007f06349d88c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:41.713661 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282729728}
I20260709 13:07:41.329663 20141 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.687860 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.688930 20093 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.719261 20093 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:41.325641 20005 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.720464 20093 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.721755 20093 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.722971 20005 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:41.690563 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.725368 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.726619 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.693442 20150 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.694976 16485 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:41.639328 20191 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:41.695864 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.700241 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.718094 19877 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:41.735992 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:41.338536 20237 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:41.677117 20193 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.735466 16488 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:41.735458 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.744295 16637 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:41.744405 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.744787 17184 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:41.745091 16633 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 4.
I20260709 13:07:41.745293 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:41.745652 20193 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.738718 20150 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.751868 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:41.753430 20193 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:41.753831 16489 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:41.755267 16635 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.756347 16560 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:41.680519 20263 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:07:41.759938 16485 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.760376 16634 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:41.761639 16633 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:41.762302 16639 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:41.771983 16486 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:41.763882 16482 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:41.716066 20197 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:41.774041 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.774842 20197 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:41.776150 16638 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:41.777397 16487 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.777580 16638 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:41.782339 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 466) took 1045 ms. Trace:
I20260709 13:07:41.782706 16560 rpcz_store.cc:276] 0709 13:07:40.736848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.747070 (+ 10222us) service_pool.cc:224] Handling call
0709 13:07:41.782118 (+1035048us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b540006ccd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:41.782226 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255677824}
I20260709 13:07:41.784668 16633 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:41.784963 20185 consensus_meta.cc:287] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.911s	user 0.003s	sys 0.011s
I20260709 13:07:41.786069 16633 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:41.774066 20174 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:41.787863 20174 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.788132 17186 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 5.
I20260709 13:07:41.790403 16564 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:41.790723 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:41.792033 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82af48cecc58434e959547ec318fa4c5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:41.792433 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:41.792764 16563 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:41.793375 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:41.793747 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1344) took 1019 ms. Trace:
I20260709 13:07:41.794140 16483 rpcz_store.cc:276] 0709 13:07:40.774755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.909320 (+134565us) service_pool.cc:224] Handling call
0709 13:07:40.909559 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.647992 (+738433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.793467 (+145475us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400368654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:41.793690 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070904192}
W20260709 13:07:41.787283 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.795873 16561 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:41.794111 16565 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.797129 20202 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.800120 16484 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:41.800992 20263 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.794773 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:41.787372 17153 leader_election.cc:336] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.977s (SENT)
I20260709 13:07:41.801644 20092 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:41.749512 20191 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:07:41.803056 20191 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.803443 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 489) took 1496 ms. Trace:
I20260709 13:07:41.803831 16490 rpcz_store.cc:276] 0709 13:07:40.306711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.649718 (+343007us) service_pool.cc:224] Handling call
0709 13:07:40.649965 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.657238 (+  7273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.803028 (+1145790us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b5400332cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:41.803246 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15321344}
I20260709 13:07:41.802165 20092 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.759076 16640 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:41.806594 20263 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:41.810457 20263 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:41.811941 19835 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:41.813627 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1345) took 1038 ms. Trace:
I20260709 13:07:41.799525 20202 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:41.807255 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:41.814445 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:41.739665 20165 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:41.837695 16631 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:41.749022 20005 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:41.813998 16484 rpcz_store.cc:276] 0709 13:07:40.774993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.911128 (+136135us) service_pool.cc:224] Handling call
0709 13:07:41.145169 (+234041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.800487 (+655318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.813335 (+ 12848us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400298bd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:41.813564 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505459456}
I20260709 13:07:41.803449 20191 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:41.813769 20263 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.983894 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:41.884624 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1407) took 1023 ms. Trace:
I20260709 13:07:41.854379 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:41.892920 16491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2001) took 1921 ms (client timeout 2333 ms). Trace:
I20260709 13:07:41.839322 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:41.894975 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:41.946530 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.973047 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 221562us
I20260709 13:07:41.849016 16635 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:41.963191 16565 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:41.955930 17186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 719) took 1293 ms. Trace:
I20260709 13:07:41.891855 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1353) took 1085 ms. Trace:
I20260709 13:07:41.996544 16639 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:07:41.894636 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:41.879520 20267 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:07:41.992173 16640 rpcz_store.cc:276] 0709 13:07:40.861003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.837534 (+976531us) service_pool.cc:224] Handling call
0709 13:07:41.884098 (+ 46564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.884318 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.884343 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.884383 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:41.884411 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.884463 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.884551 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.839824 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:41.974608 20142 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.828s	user 0.000s	sys 0.017s
I20260709 13:07:41.954524 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:42.000480 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 233943us
I20260709 13:07:42.000663 16632 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
W20260709 13:07:41.993758 16491 rpcz_store.cc:269] 0709 13:07:39.971537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.369994 (+398457us) service_pool.cc:224] Handling call
0709 13:07:41.892484 (+1522490us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400259754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:41.892719 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004978560}
I20260709 13:07:41.996188 17186 rpcz_store.cc:276] 0709 13:07:40.662212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.667883 (+  5671us) service_pool.cc:224] Handling call
0709 13:07:41.950635 (+1282752us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54004cb154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:41.955846 (+  5211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572987264}
I20260709 13:07:41.996918 16487 rpcz_store.cc:276] 0709 13:07:40.791290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.657256 (+865966us) service_pool.cc:224] Handling call
0709 13:07:41.772420 (+115164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.805909 (+ 33489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.876108 (+ 70199us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540004fbd0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:41.876268 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264125312}
I20260709 13:07:41.892351 20145 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.003029 16633 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:41.878073 20137 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.000656 16563 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:41.950687 20185 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.008628 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1405) took 1144 ms. Trace:
W20260709 13:07:42.011086 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 82422.8us
I20260709 13:07:41.878055 20160 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:42.011363 16639 rpcz_store.cc:276] 0709 13:07:40.860184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.800167 (+939983us) service_pool.cc:224] Handling call
0709 13:07:41.995257 (+195090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.998247 (+  2990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.004851 (+  6604us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54003269d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:42.004967 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447839616}
I20260709 13:07:42.016623 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:42.017728 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.023990 16564 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:42.025061 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.025996 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:42.028066 16632 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:42.028473 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.029217 16632 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.029693 16639 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:42.026301 16640 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:42.027498 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.032228 16638 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:42.034520 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:42.036792 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1404) took 1177 ms. Trace:
I20260709 13:07:42.038652 16635 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:42.010648 20137 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:41.977773 20203 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 13:07:42.037160 16633 rpcz_store.cc:276] 0709 13:07:40.859023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.786831 (+927808us) service_pool.cc:224] Handling call
0709 13:07:41.787154 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.009391 (+222237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.036548 (+ 27157us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003f1954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:42.036736 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493844864}
I20260709 13:07:42.045459 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:41.994607 19986 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:42.082218 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1401) took 1194 ms. Trace:
I20260709 13:07:42.076709 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:42.092643 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:42.093366 16640 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:42.082656 16638 rpcz_store.cc:276] 0709 13:07:40.854242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.778601 (+924359us) service_pool.cc:224] Handling call
0709 13:07:41.778916 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.032638 (+253722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.041389 (+  8751us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540015d454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:42.047488 (+  6099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581983488}
I20260709 13:07:42.086241 16561 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:42.073094 20262 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.057317 20137 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.118896 20092 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.120375 20160 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.122164 20237 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.122560 20237 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:42.122936 20237 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.127991 19965 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:42.128414 19965 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.128715 19965 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.131922 20156 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.132443 20156 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.132897 20156 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:42.132843 20268 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 13:07:42.134320 16565 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:42.142143 16637 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:42.173003 20254 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.173658 20254 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.176162 20254 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:42.180248 20221 consensus_meta.cc:287] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 13:07:42.180672 20221 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.181668 16631 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:42.132124 20203 consensus_queue.cc:1243] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:42.216176 20185 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.235639 16564 raft_consensus.cc:2368] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
I20260709 13:07:42.039436 20005 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:42.308620 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.313850 16558 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:42.182678 20221 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:42.308519 20155 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.216952 19986 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.308576 20040 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:42.389178 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 49446.2us
W20260709 13:07:42.374599 17153 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.643s (SENT) [suppressed 14 similar messages]
W20260709 13:07:42.391594 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.394120 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.121035 20191 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.417891 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:42.185053 19965 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.418612 20155 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.427258 20040 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:42.432078 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.227926 20185 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.438725 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.440434 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:42.448750 16560 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.457973 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:42.458572 17184 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:42.461081 20005 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:42.461577 20191 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.462316 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:42.462857 16561 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:42.463670 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:42.471238 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.472829 20185 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.473531 20040 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.473742 16563 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:42.474895 16636 raft_consensus.cc:2410] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:42.476150 19965 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:42.477916 20150 consensus_meta.cc:287] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.684s	user 0.006s	sys 0.002s
I20260709 13:07:42.478313 20150 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.479456 16632 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.482309 20237 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.471540 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:42.488181 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.488566 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.490527 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:42.450438 20174 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.001s
I20260709 13:07:42.497071 16561 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:42.498379 17186 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.498806 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:42.504498 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:42.509872 17184 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.507988 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.510948 16484 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:42.515055 16563 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:42.518745 16635 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:42.519377 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 493) took 1232 ms. Trace:
I20260709 13:07:42.519622 16636 rpcz_store.cc:276] 0709 13:07:41.286927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.707509 (+420582us) service_pool.cc:224] Handling call
0709 13:07:42.516781 (+809272us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54000fcdd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:42.519328 (+  2547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761666304}
I20260709 13:07:42.519102 16635 pending_rounds.cc:85] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 7
I20260709 13:07:42.522495 16635 pending_rounds.cc:107] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:42.522778 16635 raft_consensus.cc:2889] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.523447 17186 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:42.507023 20160 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.525856 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:42.528250 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 508208us
I20260709 13:07:42.500062 20174 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.515866 20092 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.531539 16560 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:42.532095 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:42.533128 16563 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.535301 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.521551 20237 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.524868 20202 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.536794 16483 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:42.538214 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:42.539316 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.540975 16633 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.542733 16490 raft_consensus.cc:2368] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6.
I20260709 13:07:42.543260 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:42.543936 16487 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.545892 16632 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:42.549191 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.547202 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.551455 16489 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 7: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:42.551964 16482 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:42.550531 17152 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.048s
W20260709 13:07:42.555339 17152 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.012s	sys 0.048s
W20260709 13:07:42.555693 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 529372us
I20260709 13:07:42.557621 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:42.556799 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:42.558583 17186 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.558907 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:42.553630 20272 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:07:42.562122 16632 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:42.563071 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.564483 17187 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:42.561806 20202 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.564999 16562 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:42.562702 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:42.565882 17184 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:42.562711 16603 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.566584 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1406) took 1703 ms. Trace:
I20260709 13:07:42.566612 16490 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:42.553823 20237 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:42.570995 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2244) took 1333 ms. Trace:
I20260709 13:07:42.573386 16631 rpcz_store.cc:276] 0709 13:07:41.237136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.960567 (+723431us) service_pool.cc:224] Handling call
0709 13:07:41.978119 (+ 17552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.182035 (+203916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.570781 (+388746us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54003d1b54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:42.570943 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467663744}
I20260709 13:07:42.574033 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:42.556977 20150 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:42.576052 20221 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:42.577347 17184 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.568466 19877 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.578070 19877 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.578409 19877 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.580212 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:42.580713 17188 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.567237 16634 rpcz_store.cc:276] 0709 13:07:40.860726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.835778 (+975052us) service_pool.cc:224] Handling call
0709 13:07:41.977223 (+141445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.998929 (+ 21706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.998959 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.030497 (+ 31538us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.488250 (+457753us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:42.488286 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.488345 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.564058 (+ 75713us) raft_consensus.cc:1685] finished
0709 13:07:42.564076 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.564198 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10065,"raft.queue_time_us":17834,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10139,"thread_start_us":302401,"threads_started":1,"wal-append.queue_time_us":472336}
I20260709 13:07:42.584587 20234 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:42.574869 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.583268 16482 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:42.590940 17188 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:42.591837 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.593158 16489 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
W20260709 13:07:42.595709 20275 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.484s	user 0.005s	sys 0.006s
I20260709 13:07:42.596947 20202 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.585285 20262 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.590238 20234 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.599236 20234 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:42.600108 20234 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.602434 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.602905 16489 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:42.575223 20160 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.626142 17186 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:42.601315 20234 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.572809 20137 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.608893 20145 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:42.629098 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:42.602618 20142 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:42.634266 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 189141us
I20260709 13:07:42.635478 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:42.640446 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 104528us
I20260709 13:07:42.641629 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:42.643497 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.644131 16483 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.610411 20237 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.632387 19965 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.650802 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.653295 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:42.640358 20145 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:42.654042 16489 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:42.655346 16564 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:42.656139 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:42.659466 16560 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:42.661028 16482 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.662739 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:42.663246 16640 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:42.665302 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 57012.5us
I20260709 13:07:42.666144 16557 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.635867 20142 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.673828 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:42.664179 20279 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:07:42.679498 16488 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:42.680877 16488 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:42.682022 16488 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:42.683008 16488 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.684753 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:42.645430 19877 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.686693 20262 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.668573 20174 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:42.702877 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.701606 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.735330 16633 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:42.706238 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2246) took 1468 ms. Trace:
I20260709 13:07:42.727083 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:42.740901 16637 rpcz_store.cc:276] 0709 13:07:41.237975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.745013 (+507038us) service_pool.cc:224] Handling call
0709 13:07:42.706103 (+961090us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540015cf54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:42.706191 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599149312}
I20260709 13:07:42.706537 20165 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.732312 20155 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.705814 20093 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:42.743400 20093 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:42.727998 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:42.745913 20093 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.747153 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:07:42.747818 16487 raft_consensus.cc:606] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:42.747923 16563 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:42.746833 20093 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.725492 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:42.752169 16604 leader_election.cc:400] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6.
I20260709 13:07:42.752467 16604 leader_election.cc:403] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:42.754602 20221 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 5. Current term is 6.
I20260709 13:07:42.755275 20221 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:42.756595 20287 log.cc:927] Time spent T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:07:42.759028 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.759126 16485 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:42.758440 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.759260 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.760150 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.760497 16560 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.760900 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:42.761462 16558 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:42.740463 16489 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:42.763082 16636 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:42.763557 20145 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.706287 16486 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:42.777012 16640 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:42.667689 19965 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.784210 16563 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:42.784374 16560 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:42.785036 16482 raft_consensus.cc:2410] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:42.778352 16562 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:42.763226 20156 consensus_meta.cc:287] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.000s
W20260709 13:07:42.786432 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 84873.4us
I20260709 13:07:42.787473 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.788599 16483 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:42.789949 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 152335us
I20260709 13:07:42.792034 20165 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.792848 20137 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:42.792865 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 45058.1us
I20260709 13:07:42.792062 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:42.807195 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.799687 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:42.800441 20156 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.702622 20160 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.707952 20262 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:42.801949 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 134778us
I20260709 13:07:42.813481 16490 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:42.802402 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 102904us
I20260709 13:07:42.810451 16483 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:42.811535 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.811651 16488 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:42.811770 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.812078 16566 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:42.812397 17185 raft_consensus.cc:2393] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:42.814846 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:42.820667 16491 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:42.819331 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:42.818135 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:42.825049 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.826033 16489 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:42.826684 16486 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:42.823961 20092 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.827971 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:42.828356 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:42.827724 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.830073 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.813598 20165 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:42.836485 20263 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:42.837502 20165 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.818377 20288 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.838639 20288 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.836390 16565 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.840080 16565 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:42.840555 20288 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.836675 16562 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:42.831331 16563 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:42.829663 20092 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.842367 16563 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:42.843109 16563 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.843703 20092 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.833050 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.840776 16565 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.818970 19835 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 13:07:42.831265 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82af48cecc58434e959547ec318fa4c5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:42.844681 16565 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.833774 16561 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:42.845582 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.844342 20156 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:42.847123 16563 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.841447 20237 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.852682 20092 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.853111 20092 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:42.853466 20092 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.854334 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:42.855034 16559 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:42.855304 20137 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:42.855851 20288 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:42.856182 20137 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.856855 20093 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.857244 20093 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.857517 20137 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.858119 20137 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:42.834355 20262 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:42.858345 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:42.834995 20005 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:42.857594 20093 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.856658 20288 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:42.836030 16560 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.864511 16560 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:42.864821 20156 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:42.865375 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.865262 16560 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.844801 19965 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:42.866185 16560 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:42.858376 17153 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.132s (SENT)
I20260709 13:07:42.858593 20174 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:42.858714 20262 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.868292 20262 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:42.867929 20174 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:42.856508 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:42.869419 20174 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.870530 20174 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.870766 20185 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.871253 20185 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:42.864854 20011 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:07:42.872160 20185 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:42.873636 16566 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:42.863893 16561 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:42.867892 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:42.879470 17186 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.865192 20156 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:42.875185 16566 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:42.856679 19877 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:42.882109 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:42.882810 16559 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.873826 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 10 to 11, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 11 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.864530 20137 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.882702 19877 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:07:42.882181 20156 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.893246 16559 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:42.882827 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:42.878530 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:42.836650 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:42.899575 16557 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:42.904356 16560 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:42.904698 16560 pending_rounds.cc:85] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:07:42.904906 16560 pending_rounds.cc:107] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:42.905131 16560 raft_consensus.cc:2889] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.905639 16563 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:42.906949 16565 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:42.907464 16565 pending_rounds.cc:85] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
W20260709 13:07:42.907259 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 80179.9us
I20260709 13:07:42.907912 16565 pending_rounds.cc:107] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:42.908185 16565 raft_consensus.cc:2889] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.919656 16566 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.920136 19835 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.920428 20221 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.919592 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:42.920917 20155 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.921638 20155 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:42.923023 20237 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:42.919953 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 83412.7us
I20260709 13:07:42.924814 20237 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:42.925292 20237 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:42.925645 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.925894 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:42.927711 20160 raft_consensus.cc:2764] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:07:42.928390 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:42.920840 16566 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.931695 17186 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
W20260709 13:07:42.931881 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.843609 20142 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:42.929163 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:42.939575 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.941655 16603 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:42.923561 20155 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:42.940891 16389 catalog_manager.cc:5697] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 3 to 6, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 6 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:42.947700 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 64950.8us
W20260709 13:07:42.952581 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.966143 16389 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 9 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:43.003414 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 54607.9us
I20260709 13:07:42.947602 20254 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:07:43.005601 20254 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:43.005959 20254 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:43.006794 20254 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.007892 19965 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:42.996127 20288 consensus_queue.cc:1175] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "035eaa2f12374a81a4df7868a5453d3c" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:07:43.012420 20254 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.013442 20185 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:42.948218 20137 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:07:43.017012 16566 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:42.951012 20203 consensus_queue.cc:1059] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:07:42.950587 20145 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:43.022207 16385 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 226) took 14813 ms (client timeout 15000 ms). Trace:
I20260709 13:07:43.027294 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:43.022863 20203 raft_consensus.cc:3055] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:43.028945 20203 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:43.029846 20203 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.030972 20203 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.032018 20092 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:43.034610 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 85458.3us
W20260709 13:07:43.036720 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 107599us
I20260709 13:07:42.951444 20295 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.039213 20165 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.039075 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:43.031961 20142 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.042531 20142 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.023171 20262 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.044150 20262 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.044713 20142 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:43.045231 20142 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:43.045552 20142 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.039072 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:43.055835 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51754.5us
I20260709 13:07:43.022607 20156 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.063382 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:43.065047 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:43.034237 20298 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:43.021961 20011 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:43.072795 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 142696us
I20260709 13:07:43.027626 20155 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:43.075405 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.045881 20142 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.076982 16456 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:43.079888 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.080453 16389 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 9 to 11, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 11 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.059712 20005 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.077566 20155 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:43.089762 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.085209 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.091068 20202 raft_consensus.cc:993] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:07:43.025369 20237 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.017877 20093 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:43.096863 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 242616us
I20260709 13:07:43.096671 16389 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.084614 20191 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.101168 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.108073 16563 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:43.102346 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.102581 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:43.103082 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.104838 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.109025 16565 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:43.086360 20137 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:43.074414 20295 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:43.124214 20301 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:43.124431 20295 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:43.125010 20297 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:43.126581 20237 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.098515 20155 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.106010 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:43.108757 16559 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:43.110358 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.111409 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.112114 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.128283 16561 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:43.111605 20093 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.111953 20202 raft_consensus.cc:1081] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:07:43.112396 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:43.133589 16557 raft_consensus.cc:2376] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8. Re-sending same reply.
I20260709 13:07:43.113101 20304 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.097450 20092 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.116518 16389 catalog_manager.cc:5697] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 10 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.117267 17185 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:43.098603 20005 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:43.120584 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 57280.8us
I20260709 13:07:43.104851 20011 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:43.133071 20306 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.132654 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:43.082890 20145 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:43.142150 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:43.143288 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:43.127504 19986 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:43.165587 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.215176 16566 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.208349 16456 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:43.140515 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.152064 16389 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 11, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 11 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.218200 20137 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.223102 20137 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.223613 20092 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.224038 20092 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:43.224407 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 78645.6us
I20260709 13:07:43.225652 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:43.026575 16385 rpcz_store.cc:269] 0709 13:07:28.193696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.200366 (+  6670us) service_pool.cc:224] Handling call
0709 13:07:42.951774 (+14751408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:41.332978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:41.336334 (+  3356us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:41.336371 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:07:41.336384 (+    13us) tablet.cc:662] Decoding operations
0709 13:07:41.337016 (+   632us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:41.337051 (+    35us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:41.337067 (+    16us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:41.337527 (+   460us) tablet.cc:701] Row locks acquired
0709 13:07:41.337538 (+    11us) write_op.cc:260] PREPARE: finished
0709 13:07:41.337787 (+   249us) write_op.cc:270] Start()
0709 13:07:41.337859 (+    72us) write_op.cc:276] Timestamp: P: 1783602461337606 usec, L: 0
0709 13:07:41.337879 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:41.338306 (+   427us) log.cc:844] Serialized 3935 byte log entry
0709 13:07:41.343472 (+  5166us) op_driver.cc:464] REPLICATION: finished
0709 13:07:41.472090 (+128618us) write_op.cc:301] APPLY: starting
0709 13:07:41.472307 (+   217us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:41.472716 (+   409us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:41.472913 (+   197us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:41.484595 (+ 11682us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:41.485053 (+   458us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:41.485130 (+    77us) write_op.cc:312] APPLY: finished
0709 13:07:41.485734 (+   604us) log.cc:844] Serialized 77 byte log entry
0709 13:07:41.486045 (+   311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:41.486462 (+   417us) write_op.cc:454] Released schema lock
0709 13:07:41.486548 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:41.606807 (+120259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:41.606858 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17406,"reported_tablets":49,"spinlock_wait_cycles":74496,"child_traces":[["op",{"apply.queue_time_us":784,"apply.run_cpu_time_us":5519,"apply.run_wall_time_us":128480,"num_ops":10,"prepare.queue_time_us":178480,"prepare.run_cpu_time_us":5468,"prepare.run_wall_time_us":10145,"raft.queue_time_us":721,"raft.run_cpu_time_us":1089,"raft.run_wall_time_us":117824,"replication_time_us":5475,"thread_start_us":222359,"threads_started":4,"wal-append.queue_time_us":2836,"wal-append.run_cpu_time_us":3379,"wal-append.run_wall_time_us":1150350}]]}
I20260709 13:07:43.224453 20092 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:43.231207 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.233642 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.233451 16558 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:43.139634 20191 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:43.242057 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 109489us
I20260709 13:07:43.248111 16455 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:43.203145 20221 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.254966 16566 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:43.147579 19877 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.145571 20304 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:43.248893 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 106812us
I20260709 13:07:43.217211 19986 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:43.147279 20300 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:43.257858 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:43.261158 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:43.262107 16389 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 9 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 12 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:43.266640 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 119513us
I20260709 13:07:43.264889 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.272258 16558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:07:43.272857 16558 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.273175 16558 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.277273 20308 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.260210 20165 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.279906 20150 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.280390 20150 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:43.264180 19986 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.274991 16389 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 9 to 10, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:43.279379 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.280788 20150 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.284940 20142 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.286859 20142 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:43.285844 16389 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 9 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 10 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.283423 20040 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:43.288566 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:43.268540 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:43.291908 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 252884us
I20260709 13:07:43.292061 16558 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.256587 20160 raft_consensus.cc:2764] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:43.304638 16564 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:43.304766 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 43690.3us
I20260709 13:07:43.305470 16389 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:43.280663 20005 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.312951 20093 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.313495 20093 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:43.314324 20093 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.314807 20092 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.265488 20263 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:07:43.316752 20263 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:43.317150 20263 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:43.317806 20092 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:43.292398 20254 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:43.318571 20304 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.319947 20145 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.304405 20142 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:43.324028 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:43.327623 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:43.328159 16638 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.328299 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:43.329135 16635 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.223973 20137 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.291226 20237 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:43.343408 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:43.332744 16558 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:43.332665 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 64203.2us
I20260709 13:07:43.344360 16633 raft_consensus.cc:2410] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:07:43.332898 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.344988 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:43.347805 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.350023 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:43.350214 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:43.296079 20165 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.350982 16636 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:43.307880 20288 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.351655 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:43.351382 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:43.353363 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 60200.1us
I20260709 13:07:43.353732 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:43.352427 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 73399.6us
I20260709 13:07:43.357476 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:43.360553 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:43.356033 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:43.363018 16636 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.363281 20312 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:43.363706 20312 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.357808 20317 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:43.364411 20202 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:43.363443 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.359236 20295 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.332377 20314 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:07:43.365804 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.366010 20156 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.366405 20156 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.366744 20156 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.367703 20262 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.368330 20165 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.369074 20300 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:43.369967 20300 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:43.370434 20300 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.343362 20174 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.358994 16605 leader_election.cc:400] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
I20260709 13:07:43.365240 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.371493 16605 leader_election.cc:403] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:43.332635 20221 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:07:43.357398 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.321013 20191 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.372803 20174 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.372923 20300 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.372048 19965 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:43.373600 19965 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.353605 20011 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.360869 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:43.376817 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.378669 16636 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:43.384366 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:43.387815 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.372120 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:43.389003 16562 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.391889 16486 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:43.402170 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:43.403522 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.407766 16635 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:43.373198 20174 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.364099 20312 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:43.409569 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.391535 16389 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 9 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:43.320962 20155 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.411936 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:43.413502 16484 raft_consensus.cc:2410] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:43.413805 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:43.414402 16491 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:43.414781 16530 leader_election.cc:400] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:43.415069 16530 leader_election.cc:403] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:43.415990 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 58608.5us
I20260709 13:07:43.354694 20237 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.374313 19965 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.415515 20092 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.364926 20202 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.419109 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:43.427665 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 53453.9us
I20260709 13:07:43.355332 20308 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:43.418298 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:43.428761 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.429203 16389 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:43.430620 19835 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
W20260709 13:07:43.431674 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.318084 20263 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.434963 16638 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:43.412115 20300 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.411903 20295 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:43.436182 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 77333.9us
I20260709 13:07:43.436192 16389 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:43.437546 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:43.417090 20160 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.438581 16488 raft_consensus.cc:1217] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:07:43.442315 16488 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:43.440605 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:43.416468 20156 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.442265 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:43.439599 20142 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:07:43.455150 20156 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.458076 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:43.458578 16558 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.444046 16389 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 4 to 8, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 8 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.456583 20263 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.438575 20262 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.439942 20295 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:43.442047 20160 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.465544 16389 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 9 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.436810 20306 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:43.442723 20092 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.460132 19965 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.462612 20137 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.443476 20234 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:07:43.477667 20237 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.453312 20314 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:07:43.476357 16558 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:43.465247 20318 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:43.445075 19877 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:43.441377 20300 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.467640 20295 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.479197 16389 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 9, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 9 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.469590 20160 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.476543 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:43.487247 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.509117 20326 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:43.510244 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 91994.2us
I20260709 13:07:43.471752 20317 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:43.521195 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:43.478696 20234 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:43.549885 20165 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.521093 20254 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.520290 20307 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 7. Current term is 8.
W20260709 13:07:43.561187 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 52310.5us
I20260709 13:07:43.566527 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:43.567931 20326 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.568864 20319 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.569473 20322 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.570109 20310 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.526536 20317 consensus_queue.cc:1243] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:43.526821 20137 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.591140 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 66773.6us
I20260709 13:07:43.512239 20202 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.566256 20306 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:43.593910 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:43.593436 16389 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 8, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 8 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:43.597301 17185 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.585428 20165 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.598042 17186 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:43.598223 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 111050us
I20260709 13:07:43.564100 20040 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:43.586669 20155 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.524987 20262 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.513806 20308 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.605020 16389 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 9 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:07:43.608122 16558 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.591737 20319 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:43.611162 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:43.611555 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 90491.4us
I20260709 13:07:43.612886 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:43.591092 19877 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:43.597651 20310 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:43.614883 16563 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:43.614199 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 145237us
I20260709 13:07:43.615427 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:43.620950 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:43.609527 20318 raft_consensus.cc:697] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:43.596479 20280 consensus_queue.cc:1059] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:07:43.612533 20328 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.595746 19986 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.593035 20137 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.660344 16389 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 8, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 8 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:43.662504 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 47118.9us
I20260709 13:07:43.614455 20314 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.671749 16558 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:43.673571 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:43.673259 20165 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.676116 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.676772 16564 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:43.676610 20319 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.595196 20322 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.673166 20335 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:43.679227 20322 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.680016 20317 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.680701 20317 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:43.681720 20318 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.680040 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:43.682976 16560 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
W20260709 13:07:43.683872 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.684520 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 71713.8us
I20260709 13:07:43.686480 20174 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.599169 20306 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.621912 19877 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.689234 20306 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:43.689675 19877 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:43.690099 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:43.690846 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:43.692103 19986 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.690178 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:43.692380 16487 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:43.693939 20150 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.690847 19877 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:43.682178 20317 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.696519 16637 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:43.696882 20317 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.698843 20317 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:43.699298 20317 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:43.697207 20328 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.700093 20092 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:43.676189 20323 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:07:43.700562 20328 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.701305 20310 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:43.702246 20324 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:07:43.706297 16489 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:07:43.659736 20203 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:43.716182 16484 raft_consensus.cc:2410] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:43.723433 17185 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:43.725520 16562 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:43.725450 16389 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 6 to 7, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 7 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.728154 16483 pending_rounds.cc:85] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 4
I20260709 13:07:43.728435 16483 pending_rounds.cc:107] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:43.728649 16483 raft_consensus.cc:2889] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:43.729122 16563 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:43.759063 16389 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 9 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.760046 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:43.726226 20203 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:43.761246 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 101277us
I20260709 13:07:43.725971 20335 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.764801 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:43.738435 20150 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:43.766536 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:43.766929 16389 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 9, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 9 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.768919 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:43.765008 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:43.737275 20314 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:43.785401 16490 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
W20260709 13:07:43.796353 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.807163 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53208.5us
I20260709 13:07:43.810683 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:43.765738 19877 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.821552 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:43.822674 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:43.829280 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:43.828936 16389 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 9 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.830595 16389 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 10, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 10 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.779992 20300 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:43.837090 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:43.834661 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:43.775971 20339 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.836048 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.838397 16490 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:43.840243 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 126526us
I20260709 13:07:43.843425 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:43.956099 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 112727us
I20260709 13:07:43.899398 16389 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 10 to 11, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 11 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:43.968237 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:43.970753 16639 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:07:43.959168 16389 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 7 to 11, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 11 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:43.968655 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 202177us
I20260709 13:07:43.930531 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:43.974354 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:43.974922 17179 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:43.979364 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 171541us
I20260709 13:07:43.981786 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:43.982065 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:43.833954 20185 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 13:07:43.840263 20288 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.835716 19877 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:43.880648 20174 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:43.909669 20300 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:43.910501 20092 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.842902 20332 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.812531 20314 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:44.000072 19965 consensus_meta.cc:287] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.525s	user 0.001s	sys 0.008s
W20260709 13:07:44.006501 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 182868us
I20260709 13:07:43.843945 20312 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:43.993755 20288 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.074882 16488 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:44.001073 20342 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 13:07:43.910101 20203 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.142221 16482 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:07:43.955574 20339 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.150419 20333 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.016036 20092 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:43.953784 20310 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:07:44.169848 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 187842us
I20260709 13:07:44.172386 20342 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:07:44.176580 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 203532us
I20260709 13:07:44.177299 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:44.179972 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.151019 20333 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.148202 20203 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.190871 17179 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:44.010902 20332 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:44.152027 20137 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:44.196187 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 194748us
I20260709 13:07:43.982587 20335 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:44.216113 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.176465 20339 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.221978 16485 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:44.225415 20321 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.225800 20321 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:44.226588 20321 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.227583 20321 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.210371 20344 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:44.211524 20347 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:07:44.196195 20332 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.212380 20314 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.259997 20353 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.251080 20339 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:44.211616 20338 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.270s
I20260709 13:07:44.250895 20326 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:44.288527 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.257009 20310 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:44.309108 20341 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.410s	user 0.000s	sys 0.000s
I20260709 13:07:44.316890 20005 raft_consensus.cc:3055] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:44.317289 20005 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:44.318029 20005 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:44.318984 20355 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:07:44.322046 20333 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.318958 20005 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.325402 20093 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:44.325896 20093 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.297308 20326 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:44.331972 20093 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:44.333612 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.333562 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 517466us
I20260709 13:07:44.334821 19986 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.335914 20280 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:44.336452 20280 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.338371 20280 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:44.340071 20346 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
I20260709 13:07:44.296624 20092 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.343845 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:44.347671 16558 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.335274 19986 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:44.356995 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 179751us
I20260709 13:07:44.287436 20314 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.359915 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:44.299326 20142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.019s	sys 0.000s
I20260709 13:07:44.365082 16638 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:44.288475 20339 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:44.361200 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:44.367214 16632 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.235419 20318 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:07:44.365845 16639 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.370075 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.329465 20326 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.297952 20310 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:44.335361 20288 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.370393 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:44.376881 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.377020 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.370018 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.379681 16634 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:44.382076 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:44.370265 20142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.019s	sys 0.000s
I20260709 13:07:44.383212 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:44.382625 16631 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:44.383186 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.387224 20314 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:44.387897 20314 consensus_queue.cc:1243] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:44.390491 20263 consensus_meta.cc:287] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.923s	user 0.005s	sys 0.002s
I20260709 13:07:44.392493 19986 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.392187 20310 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.393553 20310 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.395978 20352 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:44.396553 20352 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.397192 20332 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.398504 20352 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.399250 20326 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.383601 16635 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:44.383721 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.405418 16636 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:44.405758 16558 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:07:44.369679 20339 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:44.408566 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.411341 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.267560 20353 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.374548 20191 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:44.374389 20280 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:44.414005 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:44.416817 20345 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.572s	user 0.000s	sys 0.025s
I20260709 13:07:44.419147 20150 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:44.421913 20317 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.430274 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.439653 16454 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.440534 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.442404 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.444258 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:44.445335 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 74499.7us
I20260709 13:07:44.449012 16564 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:44.449198 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:44.452795 20160 consensus_meta.cc:287] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.930s	user 0.008s	sys 0.000s
I20260709 13:07:44.453183 20160 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.454198 16558 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:44.406741 20312 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:44.457779 20357 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.427057 20174 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.461362 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:44.472417 16560 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.460897 16562 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:44.473502 16633 raft_consensus.cc:2410] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:07:44.477514 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.477934 16632 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:44.481809 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.483851 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.484921 16489 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:44.486006 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.487282 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:44.488078 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.456934 20332 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:44.462040 20354 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.475957 20234 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.489125 17184 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.459775 20280 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:44.491415 20295 consensus_meta.cc:287] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.970s	user 0.007s	sys 0.001s
I20260709 13:07:44.488498 16564 raft_consensus.cc:2410] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:44.473711 20191 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.462244 20092 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.484995 19877 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:44.494992 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45865.8us
I20260709 13:07:44.495826 20379 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.496239 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:44.502885 16560 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:44.524525 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:44.477192 20174 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.535985 16561 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:44.537243 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:44.556668 16484 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:44.551014 20005 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.557533 17153 leader_election.cc:336] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 3.354s (SENT)
I20260709 13:07:44.557977 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.536919 20234 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.548969 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.560283 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.561441 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:44.549226 20371 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:44.549149 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:44.551201 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.532254 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2282) took 1096 ms. Trace:
I20260709 13:07:44.564843 16637 rpcz_store.cc:276] 0709 13:07:43.400014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.400117 (+   103us) service_pool.cc:224] Handling call
0709 13:07:43.423394 (+ 23277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.696863 (+273469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.496236 (+799373us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002fc954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:44.496377 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627722368}
I20260709 13:07:44.559535 17181 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:44.555953 16489 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:44.557168 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.566430 16561 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:44.567057 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:44.555696 16491 raft_consensus.cc:2368] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:44.568984 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.569604 16560 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:44.550364 20295 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.557559 20005 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.573503 16491 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:07:44.574509 20295 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:44.575006 20005 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:44.556198 20379 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.579094 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.582971 16632 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:44.558990 20332 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.584895 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.562949 19877 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.575758 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:44.591044 17153 leader_election.cc:336] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.649s (SENT)
I20260709 13:07:44.622792 20360 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.623291 20360 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.625269 20360 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.626969 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.627517 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:44.630697 16563 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:44.593075 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:44.585032 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:44.626187 20376 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.620093 20344 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.632301 16632 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:44.632022 16530 connection.cc:256] RPC call timeout handler was delayed by -1.5169318419999627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:07:44.633605 16530 connection.cc:256] RPC call timeout handler was delayed by -1.4062318420000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:07:44.634315 16530 connection.cc:256] RPC call timeout handler was delayed by -1.4062318420000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:07:44.634589 16530 connection.cc:256] RPC call timeout handler was delayed by -1.4044318420000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:07:44.634783 16530 connection.cc:256] RPC call timeout handler was delayed by -1.3189318419999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:07:44.635003 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1470318420000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:07:44.635340 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.635221 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0714318420000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 13:07:44.636171 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0687318420000338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:07:44.636898 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.642488 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:44.643639 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:44.599910 20379 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.644881 16559 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:44.599058 20353 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.598126 20191 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.645735 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:44.601033 20174 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:44.632668 20005 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.650092 16489 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:44.601440 20295 raft_consensus.cc:2764] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:44.598340 20383 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:07:44.655701 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.656423 16486 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 13. Ops: [11.6-11.6]
I20260709 13:07:44.656443 16559 raft_consensus.cc:2410] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:44.639441 20234 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:44.646312 20142 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:44.660933 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69923us
I20260709 13:07:44.646658 20332 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.648329 20360 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:44.663867 16632 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:44.628360 19877 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:44.665367 17153 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.734s (SENT)
I20260709 13:07:44.666226 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.667155 17153 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.667313 16559 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:44.668622 16486 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:44.667514 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:44.671675 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:44.678097 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:44.679014 16632 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.677696 20308 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.677838 20360 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:44.681474 20360 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.682379 16559 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:44.683116 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:44.683835 16559 raft_consensus.cc:2410] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:44.684602 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.686686 16486 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:44.633788 20376 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.717957 20359 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:07:44.719043 20376 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:44.719923 20395 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:44.721679 16530 leader_election.cc:400] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:44.722599 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.723443 20393 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.725194 20326 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.725478 20393 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.725687 20326 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:44.726011 20393 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.726581 20326 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.727741 20326 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:44.728000 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 62656.5us
I20260709 13:07:44.728139 20393 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.729125 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.671391 20295 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.657940 20005 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.732308 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:44.685209 20321 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:44.753008 16559 pending_rounds.cc:85] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 4
I20260709 13:07:44.755952 16559 pending_rounds.cc:107] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:07:44.756201 16559 raft_consensus.cc:2889] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.736030 20300 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.755110 20237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.012s
I20260709 13:07:44.736547 20295 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:44.769420 16489 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.774760 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.777006 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.778194 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.779088 20263 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.779280 20174 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.753618 19986 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:44.779729 20174 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.780326 19986 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.781306 20384 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:07:44.781656 20174 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:44.783154 20005 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:44.783728 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.784158 17153 leader_election.cc:336] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.925s (SENT)
I20260709 13:07:44.784538 20280 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:44.768270 20379 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:44.787056 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.810850 16562 raft_consensus.cc:2410] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:44.811460 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:44.779874 20393 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.813895 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:44.761106 20321 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:44.814667 16562 raft_consensus.cc:2410] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:07:45.317391 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 62771.4us
W20260709 13:07:45.352416 17153 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.231s (SENT)
I20260709 13:07:45.132579 20392 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.105572 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.814638 16632 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:44.770599 20237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.012s	sys 0.012s
I20260709 13:07:44.815363 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:44.873587 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.355387 16566 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:45.355737 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:45.356359 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.356824 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:45.341269 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:45.358016 16489 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:44.866166 16637 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:44.784121 20388 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:07:44.974834 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.814591 16486 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:45.364594 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 586455us
I20260709 13:07:45.358604 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:45.357013 16566 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:45.374029 16558 raft_consensus.cc:2376] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9. Re-sending same reply.
I20260709 13:07:44.879356 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.376354 16561 raft_consensus.cc:2410] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:45.377055 16565 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:45.380944 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:44.788337 20390 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:44.792302 20375 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.013669 20401 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:07:45.390636 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:45.376784 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:45.391516 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.400210 16562 raft_consensus.cc:2393] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:45.396261 17153 leader_election.cc:336] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.643s (SENT)
I20260709 13:07:45.327128 20005 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:45.401067 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:44.956171 20263 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.162643 19877 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:44.795230 20300 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.404534 16566 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:45.374862 20379 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.401548 16489 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:45.412388 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:45.405104 20339 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.976s	user 0.010s	sys 0.000s
W20260709 13:07:45.416479 17187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.015s	sys 0.019s
I20260709 13:07:45.399187 20393 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.418311 17187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.015s	sys 0.019s
I20260709 13:07:45.405254 20375 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.356977 20392 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:44.878145 20295 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:45.434489 20398 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.521s	user 0.001s	sys 0.000s
I20260709 13:07:45.439913 16566 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:45.440852 16566 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:45.441979 16566 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.407375 20005 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.432899 20393 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.411473 20321 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.446823 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2059) took 1036 ms. Trace:
I20260709 13:07:45.450394 16489 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:45.437732 20328 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:45.428033 20339 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.452091 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:45.455056 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.447196 16488 rpcz_store.cc:276] 0709 13:07:44.410571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.410693 (+   122us) service_pool.cc:224] Handling call
0709 13:07:44.427218 (+ 16525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.459653 (+ 32435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.459681 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.461588 (+  1907us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.560454 (+ 98866us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:44.560492 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.560551 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.446633 (+886082us) raft_consensus.cc:1685] finished
0709 13:07:45.446658 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.446768 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32097,"raft.queue_time_us":34932,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":98546,"threads_started":1,"wal-append.queue_time_us":177594}
I20260709 13:07:45.456071 16566 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.444911 20408 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:45.460902 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2046) took 1771 ms. Trace:
I20260709 13:07:45.461288 16482 rpcz_store.cc:276] 0709 13:07:43.689316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.693623 (+  4307us) service_pool.cc:224] Handling call
0709 13:07:43.693902 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.142651 (+448749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.459325 (+1316674us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54002e3bd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:45.460841 (+  1516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030516096}
I20260709 13:07:45.496001 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:45.496862 16488 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:45.497733 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:45.508525 16488 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:45.509306 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:45.510399 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:45.511819 20379 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.512324 20379 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.514227 20379 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.525072 20375 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.526891 16488 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:45.530081 16489 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:45.533074 16489 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:07:45.533380 16489 pending_rounds.cc:85] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 10
I20260709 13:07:45.533582 16489 pending_rounds.cc:107] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:07:45.534071 16489 raft_consensus.cc:2889] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.458660 20328 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:45.533574 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72648.2us
I20260709 13:07:45.558677 16488 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:45.561028 20160 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.562001 20160 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.564119 20366 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.566983 20373 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:45.572346 20333 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.572829 20333 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.576396 20333 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:45.596463 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:45.597277 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:45.598135 20011 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.600785 16484 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:45.580448 20373 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:45.581554 20338 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.601970 16484 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:45.596138 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:45.604199 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:45.604343 20221 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.598173 20389 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.605538 20389 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:45.605916 20389 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.606649 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:45.601913 20338 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.608115 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:45.609647 20338 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:45.610127 20338 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:45.610423 20338 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:45.611125 20338 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.605018 20318 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:45.616835 20318 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:45.617623 20318 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.617950 20142 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:45.618600 20318 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.619415 20142 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.592105 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.620750 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.621906 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.622402 16560 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:45.623281 16560 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:45.611539 20011 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.604951 20221 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:45.604184 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:45.625746 20221 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:45.626085 20221 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:45.626834 20221 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.605212 20370 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.628113 16490 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:45.628225 20370 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.628654 20370 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.616160 20333 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:45.628819 20145 consensus_queue.cc:1175] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "035eaa2f12374a81a4df7868a5453d3c" responder_term: 10 status { last_received { term: 10 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 10 index: 5 } }
I20260709 13:07:45.629102 20333 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:45.629498 20333 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.632133 20221 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.634078 20142 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.634523 20142 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:45.636961 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.638044 20366 consensus_queue.cc:1059] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:45.623611 16560 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:45.639581 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2047) took 1950 ms. Trace:
I20260709 13:07:45.639405 16560 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.639753 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:45.640129 20370 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.639961 16485 rpcz_store.cc:276] 0709 13:07:43.689589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.690796 (+  1207us) service_pool.cc:224] Handling call
0709 13:07:43.691077 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.222371 (+531294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.639350 (+1416979us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54000e7254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:45.639531 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220278144}
I20260709 13:07:45.640916 20262 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:45.623214 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 514) took 1039 ms. Trace:
I20260709 13:07:45.642503 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2288) took 1281 ms. Trace:
I20260709 13:07:45.642840 16633 rpcz_store.cc:276] 0709 13:07:44.361143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.376648 (+ 15505us) service_pool.cc:224] Handling call
0709 13:07:45.642322 (+1265674us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b54003d2a54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:45.642453 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210244864}
W20260709 13:07:45.643298 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.641927 16637 rpcz_store.cc:276] 0709 13:07:44.583531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.633840 (+ 50309us) service_pool.cc:224] Handling call
0709 13:07:44.644494 (+ 10654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.372749 (+728255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.622990 (+250241us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001f9fd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:45.623156 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509323648}
I20260709 13:07:45.644232 20385 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.641505 20262 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:45.645130 20343 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.452s	user 0.010s	sys 0.012s
I20260709 13:07:45.646556 20262 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:45.647053 20262 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.651268 20370 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.651723 20160 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.656631 20160 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.641546 16485 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:45.644734 20385 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.660976 20385 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.653630 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.662217 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.662734 16564 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 5.
I20260709 13:07:45.663493 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.664638 16482 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:45.665011 16564 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:45.665729 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:45.666286 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.666613 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.657930 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2058) took 1902 ms. Trace:
W20260709 13:07:45.667200 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.667064 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82af48cecc58434e959547ec318fa4c5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:07:45.667714 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.652943 16560 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.664522 20160 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.667218 16490 rpcz_store.cc:276] 0709 13:07:43.755290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.305887 (+550597us) service_pool.cc:224] Handling call
0709 13:07:44.306150 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.628526 (+1322376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.657718 (+ 29192us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002d7654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:45.657875 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3039725312}
I20260709 13:07:45.676196 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.676787 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:45.663970 20389 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.667104 16564 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:45.676759 16557 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:45.684494 16488 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:45.684873 16488 pending_rounds.cc:85] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 8
I20260709 13:07:45.685084 16488 pending_rounds.cc:107] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:45.685299 16488 raft_consensus.cc:2889] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.688585 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:45.689118 16564 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:45.689999 16564 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:45.690482 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 478) took 1046 ms. Trace:
I20260709 13:07:45.647437 20262 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.696009 16560 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:45.696370 16560 pending_rounds.cc:85] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 4
I20260709 13:07:45.467947 20408 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.690814 16564 rpcz_store.cc:276] 0709 13:07:44.644412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.689622 (+1045210us) service_pool.cc:224] Handling call
0709 13:07:45.689865 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.690295 (+   430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.690437 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.704149 16560 pending_rounds.cc:107] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:45.704453 16560 raft_consensus.cc:2889] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.709756 16566 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:45.690367 20349 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.662259 20333 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:45.644501 20322 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.709916 20405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.026s	sys 0.067s
W20260709 13:07:45.764220 20405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.026s	sys 0.068s
I20260709 13:07:45.710111 16566 pending_rounds.cc:85] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:07:45.765045 16566 pending_rounds.cc:107] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:45.765303 16566 raft_consensus.cc:2889] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.766010 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2049) took 1129 ms. Trace:
I20260709 13:07:45.766364 16566 rpcz_store.cc:276] 0709 13:07:44.636550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.414392 (+777842us) service_pool.cc:224] Handling call
0709 13:07:45.431129 (+ 16737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.765777 (+334648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.765960 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.767604 16566 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:45.780884 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.768275 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 482) took 1089 ms. Trace:
I20260709 13:07:45.806960 16566 rpcz_store.cc:276] 0709 13:07:44.679010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.767141 (+1088131us) service_pool.cc:224] Handling call
0709 13:07:45.767434 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.768048 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.768217 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.808748 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 483) took 1090 ms. Trace:
I20260709 13:07:45.809155 16566 rpcz_store.cc:276] 0709 13:07:44.717982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.807919 (+1089937us) service_pool.cc:224] Handling call
0709 13:07:45.808262 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.808431 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.808456 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.808496 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.808525 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.808575 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.808692 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.810489 16566 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:45.814496 20411 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.728940 20406 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:07:45.729646 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:45.730134 20402 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:07:45.732579 16564 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:45.737313 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.736109 20370 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.742070 20005 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.743817 20328 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.723011 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2050) took 1086 ms. Trace:
I20260709 13:07:45.744112 20322 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.744652 20392 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:45.818357 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 422091us
I20260709 13:07:45.745883 20389 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.746520 20339 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:45.748214 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2041) took 1208 ms. Trace:
I20260709 13:07:45.819108 20422 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:45.746910 20300 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.750665 20288 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.751813 20185 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:07:45.759586 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 481) took 1091 ms. Trace:
I20260709 13:07:45.924211 16563 rpcz_store.cc:276] 0709 13:07:44.539719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.636254 (+ 96535us) service_pool.cc:224] Handling call
0709 13:07:44.649250 (+ 12996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.664297 (+ 15047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.664329 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.677197 (+ 12868us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.955711 (+278514us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:44.955755 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.955844 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.747979 (+792135us) raft_consensus.cc:1685] finished
0709 13:07:45.748005 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.748134 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16676,"raft.queue_time_us":12928,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3848,"spinlock_wait_cycles":14720,"thread_start_us":200674,"threads_started":1,"wal-append.queue_time_us":718570}
I20260709 13:07:45.725911 20408 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.929764 16557 rpcz_store.cc:276] 0709 13:07:44.668611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.758853 (+1090242us) service_pool.cc:224] Handling call
0709 13:07:45.759136 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.759313 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.759337 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.759374 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.759402 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.759451 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.759538 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.931403 16557 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:45.931720 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:45.931957 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 495) took 1210 ms. Trace:
I20260709 13:07:45.932314 16557 rpcz_store.cc:276] 0709 13:07:44.721250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.930850 (+1209600us) service_pool.cc:224] Handling call
0709 13:07:45.931103 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.931735 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.931909 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.932978 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:45.933351 16557 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:45.934101 20422 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.936112 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:45.931459 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:45.898931 20411 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.937733 20295 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.939651 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:45.940543 20288 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:45.940950 20288 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.941354 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 493) took 1220 ms. Trace:
I20260709 13:07:45.941717 16563 rpcz_store.cc:276] 0709 13:07:44.720749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.940620 (+1219871us) service_pool.cc:224] Handling call
0709 13:07:45.940873 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.941054 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.941079 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.941134 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.941163 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.941211 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.941301 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.943001 16563 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:45.936198 20422 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:45.945689 20322 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:45.753293 20352 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.193s
I20260709 13:07:45.945914 20411 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
W20260709 13:07:45.939716 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.950708 16557 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.830911 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 492) took 1110 ms. Trace:
W20260709 13:07:45.728348 20409 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:07:45.952098 16566 rpcz_store.cc:276] 0709 13:07:44.720485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.810058 (+1089573us) service_pool.cc:224] Handling call
0709 13:07:45.810334 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.830612 (+ 20278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.830846 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:45.898865 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 460194us
W20260709 13:07:45.756664 20374 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.208s	user 0.000s	sys 0.007s
I20260709 13:07:45.954921 16633 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:45.929579 20370 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.956143 20370 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.957671 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2053) took 2246 ms. Trace:
I20260709 13:07:45.958469 20005 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:45.959084 17187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.018s	sys 0.028s
W20260709 13:07:45.959460 17187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.018s	sys 0.029s
I20260709 13:07:45.736889 20393 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:45.736303 20404 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:07:45.937441 17186 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:45.897528 16560 rpcz_store.cc:276] 0709 13:07:44.636780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.622925 (+986145us) service_pool.cc:224] Handling call
0709 13:07:45.623159 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.722753 (+ 99594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.722947 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.960173 17187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 755) took 1153 ms. Trace:
I20260709 13:07:45.756106 19986 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:45.957983 16483 rpcz_store.cc:276] 0709 13:07:43.711691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.711822 (+   131us) service_pool.cc:224] Handling call
0709 13:07:43.727958 (+ 16136us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:44.685843 (+957885us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b18001c8fa0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f06360334bc 00007f063338148b 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339b455 00007f0636483060 00007f0636483bfb 00007f063648e64b
0709 13:07:44.716442 (+ 30599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.716476 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:44.717124 (+   648us) log.cc:844] Serialized 78 byte log entry
0709 13:07:44.865561 (+148437us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:44.865595 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.865661 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.957399 (+1091738us) raft_consensus.cc:1685] finished
0709 13:07:45.957418 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.957603 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68560,"raft.queue_time_us":200311,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12869,"spinlock_wait_cycles":14397184,"thread_start_us":265715,"threads_started":2,"wal-append.queue_time_us":687962}
I20260709 13:07:45.974157 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:45.749384 20262 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:45.976547 16560 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:45.978127 16633 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:45.987102 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:45.900422 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 480) took 1242 ms. Trace:
I20260709 13:07:45.987648 16564 rpcz_store.cc:276] 0709 13:07:44.657938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.732136 (+1074198us) service_pool.cc:224] Handling call
0709 13:07:45.732411 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.900153 (+167742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.900363 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.987748 16635 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:45.989387 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:45.990087 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.992614 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:45.993155 16640 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:45.993875 16557 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.994201 16557 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:45.996882 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:45.997653 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:45.997799 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:45.998090 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 268494us
I20260709 13:07:45.998466 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:45.999106 16560 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:45.999261 16636 raft_consensus.cc:2410] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:45.976118 17187 rpcz_store.cc:276] 0709 13:07:44.806982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.807145 (+   163us) service_pool.cc:224] Handling call
0709 13:07:44.813945 (+  6800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.814141 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:44.814382 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.959753 (+1145371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.959916 (+   163us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.959960 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.960022 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.960124 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49161,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":134243,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":1144978,"threads_started":2,"wal-append.queue_time_us":647640}
I20260709 13:07:45.998207 17181 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:46.001454 16566 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:07:45.724421 20349 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:46.003047 20349 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.003520 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:45.958087 20370 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:46.012174 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:46.004961 17186 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:45.739285 20333 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:46.012035 16560 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.044389 16560 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:45.940416 20338 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.012058 16631 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:46.006095 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 367615us
W20260709 13:07:46.013458 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 335582us
W20260709 13:07:46.013613 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 404345us
W20260709 13:07:46.045832 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.034031 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:46.012892 17184 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:46.046271 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:46.018770 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.047206 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:46.047854 17188 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
W20260709 13:07:46.048507 16454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.028s	sys 0.043s
W20260709 13:07:46.048795 16454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.028s	sys 0.043s
I20260709 13:07:46.048936 16564 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.050231 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:46.047724 16566 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.051483 16566 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:46.049386 16564 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:46.052644 16560 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.053680 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:46.053892 16529 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:46.054632 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:46.058983 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:46.059573 16636 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:46.005048 16557 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:45.758196 20142 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:46.061087 20404 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:46.062417 16560 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.046761 20005 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.065722 16557 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.071452 16456 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:46.073027 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.073678 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:46.064316 16636 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:07:46.101570 16636 pending_rounds.cc:85] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 3
I20260709 13:07:46.101854 16636 pending_rounds.cc:107] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:07:46.102104 16636 raft_consensus.cc:2889] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:46.078616 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.105743 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.130640 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:46.130903 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76003.4us
I20260709 13:07:46.043841 19986 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.133312 17187 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:46.143285 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:46.143914 16636 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:46.134425 16560 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:46.135485 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.140296 16566 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.158674 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:46.159328 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2042) took 1617 ms. Trace:
I20260709 13:07:46.155177 20331 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.063143 20419 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:46.161129 20419 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:46.063254 20370 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:07:46.161480 20333 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:46.161813 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:46.162503 20333 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:46.162843 20333 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:46.164183 20237 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.161513 20419 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.164686 20237 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:46.166666 20237 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:46.176456 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 142500us
I20260709 13:07:46.062201 20262 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:46.156610 16564 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.061543 20411 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.210s
I20260709 13:07:46.163614 20333 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.177600 17188 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:46.385281 16638 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:46.731963 20419 consensus_meta.cc:287] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
I20260709 13:07:46.804172 20306 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.803283 20423 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.804764 20306 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.155207 20421 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.805478 20423 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.805996 20421 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.807212 20429 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:46.807595 20429 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:46.807881 20423 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:46.804189 20419 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:46.687417 20142 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:46.810451 20419 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:46.810667 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2047) took 2174 ms. Trace:
I20260709 13:07:46.808442 20429 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:46.719501 20295 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.781s	user 0.007s	sys 0.003s
I20260709 13:07:46.811120 16561 rpcz_store.cc:276] 0709 13:07:44.636065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.403027 (+766962us) service_pool.cc:224] Handling call
0709 13:07:45.411897 (+  8870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.828217 (+416320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.828250 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.897030 (+ 68780us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.372728 (+475698us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:46.372765 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.372832 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.810485 (+437653us) raft_consensus.cc:1685] finished
0709 13:07:46.810504 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.810612 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143929,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":833726,"threads_started":2,"wal-append.queue_time_us":874057}
I20260709 13:07:46.812012 20429 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.812887 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:46.813385 16456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.016s	sys 0.017s
W20260709 13:07:46.813692 16456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.016s	sys 0.017s
W20260709 13:07:46.384539 17185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 754) took 1655 ms (client timeout 1530 ms). Trace:
W20260709 13:07:46.432238 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.387630 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.350669 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:46.361356 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.215943 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:46.310844 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.442860 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.814123 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 742661us
I20260709 13:07:46.442373 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:46.178959 16637 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:46.574916 16639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.007s
W20260709 13:07:46.271225 16485 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.025s	sys 0.049s
W20260709 13:07:46.819526 16485 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.037s	sys 0.060s
W20260709 13:07:46.532409 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.304702 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:46.159660 16559 rpcz_store.cc:276] 0709 13:07:44.541950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.732869 (+190919us) service_pool.cc:224] Handling call
0709 13:07:44.752823 (+ 19954us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:44.759324 (+  6501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.759354 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.759895 (+   541us) log.cc:844] Serialized 52 byte log entry
0709 13:07:44.865780 (+105885us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:44.865823 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.865888 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.159150 (+1293262us) raft_consensus.cc:1685] finished
0709 13:07:46.159170 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.159280 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5020,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":44630,"thread_start_us":96282,"threads_started":1,"wal-append.queue_time_us":688648}
I20260709 13:07:46.308336 16566 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:46.383674 16565 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.028s
W20260709 13:07:46.410647 16562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.009s	sys 0.032s
W20260709 13:07:46.821529 16562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.009s	sys 0.043s
I20260709 13:07:46.598699 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2052) took 2887 ms. Trace:
I20260709 13:07:46.803125 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:46.822456 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:46.808249 20333 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:46.335675 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.570552 16635 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:46.823242 16565 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.013s	sys 0.037s
W20260709 13:07:46.333287 16558 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.012s	sys 0.020s
W20260709 13:07:46.832674 16558 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.012s	sys 0.039s
W20260709 13:07:46.832849 17152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.006s	sys 0.014s
I20260709 13:07:46.818557 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:46.833192 17152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.006s	sys 0.014s
W20260709 13:07:46.819229 16639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.008s	sys 0.012s
I20260709 13:07:46.825697 16490 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:07:46.630963 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.427170 16455 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:46.822890 16559 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:46.834043 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 406910us
W20260709 13:07:46.834177 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.834412 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:46.835063 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.835361 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.835783 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.835844 16559 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:46.131412 19877 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.816322 16603 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:46.428884 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:46.416216 20370 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.823897 16557 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:46.834386 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:46.241240 20319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.013s	sys 0.020s
W20260709 13:07:46.837850 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.853207 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.838368 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:46.836083 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:46.726353 20338 consensus_meta.cc:287] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.000s
W20260709 13:07:46.837636 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.155260 20174 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:46.177402 20366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.020s
I20260709 13:07:46.156060 19986 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.830207 20411 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.842128 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 796447us
I20260709 13:07:46.844368 16603 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:46.566938 20288 consensus_meta.cc:287] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.000s
I20260709 13:07:46.335925 20373 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.559s
W20260709 13:07:46.467293 20375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.011s	sys 0.030s
I20260709 13:07:46.849215 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:46.844084 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:46.926677 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 82656.6us
I20260709 13:07:46.845347 16564 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.065292 20263 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:46.850538 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 47519us
W20260709 13:07:46.569613 20349 consensus_meta.cc:287] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.000s
I20260709 13:07:46.334288 20322 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:46.856274 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.416410 20310 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.177680 20155 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.857379 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:46.869668 20393 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.177507 20415 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.167102 20237 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.855356 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:46.822975 16487 rpcz_store.cc:276] 0709 13:07:43.711017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.711416 (+   399us) service_pool.cc:224] Handling call
0709 13:07:43.727737 (+ 16321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.981602 (+253865us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:44.003911 (+ 22309us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.730614 (+726703us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18003c9220. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:07:44.809968 (+ 79354us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.863070 (+ 53102us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.863319 (+   249us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:44.863355 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.863433 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.583471 (+1720038us) raft_consensus.cc:1685] finished
0709 13:07:46.598443 (+ 14972us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.598630 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77435,"prepare.queue_time_us":163944,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":8981,"raft.queue_time_us":71455,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":19313,"spinlock_wait_cycles":2841344,"thread_start_us":254907,"threads_started":2,"wal-append.queue_time_us":1397251}
W20260709 13:07:46.925791 20375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.011s	sys 0.040s
I20260709 13:07:46.450156 20424 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.857867 20370 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.808511 20421 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:46.830557 20142 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.562644 20185 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.130647 20326 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.714s
W20260709 13:07:46.820461 17185 rpcz_store.cc:269] 0709 13:07:44.729311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.732105 (+  2794us) service_pool.cc:224] Handling call
0709 13:07:46.384307 (+1652202us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54005082d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:46.384459 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3143807360}
W20260709 13:07:46.865072 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 481741us
I20260709 13:07:46.611166 20321 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:46.840701 20360 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.957796 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:46.848157 20005 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:46.845425 16486 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.008s	sys 0.012s
W20260709 13:07:46.963147 16486 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.008s	sys 0.012s
I20260709 13:07:46.871049 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:46.841094 19877 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:46.860566 20366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.011s	sys 0.035s
I20260709 13:07:46.840441 20262 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:46.875654 16566 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
I20260709 13:07:46.850040 20423 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.272276 20383 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.663s
I20260709 13:07:46.935530 20310 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:46.853974 20433 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:46.859378 20448 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.927614 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:46.929076 20011 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:46.196497 20331 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:46.929720 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 60401.9us
I20260709 13:07:46.997175 19877 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:46.933125 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.934496 17181 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.857612 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:46.868113 20174 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:46.860877 20352 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:07:46.926112 20145 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:46.937352 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:46.938838 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 83542.8us
I20260709 13:07:47.023411 16488 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.024251 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:47.025136 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:46.167157 20328 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:46.940645 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2066) took 1524 ms. Trace:
I20260709 13:07:47.008853 20433 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.033531 16634 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:46.941951 16563 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.008s	sys 0.008s
I20260709 13:07:46.931061 20263 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:46.934827 20322 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.876928 20411 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:46.956257 16482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.008s	sys 0.037s
W20260709 13:07:47.064810 16482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.008s	sys 0.037s
I20260709 13:07:46.996369 20321 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:46.852948 20319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.014s	sys 0.032s
I20260709 13:07:46.923815 20288 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.960563 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:07:46.960897 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 142789us
I20260709 13:07:47.069896 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:46.937315 20447 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.964056 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 93680.6us
I20260709 13:07:46.941970 20446 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.939457 20300 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:46.973104 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 513) took 1572 ms. Trace:
I20260709 13:07:46.973910 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:46.999635 16566 pending_rounds.cc:85] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 3
I20260709 13:07:47.075779 16566 pending_rounds.cc:107] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:07:47.076089 16566 raft_consensus.cc:2889] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.933648 20349 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.930352 20295 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:07:46.959836 20427 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.944247 20424 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.003181 20370 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:46.852339 20422 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:47.006213 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.088083 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2361) took 1436 ms. Trace:
I20260709 13:07:47.088470 16566 rpcz_store.cc:276] 0709 13:07:45.651343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.002394 (+351051us) service_pool.cc:224] Handling call
0709 13:07:46.047591 (+ 45197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.087862 (+1040271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.088032 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.010478 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:47.089334 16487 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.962792 20005 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:46.938532 20415 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:46.867707 19986 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.997437 20430 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:47.015621 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 143125us
I20260709 13:07:47.069217 20373 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.022465 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2048) took 2386 ms. Trace:
I20260709 13:07:47.074790 20446 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.940817 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:47.034029 16563 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.008s	sys 0.008s
I20260709 13:07:46.958833 20142 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:46.965276 20185 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.065600 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2068) took 1619 ms. Trace:
W20260709 13:07:46.940292 20416 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.008s	sys 0.019s
W20260709 13:07:47.066870 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 68229.6us
I20260709 13:07:47.164402 17181 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:46.997285 20360 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:47.066390 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 142227us
I20260709 13:07:47.166297 16529 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:07:47.071080 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 110614us
I20260709 13:07:47.072551 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:47.009939 20423 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.023126 20145 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:47.078729 20421 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:47.083315 16488 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:07:47.064509 20322 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.084007 16636 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:47.058919 20433 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.064311 20263 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:47.085579 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.064225 20435 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:47.087270 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:46.939086 20393 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.058073 20155 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:07:46.939910 20237 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.075055 16486 rpcz_store.cc:276] 0709 13:07:45.400311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.654855 (+254544us) service_pool.cc:224] Handling call
0709 13:07:45.655161 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:45.655467 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.655493 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:45.656071 (+   578us) log.cc:844] Serialized 52 byte log entry
0709 13:07:46.006038 (+349967us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.972625 (+966587us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.972832 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.972896 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.972943 (+    47us) raft_consensus.cc:1685] finished
0709 13:07:46.972954 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.973058 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":443605,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":5214,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":6887,"thread_start_us":1257861,"threads_started":2,"wal-append.queue_time_us":773990}
I20260709 13:07:47.193033 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:47.113142 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:47.074018 20366 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.032553 16485 rpcz_store.cc:276] 0709 13:07:45.416348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.660146 (+243798us) service_pool.cc:224] Handling call
0709 13:07:45.660403 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.660570 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:46.819764 (+1159194us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.940275 (+120511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.940343 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:46.940405 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.940481 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.940591 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":771880,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":115,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8093,"thread_start_us":1279030,"threads_started":2}
I20260709 13:07:47.148830 20383 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:47.126039 16562 rpcz_store.cc:276] 0709 13:07:44.636305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.400780 (+764475us) service_pool.cc:224] Handling call
0709 13:07:45.408766 (+  7986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.765028 (+356262us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:45.765056 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.765569 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.821769 (+1056200us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:46.821796 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.821837 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.022264 (+200427us) raft_consensus.cc:1685] finished
0709 13:07:47.022283 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.022405 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151148,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":1409332,"threads_started":2,"wal-append.queue_time_us":1249084}
I20260709 13:07:47.075157 20338 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.158113 16491 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 13. Ops: [11.6-11.6]
I20260709 13:07:47.160580 16482 rpcz_store.cc:276] 0709 13:07:45.446153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.665325 (+219172us) service_pool.cc:224] Handling call
0709 13:07:45.665556 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.665720 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:46.059658 (+393938us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.065221 (+1005563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.065277 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.065328 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.065395 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.065544 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":783752,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1064,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":1393927,"threads_started":2,"wal-append.queue_time_us":948693}
I20260709 13:07:47.165460 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:47.165926 16561 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.084035 20427 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.087669 20326 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:47.090972 20422 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.170859 16631 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:47.015983 20448 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:47.256148 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 89908.3us
I20260709 13:07:47.258862 16561 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:47.108201 20005 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.175117 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:47.164678 20416 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.008s	sys 0.019s
I20260709 13:07:47.125243 20370 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.150528 20011 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.073998 20328 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.168111 20437 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:47.169703 20443 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:07:47.161968 20446 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.190352 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:47.196457 20472 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:47.197153 20462 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:47.197811 20342 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:47.199132 16603 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:47.283356 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2348) took 1634 ms. Trace:
W20260709 13:07:47.224301 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.174309 20145 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.172246 20460 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.175778 20174 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:47.236910 20461 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:47.238238 16637 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
W20260709 13:07:47.236121 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 54158.6us
I20260709 13:07:47.243396 16482 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:47.086690 20262 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.076170 20447 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.188405 20435 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.245497 20451 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 13:07:47.266386 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 193889us
I20260709 13:07:47.275102 20469 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:47.271130 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.237190 20411 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:47.244261 20427 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.185688 20421 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.243494 20326 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.229260 20373 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:07:47.277554 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2309) took 1064 ms. Trace:
W20260709 13:07:47.273818 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.255447 20422 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.260515 20470 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.231702 20352 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:47.275309 16488 raft_consensus.cc:2410] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:47.283811 16564 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:47.284765 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 89415.2us
I20260709 13:07:47.274621 20466 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:07:47.369179 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2358) took 1718 ms. Trace:
W20260709 13:07:47.351097 20458 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:07:47.285521 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2060) took 1117 ms. Trace:
W20260709 13:07:47.286309 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 87239.8us
I20260709 13:07:47.372004 16560 rpcz_store.cc:276] 0709 13:07:46.167983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.177211 (+  9228us) service_pool.cc:224] Handling call
0709 13:07:46.516110 (+338899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.576209 (+ 60099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.576242 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.586283 (+ 10041us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.946479 (+360196us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b180018ac60. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:07:47.012401 (+ 65922us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:47.012435 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.012495 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.280307 (+267812us) raft_consensus.cc:1685] finished
0709 13:07:47.280326 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.285474 (+  5148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42441,"raft.queue_time_us":53476,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":16696,"spinlock_wait_cycles":103833984,"thread_start_us":65613,"threads_started":1,"wal-append.queue_time_us":571564}
I20260709 13:07:47.347543 20385 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:47.287025 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 196705us
I20260709 13:07:47.266378 20383 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:47.287981 20331 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:47.278813 20471 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.330711 16482 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:47.333000 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.282152 20310 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.239311 20366 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:47.347131 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.342187 20443 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:47.275152 20370 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.274857 20011 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.353186 16636 rpcz_store.cc:276] 0709 13:07:46.212985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.818376 (+605391us) service_pool.cc:224] Handling call
0709 13:07:47.277381 (+459005us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54000b3954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:47.277494 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576280832}
I20260709 13:07:47.366676 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2068) took 1196 ms. Trace:
I20260709 13:07:47.283859 16563 rpcz_store.cc:276] 0709 13:07:45.648605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.946184 (+297579us) service_pool.cc:224] Handling call
0709 13:07:45.946438 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.946613 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:47.159553 (+1212940us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.283020 (+123467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.283086 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:47.283131 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.283194 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.283303 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4800,"prepare.queue_time_us":753478,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":1327359,"threads_started":3}
I20260709 13:07:47.344518 20435 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.345504 20185 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.346827 20469 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:47.369551 16564 rpcz_store.cc:276] 0709 13:07:45.650711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.000940 (+350229us) service_pool.cc:224] Handling call
0709 13:07:46.048816 (+ 47876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.368947 (+1320131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.369127 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.331636 20460 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.351137 20349 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.353289 20326 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.350347 20288 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.376883 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:07:47.367926 20452 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 13:07:47.367609 20429 consensus_meta.cc:287] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.001s
W20260709 13:07:47.368744 20457 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:07:47.352355 20411 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.282317 20437 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.371565 20424 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.386073 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:47.385327 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 446301us
I20260709 13:07:47.355597 20338 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:47.345674 20306 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:47.386281 16559 rpcz_store.cc:276] 0709 13:07:46.170089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.854219 (+684130us) service_pool.cc:224] Handling call
0709 13:07:46.854476 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.854654 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:46.869889 (+ 15235us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.365598 (+495709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.365650 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.365698 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.366513 (+   815us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.366622 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16629,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":341525,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":2171,"thread_start_us":495346,"threads_started":2,"wal-append.queue_time_us":238004}
I20260709 13:07:47.392572 20469 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.395042 16487 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:07:47.351883 20480 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:47.401540 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:47.402281 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:47.433107 17182 raft_consensus.cc:2410] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:47.384610 20142 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.370371 20470 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.383785 20484 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.369243 20476 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:47.384583 20423 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:47.380887 20472 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:07:47.376299 20477 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:47.378783 20385 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.406898 16640 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:47.389369 20321 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:47.423902 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.426680 17185 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
W20260709 13:07:47.429222 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 77380.2us
I20260709 13:07:47.390694 20352 consensus_queue.cc:1243] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:47.456550 20481 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:47.456799 20421 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.441272 20393 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.431851 20447 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.404634 20310 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:47.414382 20237 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.450024 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:47.383468 20471 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.433969 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:47.454001 20328 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.472610 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2067) took 1302 ms. Trace:
W20260709 13:07:47.464731 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 537129us
W20260709 13:07:47.469096 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 123727us
W20260709 13:07:47.487242 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.452723 20473 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:07:47.506865 17187 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:47.488090 20417 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:47.507452 20473 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.507766 20417 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:47.508554 20417 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.509688 20417 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.510382 20471 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:47.511152 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 63636.1us
I20260709 13:07:47.512692 20460 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.513253 20460 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.513449 20366 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:47.514153 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:47.490999 20415 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.495417 20489 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:47.496016 20481 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:47.498680 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:47.499738 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 508) took 2124 ms. Trace:
I20260709 13:07:47.441147 20288 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:47.448429 20429 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.538518 16489 rpcz_store.cc:276] 0709 13:07:45.375419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.557619 (+182200us) service_pool.cc:224] Handling call
0709 13:07:45.708219 (+150600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.202623 (+494404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.202655 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.421427 (+218772us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.939282 (+517855us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.939318 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.940860 (+  1542us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.499561 (+558701us) raft_consensus.cc:1685] finished
0709 13:07:47.499580 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.499686 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34387,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":888749,"threads_started":2,"wal-append.queue_time_us":610466}
W20260709 13:07:47.502516 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.502899 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 69005.4us
I20260709 13:07:47.505522 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:47.545120 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:47.514818 20470 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:47.530598 19877 consensus_meta.cc:287] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
W20260709 13:07:47.531338 20483 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:47.530905 20473 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:47.531718 20463 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:07:47.531253 20370 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:47.515892 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:47.532781 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 157860us
I20260709 13:07:47.506153 20237 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.537092 20474 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:07:47.537343 20468 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:47.535239 17187 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:47.504158 16557 rpcz_store.cc:276] 0709 13:07:46.169869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.846980 (+677111us) service_pool.cc:224] Handling call
0709 13:07:46.847275 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.866450 (+ 19175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.866481 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.930191 (+ 63710us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.034808 (+104617us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.034844 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.034902 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.472391 (+437489us) raft_consensus.cc:1685] finished
0709 13:07:47.472412 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.472553 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47427,"raft.queue_time_us":10856,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9788,"thread_start_us":90952,"threads_started":1,"wal-append.queue_time_us":402436}
I20260709 13:07:47.540262 17185 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:47.497350 20349 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.539289 17184 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:47.448951 20383 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.500186 20421 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:47.551726 20142 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:47.471112 20155 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:07:47.544328 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:47.546180 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.591166 17179 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:47.545342 17186 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:47.497910 20423 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.503381 20466 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.531682 20490 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:07:47.502552 20393 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:47.531741 20310 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:07:47.574028 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58225.6us
I20260709 13:07:47.543522 20411 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:47.506733 20459 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:07:47.553673 20328 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:47.604449 20493 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:47.605021 20493 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.605683 20393 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.606525 20482 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:47.602022 20411 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.607496 20411 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.548177 20322 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.582178 20472 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:47.604380 20328 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:47.612326 16640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2308) took 1454 ms (client timeout 1847 ms). Trace:
I20260709 13:07:47.612711 20328 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:47.615952 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.550256 19877 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:47.612730 16640 rpcz_store.cc:269] 0709 13:07:46.157994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.158117 (+   123us) service_pool.cc:224] Handling call
0709 13:07:47.612160 (+1454043us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b540015ca54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:47.612267 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347822976}
I20260709 13:07:47.635192 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:47.637452 20360 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.629189 20472 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.640134 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.644348 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.583020 20448 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.641373 20499 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:47.543671 20489 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.613901 20328 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.580848 20237 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.581900 20349 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:47.652235 20333 consensus_meta.cc:287] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.807s	user 0.008s	sys 0.002s
I20260709 13:07:47.652465 20385 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.653129 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:47.654260 20445 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.723s	user 0.004s	sys 0.009s
W20260709 13:07:47.649744 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45942.5us
I20260709 13:07:47.656011 20011 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:47.657101 20493 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.657629 20435 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.602355 20423 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.658090 20484 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.659092 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2046) took 3023 ms. Trace:
I20260709 13:07:47.746567 20310 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.661885 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:47.663528 17187 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:47.601997 20142 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:47.597357 20471 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:07:47.664898 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:47.663550 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:47.667135 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:47.774704 16564 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:47.767760 20145 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.672261 20460 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:47.672904 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:47.673447 20448 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:47.673631 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:47.677531 16557 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:47.601171 20476 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:47.605517 20300 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:47.601590 20470 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:07:47.730636 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2044) took 3188 ms. Trace:
I20260709 13:07:47.737056 17185 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:47.738129 16604 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.516s (SENT) [suppressed 13 similar messages]
I20260709 13:07:47.733620 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:47.744912 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 92234.4us
I20260709 13:07:47.646448 20481 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.607062 20482 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:47.750816 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 176144us
W20260709 13:07:47.763444 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.765879 20237 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.676496 20263 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:47.774426 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 110941us
I20260709 13:07:47.667966 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:47.648448 20472 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.775761 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:47.790194 19986 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.629s	user 0.003s	sys 0.003s
W20260709 13:07:47.734397 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.978201 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.824821 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.978960 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:47.979914 16559 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.975066 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:47.980069 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.980405 16561 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:47.776144 16639 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:07:47.981175 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.823369 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.774289 17188 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:47.981928 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:47.984004 16562 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:47.977898 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.979544 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:47.770641 16565 rpcz_store.cc:276] 0709 13:07:44.635761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.382484 (+746723us) service_pool.cc:224] Handling call
0709 13:07:45.382773 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.811056 (+428283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:46.832488 (+1021432us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.342962 (+510474us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.343372 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.343486 (+   114us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:47.347440 (+  3954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.347513 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.658878 (+311365us) raft_consensus.cc:1685] finished
0709 13:07:47.658897 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.659015 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8535,"prepare.queue_time_us":889090,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":520044,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":8413,"thread_start_us":1914032,"threads_started":4,"wal-append.queue_time_us":331609}
W20260709 13:07:47.800307 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.988333 16565 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:07:47.988818 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.772130 17184 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
W20260709 13:07:47.991693 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.994820 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:47.976976 16558 rpcz_store.cc:276] 0709 13:07:44.542456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.380698 (+838242us) service_pool.cc:224] Handling call
0709 13:07:45.380999 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.812590 (+431591us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:46.832999 (+1020409us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.391145 (+558146us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.402220 (+ 11075us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.402357 (+   137us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.402567 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.485825 (+ 83258us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b1800279be0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f0636483060 00007f0636495716 00007f06364a6287 00007f06364a6208
0709 13:07:47.485970 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.486030 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.730408 (+244378us) raft_consensus.cc:1685] finished
0709 13:07:47.730433 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.730568 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39227,"prepare.queue_time_us":887876,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":11461,"raft.queue_time_us":595899,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":17767,"spinlock_wait_cycles":15989632,"thread_start_us":1961284,"threads_started":4,"wal-append.queue_time_us":376961}
I20260709 13:07:47.990813 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:47.999066 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:47.949632 20469 consensus_meta.cc:287] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.000s
I20260709 13:07:48.004714 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.000540 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:47.805444 20005 consensus_meta.cc:287] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 13:07:48.009341 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:47.999922 16560 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:48.005719 16564 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.008311 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:48.009895 16561 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:48.010143 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:48.009749 16562 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:47.982761 20424 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:48.010954 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.015753 16631 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:47.770491 20496 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.013267 16566 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:48.013840 16638 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:47.771816 20435 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:48.014323 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:47.799599 20145 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.771085 20310 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.776713 19877 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.756282 20385 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:48.007879 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:48.017376 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:47.770462 20422 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.770301 20484 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.830950 20011 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.008885 20366 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:48.024219 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:47.978137 20349 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.730186 20477 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.269s
I20260709 13:07:47.797062 20489 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.774724 20383 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:47.830472 20471 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.982313 19986 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.865435 20446 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:47.773190 20142 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:47.973984 20322 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:47.991330 20460 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.057224 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:48.322604 17188 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:48.228073 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.324550 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.140681 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.170542 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:48.326838 16563 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:48.145370 16564 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
W20260709 13:07:48.330889 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.334520 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 327767us
I20260709 13:07:48.030184 16559 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
W20260709 13:07:48.272347 20505 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:07:48.192901 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.270290 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:48.087325 20417 consensus_meta.cc:287] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.014s
I20260709 13:07:48.154341 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:48.112208 20433 consensus_meta.cc:287] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.918s	user 0.009s	sys 0.000s
W20260709 13:07:48.175688 20326 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.000s
W20260709 13:07:48.272459 20510 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:07:47.999322 20490 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.333235 20011 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:48.016177 20469 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:48.365674 20011 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:48.365911 20469 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:48.011976 20338 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:48.366814 20338 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.151057 20352 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.220s
I20260709 13:07:48.057603 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:48.346607 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.018369 20342 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.248229 20507 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.273s	user 0.000s	sys 0.002s
I20260709 13:07:48.345607 20263 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:47.990660 20437 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:48.255477 20502 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.297s	user 0.002s	sys 0.000s
I20260709 13:07:48.353950 16565 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:48.363663 20490 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.354847 16633 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:48.397078 16488 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:48.350574 16634 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:48.057658 20419 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:48.143091 20473 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.148412 20288 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.222627 20472 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:48.128341 16373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 71365.8us
I20260709 13:07:48.362135 20499 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:48.356493 20326 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.370502 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:48.371933 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:48.393664 20469 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.193890 20393 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.339830 20478 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:48.378309 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.382652 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.384156 16484 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:48.385535 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 368197us
I20260709 13:07:47.991220 20448 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:48.386700 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 51104us
I20260709 13:07:48.389921 16564 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:48.015777 20262 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.343s
I20260709 13:07:48.015383 20424 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.392556 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.170235 20185 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:48.395833 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.440147 16635 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:48.174899 20333 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.345551 20383 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:48.163699 20423 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:48.397912 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:48.398389 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:48.353008 20435 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:48.400543 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 662386us
I20260709 13:07:48.408309 20499 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:48.087679 20496 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:48.406073 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:48.025348 20005 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.337765 20471 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.406657 16560 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:48.345062 20349 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:07:48.392480 20489 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:48.404601 20419 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:48.372906 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:48.399667 20490 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.414754 16487 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:07:48.408414 20500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.006s	sys 0.007s
I20260709 13:07:48.413633 16486 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:48.413297 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.433862 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:48.424618 16484 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:48.593052 16482 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:48.593415 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 159616us
I20260709 13:07:48.395679 20493 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:48.357717 20433 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.441004 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.484935 20437 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.457892 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.403641 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:48.457639 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.601112 16563 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:48.601425 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.519142 20507 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:07:48.459414 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.483481 16634 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.601994 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:48.602340 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:48.602694 16563 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.484225 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:48.490789 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:48.604305 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 120147us
I20260709 13:07:48.604815 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:48.605377 16564 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 6.
I20260709 13:07:48.605763 20417 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:48.606220 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:48.434989 20328 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.750s	user 0.004s	sys 0.005s
W20260709 13:07:48.586817 20500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.007s	sys 0.008s
I20260709 13:07:48.606760 20011 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:48.572996 20489 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.514246 20422 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:48.447940 20424 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.339406 20385 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:48.481982 20370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.011s
I20260709 13:07:48.408300 20288 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.520759 16604 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:48.425030 20478 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:48.396529 20342 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:48.443439 20185 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:48.594233 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:48.595885 20513 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.438347 20338 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.596186 16635 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:48.442399 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:48.593675 16484 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.597625 16638 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:48.595853 16486 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:48.599210 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:48.646265 16560 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:48.601905 20437 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:48.647038 20328 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:48.648259 16564 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:48.620430 20370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.013s	sys 0.012s
I20260709 13:07:48.611596 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 770) took 1114 ms. Trace:
I20260709 13:07:48.514284 20496 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:48.605554 20366 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.525532 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:07:48.592929 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 99883.1us
I20260709 13:07:48.599067 20473 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:48.594578 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:48.484822 20322 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:07:48.598379 20466 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.641268 16634 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:48.642752 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:48.492105 20435 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:48.602335 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.650942 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 208605us
I20260709 13:07:48.571223 20333 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:48.670855 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:48.669456 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:48.671519 16560 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.651487 20142 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.652168 16484 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.652477 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.636391 20422 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:48.656968 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:48.656461 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 130980us
I20260709 13:07:48.658809 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:48.643353 20513 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.656257 16637 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
W20260709 13:07:48.649170 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 128483us
I20260709 13:07:48.664825 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.670254 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:48.651844 17182 rpcz_store.cc:276] 0709 13:07:47.497383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.497526 (+   143us) service_pool.cc:224] Handling call
0709 13:07:47.508119 (+ 10593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.508455 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:47.508716 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.552709 (+ 43993us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.553026 (+   317us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.553124 (+    98us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.553157 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.553207 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.611421 (+1058214us) raft_consensus.cc:1685] finished
0709 13:07:48.611439 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.611542 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6462,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3629,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":20014,"thread_start_us":43622,"threads_started":1,"wal-append.queue_time_us":225001}
I20260709 13:07:48.682843 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:48.649449 20262 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.652794 20525 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.649035 20460 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.522588 20429 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:07:48.674722 16635 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:48.651996 20446 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.658253 20366 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.676997 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:48.655833 20352 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:48.683146 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:48.693113 16631 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.660949 20349 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.625615 16563 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:48.700522 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:48.675536 20422 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:48.656082 20469 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:07:48.723845 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 66952.2us
I20260709 13:07:48.671168 20338 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.695825 20489 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.765429 16560 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:48.647490 20478 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.683444 20513 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.648713 20383 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.648891 20499 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.676515 20142 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:48.837949 16631 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:48.696158 19877 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:07:48.702145 20360 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.736896 20427 consensus_meta.cc:287] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.383s	user 0.016s	sys 0.006s
I20260709 13:07:48.697230 20370 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.725641 20300 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:48.768407 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 91475us
W20260709 13:07:48.824862 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 124393us
I20260709 13:07:48.722853 20237 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.827462 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:48.834610 20530 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.787309 20349 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.671456 20466 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:48.729938 20460 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.787387 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:48.912600 16560 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:07:48.862190 20499 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.764989 20423 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.767513 20366 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:48.848554 20523 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:07:48.849221 20521 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:07:48.849865 20506 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.594s	user 0.000s	sys 0.001s
I20260709 13:07:48.943427 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:48.944016 16560 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:48.850458 20522 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:07:48.853596 20415 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:48.834239 20518 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:07:48.767285 20352 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:48.825284 20338 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.869813 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:48.869760 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:48.828601 20448 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:48.849905 20532 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:07:48.831429 20326 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:07:48.843595 20478 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.843927 20322 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:48.803910 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:48.845853 20142 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.000036 20517 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.000540 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2318) took 1017 ms. Trace:
I20260709 13:07:49.000917 16640 rpcz_store.cc:276] 0709 13:07:47.983444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.983597 (+   153us) service_pool.cc:224] Handling call
0709 13:07:47.983905 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.991112 (+  7207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.991140 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.004370 (+ 13230us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.409583 (+405213us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:48.409625 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.409692 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.897269 (+487577us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b48001a01d8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
0709 13:07:49.000268 (+102999us) raft_consensus.cc:1685] finished
0709 13:07:49.000291 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.000481 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33034,"raft.queue_time_us":7304,"raft.run_cpu_time_us":20011,"raft.run_wall_time_us":898162,"spinlock_wait_cycles":17641856,"thread_start_us":378043,"threads_started":1,"wal-append.queue_time_us":459450}
I20260709 13:07:49.002980 16640 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:07:48.893181 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65771.8us
I20260709 13:07:49.003821 20342 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:49.000519 20517 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:48.894888 20528 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:07:48.895764 20519 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:07:48.855094 20005 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.694499 20185 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:48.908206 20524 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:07:48.912046 20349 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.915225 20466 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:48.894069 20237 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:48.841473 20446 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:48.916371 20484 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.917778 20447 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:48.919947 20385 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.920306 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:49.027374 16631 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:48.921056 20435 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.912130 20489 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:48.921785 19986 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:48.872145 20529 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:07:48.924678 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.871784 20419 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:48.866730 20300 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:49.044039 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2384) took 1295 ms. Trace:
I20260709 13:07:48.928448 20437 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:49.046463 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2383) took 1298 ms. Trace:
I20260709 13:07:49.046823 16561 rpcz_store.cc:276] 0709 13:07:47.748127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.010631 (+262504us) service_pool.cc:224] Handling call
0709 13:07:48.010875 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.011054 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.011078 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.011503 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.416351 (+404848us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.416384 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.416443 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.046246 (+629803us) raft_consensus.cc:1685] finished
0709 13:07:49.046266 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.046379 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":275673,"threads_started":1,"wal-append.queue_time_us":573741}
I20260709 13:07:48.929037 20433 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.929847 20333 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:48.924472 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:48.930930 16490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2083) took 2102 ms (client timeout 1516 ms). Trace:
I20260709 13:07:48.931728 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2315) took 1823 ms. Trace:
I20260709 13:07:48.922673 20530 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:48.907465 20526 log.cc:927] Time spent T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:48.866393 20471 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:48.842671 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 140757us
I20260709 13:07:49.052914 20466 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.054752 20466 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.055073 20466 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.056118 20310 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:48.927575 20288 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:48.984613 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 114866us
I20260709 13:07:48.990345 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2317) took 1881 ms. Trace:
I20260709 13:07:48.990619 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2069) took 2124 ms. Trace:
I20260709 13:07:49.057256 16633 rpcz_store.cc:276] 0709 13:07:47.109280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.109424 (+   144us) service_pool.cc:224] Handling call
0709 13:07:47.109682 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.396967 (+1287285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.990112 (+593145us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400326ed4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:48.990288 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2863083392}
I20260709 13:07:49.058667 20530 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:48.864317 20360 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:48.993475 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 123783us
I20260709 13:07:49.060196 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:48.867703 20427 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.065609 20427 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:48.994728 16560 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:49.004400 20517 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.066704 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:49.067205 16560 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.068239 16636 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:07:49.008039 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2380) took 1276 ms. Trace:
I20260709 13:07:49.068825 16557 rpcz_store.cc:276] 0709 13:07:47.731502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.004073 (+272571us) service_pool.cc:224] Handling call
0709 13:07:48.006996 (+  2923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.027982 (+ 20986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.028012 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.087434 (+ 59422us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.392412 (+304978us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:48.392448 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.392525 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.999864 (+607339us) raft_consensus.cc:1685] finished
0709 13:07:48.999881 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.007996 (+  8115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20654,"raft.queue_time_us":123151,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":18471,"thread_start_us":233134,"threads_started":1,"wal-append.queue_time_us":490820}
I20260709 13:07:49.070421 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.070911 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:49.000083 20322 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:49.024959 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2325) took 1029 ms. Trace:
I20260709 13:07:48.992856 20352 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.987178 20338 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.016700 20538 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:49.031008 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.031633 16631 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:49.073832 16632 rpcz_store.cc:276] 0709 13:07:47.995155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.995278 (+   123us) service_pool.cc:224] Handling call
0709 13:07:48.015481 (+ 20203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.015755 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.015783 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.059515 (+ 43732us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.395488 (+335973us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.395523 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.395587 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.024727 (+629140us) raft_consensus.cc:1685] finished
0709 13:07:49.024752 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.024886 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127026,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":11161,"thread_start_us":243769,"threads_started":1,"wal-append.queue_time_us":308042}
I20260709 13:07:49.076934 16631 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:49.077220 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2382) took 1329 ms. Trace:
I20260709 13:07:49.077564 16558 rpcz_store.cc:276] 0709 13:07:47.747897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.000559 (+252662us) service_pool.cc:224] Handling call
0709 13:07:48.000846 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.335872 (+335026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.335903 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:48.344063 (+  8160us) log.cc:844] Serialized 52 byte log entry
0709 13:07:48.516171 (+172108us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.516516 (+   345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.516798 (+   282us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.077023 (+560225us) raft_consensus.cc:1685] finished
0709 13:07:49.077041 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.077169 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23701,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":63321,"thread_start_us":437159,"threads_started":2,"wal-append.queue_time_us":267452}
I20260709 13:07:49.078635 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.032341 20489 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:07:49.034703 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.038081 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:49.080876 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.020155 20447 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:49.044384 16562 rpcz_store.cc:276] 0709 13:07:47.748347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.011026 (+262679us) service_pool.cc:224] Handling call
0709 13:07:48.143464 (+132438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.143762 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.143805 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.188814 (+ 45009us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.387491 (+198677us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.387527 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.387592 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.043829 (+656237us) raft_consensus.cc:1685] finished
0709 13:07:49.043851 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.043986 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18946,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":18641,"thread_start_us":137306,"threads_started":1,"wal-append.queue_time_us":310798}
I20260709 13:07:49.045496 16484 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:49.019629 20237 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:49.048928 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.055482 20435 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:07:49.050280 16639 rpcz_store.cc:276] 0709 13:07:47.108737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.108849 (+   112us) service_pool.cc:224] Handling call
0709 13:07:47.109187 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.981487 (+872300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.931509 (+950022us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54000b3454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:48.931676 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533288320}
W20260709 13:07:49.050149 16490 rpcz_store.cc:269] 0709 13:07:46.828213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.834169 (+  5956us) service_pool.cc:224] Handling call
0709 13:07:48.930715 (+2096546us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b54003313d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:48.930859 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2042794752}
I20260709 13:07:49.044277 20300 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.093997 20447 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:49.095147 20482 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:49.050237 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 125826us
W20260709 13:07:49.100473 20411 consensus_meta.cc:287] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.493s	user 0.004s	sys 0.023s
I20260709 13:07:49.100867 20411 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:49.103351 16634 raft_consensus.cc:2393] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:49.095227 20447 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.082868 20471 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:49.104401 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.104604 20471 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:49.105139 20437 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:49.105834 20448 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.106508 20471 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:48.965389 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.057322 16566 rpcz_store.cc:276] 0709 13:07:46.865874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.239561 (+373687us) service_pool.cc:224] Handling call
0709 13:07:47.260610 (+ 21049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.025953 (+765343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.990430 (+964477us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540007d0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:48.990569 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730490240}
I20260709 13:07:49.106968 20496 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:49.107344 20496 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:49.058852 16633 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.009063 16638 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:49.108933 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.109875 16638 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:49.012107 20415 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:49.111383 20415 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.054955 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.087221 20489 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:49.112766 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57877.7us
I20260709 13:07:49.114068 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.057271 16455 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:49.114732 20288 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.114928 20537 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:49.114782 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 57591.1us
I20260709 13:07:49.105870 20487 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:49.078804 16631 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:49.079365 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.117445 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.075511 20322 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.140820 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:49.080876 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.024207 20185 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.019004 20513 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:49.083086 16484 pending_rounds.cc:85] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:07:49.149411 16484 pending_rounds.cc:107] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:49.149688 16484 raft_consensus.cc:2889] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.086470 16560 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:49.148684 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:49.150595 16490 raft_consensus.cc:2410] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:07:49.151322 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2085) took 2322 ms. Trace:
I20260709 13:07:49.151392 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.151700 16484 rpcz_store.cc:276] 0709 13:07:46.828769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.271963 (+443194us) service_pool.cc:224] Handling call
0709 13:07:47.282503 (+ 10540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.384072 (+1101569us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000f9720. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648d1c0 00007f063648e231 00007f063648ad8f 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c
0709 13:07:49.151110 (+767038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.151275 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401070336}
I20260709 13:07:49.152410 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.088300 16632 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:49.087214 20538 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:49.092932 20490 consensus_meta.cc:287] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.001s
I20260709 13:07:49.075640 20433 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.106333 20437 consensus_queue.cc:1059] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:49.119243 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.120235 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.165537 16486 raft_consensus.cc:2410] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:07:49.071623 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.167099 16557 raft_consensus.cc:2410] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:49.124294 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:49.124977 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:49.168205 16638 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:49.127329 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.128335 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:49.121179 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:49.141206 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.141790 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.172174 16530 connection.cc:256] RPC call timeout handler was delayed by -3.8648436629999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:07:49.172546 16530 connection.cc:256] RPC call timeout handler was delayed by -3.831543662999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:07:49.172825 16530 connection.cc:256] RPC call timeout handler was delayed by -3.6857436629999256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:07:49.173099 16530 connection.cc:256] RPC call timeout handler was delayed by -3.6713436629999023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:07:49.173358 16530 connection.cc:256] RPC call timeout handler was delayed by -3.5921436630000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 13:07:49.141501 16558 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.150463 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:49.174698 16560 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.048355 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:49.152555 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.089888 20477 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.114718 20411 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:49.153909 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.080120 20262 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:49.156978 20373 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:07:49.153023 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.115669 20537 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:49.164884 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.153091 20417 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:49.179287 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.180395 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.191183 16557 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:49.166350 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.155084 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.193017 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.194393 16488 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:07:49.195504 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.183995 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:49.187757 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:49.196995 16530 connection.cc:256] RPC call timeout handler was delayed by -3.5903436629999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 13:07:49.197398 16530 connection.cc:256] RPC call timeout handler was delayed by -3.4157436629999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 13:07:49.197665 16530 connection.cc:256] RPC call timeout handler was delayed by -2.3924436629999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3328s for a response
I20260709 13:07:49.198567 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.160059 20448 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.205262 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:49.205405 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:49.206018 16557 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.205963 16632 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:49.208153 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.164135 20433 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.208779 16561 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:49.183406 20424 consensus_meta.cc:287] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.003s
I20260709 13:07:49.209625 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.210301 16561 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:49.211141 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.186831 20310 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.177493 20482 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:49.177281 20477 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:49.215910 20471 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.223902 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2381) took 1476 ms. Trace:
I20260709 13:07:49.227074 16565 rpcz_store.cc:276] 0709 13:07:47.747629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.997515 (+249886us) service_pool.cc:224] Handling call
0709 13:07:47.997768 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.396158 (+398390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.223645 (+827487us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54001c8c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:49.223841 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818600832}
W20260709 13:07:49.225603 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.156291 20300 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.176662 20490 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.238385 16558 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:07:49.239413 16560 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:49.241968 16530 leader_election.cc:400] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:49.242841 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1368) took 4649 ms. Trace:
I20260709 13:07:49.243180 16491 rpcz_store.cc:276] 0709 13:07:44.580025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.590091 (+ 10066us) service_pool.cc:224] Handling call
0709 13:07:46.598605 (+2008514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.239724 (+641119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.958955 (+719231us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54002d6c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:49.224443 (+1265488us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54002d6c50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:49.229084 (+  4641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5891094016}
I20260709 13:07:49.246323 16557 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:49.246953 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:49.242444 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 66271.1us
I20260709 13:07:49.215399 20433 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.252918 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.218284 20310 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:49.254981 17153 leader_election.cc:336] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.999s (SENT)
I20260709 13:07:49.267352 16484 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:49.261950 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.268077 16491 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:49.262626 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.269675 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.270906 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:49.228642 20448 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:49.272346 20499 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.266799 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:49.273659 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.226920 20471 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:49.278748 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.160161 20496 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:49.230180 20360 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:49.215340 20424 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.281282 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:49.265094 20310 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.280881 20419 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.285283 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.227830 20482 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:49.303180 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:49.319144 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:49.324404 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.321178 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:49.293509 20471 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.326977 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.335327 16566 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:49.336251 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.338265 16566 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.292037 20383 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.283928 20385 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:49.346715 16566 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:07:49.285678 20411 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:07:49.302163 20360 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:49.353204 17153 leader_election.cc:336] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.136s (SENT)
I20260709 13:07:49.326320 20342 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.356056 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.327073 20478 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:49.363269 17153 leader_election.cc:336] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.236s (SENT)
I20260709 13:07:49.438022 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:49.438872 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 75632us
I20260709 13:07:49.350566 20472 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:49.386516 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.384083 20342 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.347657 20383 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.328271 20537 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:49.401840 20513 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:49.298885 20530 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:07:49.284564 20550 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:07:49.273120 20538 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.451241 20342 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.453910 20383 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.480297 20489 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.327731 20349 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:49.383322 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.535481 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.535866 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.349714 20421 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.463881 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.410272 20360 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:49.423838 20437 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.350121 20477 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:49.489110 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.417757 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.484809 20472 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:49.558928 16566 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:49.492887 20300 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:49.562635 20545 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:07:49.563683 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2075) took 1165 ms. Trace:
I20260709 13:07:49.564030 16564 rpcz_store.cc:276] 0709 13:07:48.397798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.081204 (+683406us) service_pool.cc:224] Handling call
0709 13:07:49.092855 (+ 11651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.093088 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.093104 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.093382 (+   278us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.248599 (+155217us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:49.248634 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.248693 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.563450 (+314757us) raft_consensus.cc:1685] finished
0709 13:07:49.563468 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.563627 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2896,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":131796,"threads_started":1,"wal-append.queue_time_us":211163}
I20260709 13:07:49.565773 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.481799 20142 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:49.563939 20543 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:07:49.577286 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.510831 20490 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:49.601125 16482 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:49.499979 20333 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.606612 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.607403 16566 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:49.609710 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.609982 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.612304 16564 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:49.613637 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2087) took 1191 ms. Trace:
W20260709 13:07:49.612206 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 461466us
I20260709 13:07:49.640919 16566 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:49.557330 20421 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.566443 20517 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.579403 20537 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:49.652309 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.695537 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2094) took 1044 ms. Trace:
W20260709 13:07:49.944593 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 113163us
W20260709 13:07:49.917582 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 418259us
W20260709 13:07:49.819339 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.727653 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.944424 16560 rpcz_store.cc:276] 0709 13:07:48.650860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.241049 (+590189us) service_pool.cc:224] Handling call
0709 13:07:49.241295 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.245513 (+  4218us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:49.365317 (+119804us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.695232 (+329915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.695282 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:49.695324 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.695381 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.695488 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67179,"prepare.queue_time_us":229100,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":124006,"spinlock_wait_cycles":57171200,"thread_start_us":258683,"threads_started":2}
W20260709 13:07:49.945722 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 321899us
I20260709 13:07:49.953105 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:49.793395 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.954049 16564 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:49.778316 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.962373 16566 raft_consensus.cc:2368] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12.
I20260709 13:07:49.974581 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:49.973201 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:49.978617 16566 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:49.903298 20533 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.118s	user 0.002s	sys 0.000s
I20260709 13:07:50.041620 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:50.041976 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 68846.7us
I20260709 13:07:49.982661 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:49.715655 20338 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.004s
W20260709 13:07:49.942018 20565 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.329s	user 0.000s	sys 0.000s
W20260709 13:07:49.935999 20552 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.453s	user 0.001s	sys 0.000s
W20260709 13:07:50.076938 20185 consensus_meta.cc:287] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.921s	user 0.006s	sys 0.002s
I20260709 13:07:50.076987 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2076) took 1678 ms. Trace:
I20260709 13:07:50.077520 16562 rpcz_store.cc:276] 0709 13:07:48.399022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.083867 (+684845us) service_pool.cc:224] Handling call
0709 13:07:49.103003 (+ 19136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.103318 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:49.233169 (+129851us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.240716 (+  7547us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.241155 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.241275 (+   120us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:49.241305 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.241366 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.076811 (+835445us) raft_consensus.cc:1685] finished
0709 13:07:50.076830 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.076937 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2285,"prepare.queue_time_us":198756,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":7397,"raft.queue_time_us":719,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":7308,"thread_start_us":136480,"threads_started":2,"wal-append.queue_time_us":130107}
I20260709 13:07:49.828298 20550 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:50.082157 20352 consensus_meta.cc:287] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 1.002s	user 0.008s	sys 0.000s
I20260709 13:07:50.081880 20550 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:49.720674 20562 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:49.963124 20366 consensus_meta.cc:287] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.000s
I20260709 13:07:50.083352 20366 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.085381 20366 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:50.086163 20288 consensus_meta.cc:287] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.971s	user 0.005s	sys 0.002s
I20260709 13:07:50.086535 20288 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.049544 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:50.087168 16488 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.042697 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:50.087848 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 45227.8us
I20260709 13:07:50.088691 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:50.089157 20550 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:49.937098 20530 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:50.047344 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.732103 20563 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:50.090692 20563 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.092703 20563 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:49.763247 20417 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.093360 20417 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.095319 20417 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:50.062294 16560 raft_consensus.cc:2393] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 13: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:49.692543 20551 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.047782 20422 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.063354 20338 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.097486 20422 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.098394 20338 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:50.098958 20338 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:50.099375 20338 raft_consensus.cc:697] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:50.100467 20349 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:50.100207 20338 consensus_queue.cc:237] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.101055 20349 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.064961 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 521) took 1693 ms. Trace:
I20260709 13:07:50.101413 20349 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.101603 16489 rpcz_store.cc:276] 0709 13:07:48.371191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.371304 (+   113us) service_pool.cc:224] Handling call
0709 13:07:48.402420 (+ 31116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.402671 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.402695 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.403105 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.612623 (+209518us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.612655 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.612738 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.902677 (+1289939us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:50.064656 (+161979us) raft_consensus.cc:1685] finished
0709 13:07:50.064679 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.064906 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6732032,"thread_start_us":186170,"threads_started":1,"wal-append.queue_time_us":269310}
I20260709 13:07:50.103377 16490 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:07:50.065155 20561 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.333s	user 0.000s	sys 0.000s
W20260709 13:07:50.068866 20322 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.913s	user 0.006s	sys 0.002s
I20260709 13:07:50.104527 20322 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.096903 20551 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:50.082572 20352 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:50.106798 20471 consensus_meta.cc:287] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.754s	user 0.005s	sys 0.000s
I20260709 13:07:50.106524 20551 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.107236 16485 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:50.107172 20471 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.108870 20421 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:50.109084 20551 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.106411 20322 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:50.109265 20352 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:50.109601 20446 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:50.041996 20435 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 13:07:50.116262 20142 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:49.791020 20472 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:49.652637 20333 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.128659 20328 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:50.132665 20469 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:50.139374 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2091) took 1018 ms. Trace:
I20260709 13:07:50.203917 16484 rpcz_store.cc:276] 0709 13:07:49.121111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.152835 (+ 31724us) service_pool.cc:224] Handling call
0709 13:07:50.139176 (+986341us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b5400400454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:50.139312 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186151808}
W20260709 13:07:50.204360 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.145095 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 101090us
I20260709 13:07:50.148355 20488 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:50.149111 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:50.207839 17152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.017s	sys 0.009s
I20260709 13:07:50.208209 16631 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.151181 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2077) took 3324 ms. Trace:
I20260709 13:07:50.090426 20530 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:50.087395 16566 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:50.208164 17152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.017s	sys 0.009s
W20260709 13:07:50.154131 16563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 2082) took 1750 ms (client timeout 1954 ms). Trace:
W20260709 13:07:50.210461 16563 rpcz_store.cc:269] 0709 13:07:48.404168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.787846 (+383678us) service_pool.cc:224] Handling call
0709 13:07:50.153926 (+1366080us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54000d3ed4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:50.154057 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536493440}
I20260709 13:07:50.151774 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:50.156795 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.157851 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.161720 16491 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:50.147565 20544 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.852s	user 0.001s	sys 0.000s
W20260709 13:07:50.093241 20466 consensus_meta.cc:287] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.038s	user 0.006s	sys 0.001s
I20260709 13:07:49.790691 20385 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.847289 20567 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.172711 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.828451 20482 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:50.177819 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.263970 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:49.643770 20448 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.450s
I20260709 13:07:49.979959 20549 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.060729 20504 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:50.190824 16604 connection.cc:256] RPC call timeout handler was delayed by -1.248888868999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:07:50.175753 20237 consensus_meta.cc:287] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 1.083s	user 0.004s	sys 0.004s
I20260709 13:07:50.192348 16557 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.207758 20488 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:50.254067 20435 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:50.204746 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.288626 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.205233 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:50.205675 16531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.005s	sys 0.021s
I20260709 13:07:50.149721 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2319) took 2164 ms. Trace:
I20260709 13:07:49.790653 20360 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:50.211915 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 250192us
I20260709 13:07:50.208868 16483 rpcz_store.cc:276] 0709 13:07:46.826696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.245120 (+418424us) service_pool.cc:224] Handling call
0709 13:07:47.263678 (+ 18558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.288026 (+ 24348us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:47.288255 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.545202 (+256947us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.550506 (+  5304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.550552 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.550610 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.853353 (+1302743us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b180035a460. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e522 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:48.899133 (+ 45780us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b180035a460. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419
0709 13:07:50.150983 (+1251850us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400289e54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:50.151034 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.151134 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6424,"prepare.queue_time_us":3258,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":1440,"raft.queue_time_us":79950,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":32000,"spinlock_wait_cycles":63010304,"thread_start_us":255012,"threads_started":2,"wal-append.queue_time_us":107481,"wal-append.run_cpu_time_us":2382,"wal-append.run_wall_time_us":1225085}
I20260709 13:07:50.212334 16558 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:50.214533 16635 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:50.211750 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 60031.7us
I20260709 13:07:50.254522 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.297202 16638 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:50.206799 20433 consensus_meta.cc:287] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.942s	user 0.006s	sys 0.003s
W20260709 13:07:50.208693 20310 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.902s	user 0.007s	sys 0.002s
I20260709 13:07:50.259299 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:50.262472 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.302055 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.289162 20447 consensus_meta.cc:287] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.185s	user 0.005s	sys 0.005s
I20260709 13:07:50.201030 20328 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:50.284998 16563 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:50.284269 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.317883 16632 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:50.163443 20349 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:50.287294 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 197225us
W20260709 13:07:50.299670 20342 consensus_meta.cc:287] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.000s
I20260709 13:07:50.289664 16636 rpcz_store.cc:276] 0709 13:07:47.984799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.984930 (+   131us) service_pool.cc:224] Handling call
0709 13:07:47.985181 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.068603 (+1083422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.149433 (+1080830us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002ba2d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:50.149641 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490265344}
I20260709 13:07:50.078068 20185 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:07:50.290930 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:50.291225 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86071.7us
W20260709 13:07:50.291558 16604 connection.cc:256] RPC call timeout handler was delayed by -1.088688869000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 13:07:50.328158 16604 connection.cc:256] RPC call timeout handler was delayed by -1.0805888690000529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:07:50.328485 16604 connection.cc:256] RPC call timeout handler was delayed by -1.00228886900004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 13:07:50.328547 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:50.329887 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:50.295912 16557 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:50.297798 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:50.300899 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2338) took 1789 ms. Trace:
W20260709 13:07:50.304479 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 54529us
I20260709 13:07:50.202558 20446 consensus_queue.cc:1243] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:50.253130 20466 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.284543 20549 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:50.287336 20448 consensus_queue.cc:1243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:50.317585 16563 pending_rounds.cc:85] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 7
I20260709 13:07:50.347774 16563 pending_rounds.cc:107] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:50.319382 16631 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
W20260709 13:07:50.289960 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.293457 20504 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:50.317895 16566 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:50.270772 20385 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:50.333674 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.334251 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:49.620154 16559 rpcz_store.cc:276] 0709 13:07:48.421993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.222225 (+800232us) service_pool.cc:224] Handling call
0709 13:07:49.222480 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.222671 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:49.281592 (+ 58921us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.612945 (+331353us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.613225 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.613337 (+   112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.613373 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:49.613419 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.613479 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.613582 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60218,"prepare.queue_time_us":130419,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":729,"raft.queue_time_us":90973,"thread_start_us":303932,"threads_started":2}
I20260709 13:07:50.358017 16559 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:50.298113 20435 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:50.330876 16483 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:50.360024 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2104) took 1070 ms. Trace:
I20260709 13:07:50.360339 16483 rpcz_store.cc:276] 0709 13:07:49.289177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.297579 (+1008402us) service_pool.cc:224] Handling call
0709 13:07:50.359969 (+ 62390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.361119 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:50.361725 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2106) took 1009 ms. Trace:
I20260709 13:07:50.361908 16559 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:50.337544 16640 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.338968 16635 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:50.334151 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.340229 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:50.363636 16483 rpcz_store.cc:276] 0709 13:07:49.352624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.360924 (+1008300us) service_pool.cc:224] Handling call
0709 13:07:50.361681 (+   757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.350144 20587 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.316018 20482 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.331954 16639 rpcz_store.cc:276] 0709 13:07:48.511390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.090982 (+579592us) service_pool.cc:224] Handling call
0709 13:07:49.091261 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.091574 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.091602 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.092026 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.161196 (+ 69170us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:49.161231 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.161290 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.147022 (+985732us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:50.298526 (+151504us) raft_consensus.cc:1685] finished
0709 13:07:50.298545 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.300838 (+  2293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1073,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":76,"spinlock_wait_cycles":8454400,"thread_start_us":68911,"threads_started":1,"wal-append.queue_time_us":170970}
W20260709 13:07:50.343096 16637 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2329) took 2332 ms (client timeout 2446 ms). Trace:
W20260709 13:07:50.407245 16637 rpcz_store.cc:269] 0709 13:07:48.005028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.087457 (+ 82429us) service_pool.cc:224] Handling call
0709 13:07:50.337193 (+2249736us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54003f1e54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:50.337299 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760203136}
I20260709 13:07:50.345252 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:50.292114 20237 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.269910 20567 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.348881 16563 raft_consensus.cc:2889] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.349269 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:50.352118 16566 pending_rounds.cc:85] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 9
I20260709 13:07:50.353327 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:50.355626 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:50.341259 16565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.006s	sys 0.007s
I20260709 13:07:50.309782 20433 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.317555 20500 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:50.316363 20310 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.343933 20326 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:50.390232 20547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.025s	sys 0.038s
I20260709 13:07:50.386979 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.389855 20516 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:50.364547 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:50.373414 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 50520us
I20260709 13:07:50.392094 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:50.364490 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:50.368336 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.351949 20300 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:07:50.402930 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.406679 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.438660 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2087) took 1322 ms. Trace:
I20260709 13:07:50.351629 20417 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.440585 16566 pending_rounds.cc:107] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:50.480026 16566 raft_consensus.cc:2889] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.480741 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 501) took 1129 ms. Trace:
W20260709 13:07:50.440960 16565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.006s	sys 0.007s
I20260709 13:07:50.441393 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.481731 16631 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.440750 16484 raft_consensus.cc:2376] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13. Re-sending same reply.
I20260709 13:07:50.333698 20342 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.338652 20322 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:07:50.448907 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 99693.8us
I20260709 13:07:50.449609 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 500) took 1098 ms. Trace:
I20260709 13:07:50.492139 16563 rpcz_store.cc:276] 0709 13:07:49.351355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.264932 (+913577us) service_pool.cc:224] Handling call
0709 13:07:50.284692 (+ 19760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.449393 (+164701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.449559 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.492543 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:50.493327 20366 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.493651 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:50.493757 20577 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:50.495334 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:50.499394 16631 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:50.386238 17181 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:50.508915 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.385790 20582 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.390007 20568 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.389482 20352 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.385653 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.463418 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.385445 20422 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.365607 20447 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.390134 20584 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.376056 16638 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:50.468355 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.474376 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.659896 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2090) took 2140 ms. Trace:
I20260709 13:07:50.660801 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.661314 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.474889 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 499) took 1123 ms. Trace:
I20260709 13:07:50.475121 16482 rpcz_store.cc:276] 0709 13:07:49.115763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.117232 (+  1469us) service_pool.cc:224] Handling call
0709 13:07:50.438475 (+1321243us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540028a354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:50.438607 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062419200}
I20260709 13:07:50.472162 16483 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:50.481122 16566 rpcz_store.cc:276] 0709 13:07:49.351613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.311058 (+959445us) service_pool.cc:224] Handling call
0709 13:07:50.317609 (+  6551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.480508 (+162899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.480683 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.662122 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:50.463064 20547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.026s	sys 0.038s
W20260709 13:07:50.488444 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 96438.2us
I20260709 13:07:50.670292 16636 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:50.670995 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:50.488909 16604 leader_election.cc:336] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.516s (SENT)
I20260709 13:07:50.660336 16565 rpcz_store.cc:276] 0709 13:07:48.519697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.228358 (+708661us) service_pool.cc:224] Handling call
0709 13:07:49.228634 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.228809 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:49.335641 (+106832us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.659482 (+1323841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.659536 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:50.659642 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.659715 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.659843 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31055,"prepare.queue_time_us":195551,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":1370895,"threads_started":3}
I20260709 13:07:50.489394 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:50.467744 20525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.024s
I20260709 13:07:50.501703 20556 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.672528 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.673166 16565 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.663125 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:50.672197 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 183303us
I20260709 13:07:50.672163 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.676103 16566 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:50.642071 20562 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.351819 20370 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:07:50.347388 20549 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.389680 20574 consensus_queue.cc:1059] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:07:50.510133 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.510200 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:50.464361 20471 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:50.473102 19986 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:50.646908 16632 raft_consensus.cc:2368] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:50.444239 20482 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:50.648957 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 117534us
I20260709 13:07:50.649780 16635 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
W20260709 13:07:50.650911 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.651325 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:50.474738 16486 raft_consensus.cc:2410] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:50.662436 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2109) took 1169 ms. Trace:
I20260709 13:07:50.663116 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.725433 16483 rpcz_store.cc:276] 0709 13:07:49.492762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.364289 (+871527us) service_pool.cc:224] Handling call
0709 13:07:50.662383 (+298094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.726091 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.663625 16559 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.661912 16564 rpcz_store.cc:276] 0709 13:07:49.351130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.954689 (+603559us) service_pool.cc:224] Handling call
0709 13:07:50.402820 (+448131us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b5800174c98. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366eee 0000000000375939 00007f063b3da1e0 00007f063b4a30c4 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:07:50.474835 (+ 72015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2977536}
I20260709 13:07:50.726420 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:50.661051 20322 consensus_queue.cc:1243] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:50.669865 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.727381 16638 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.502100 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:50.728339 16489 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:50.640482 20446 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:50.616418 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.727842 16604 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:50.458352 20587 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.708061 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:50.708707 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:50.708814 17179 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:50.708988 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:50.736899 16559 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:50.737035 17187 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 6.
I20260709 13:07:50.709336 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:50.646660 20352 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:50.738154 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.738791 17183 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:50.707044 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:50.739188 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:50.739686 16566 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:50.474036 20581 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:50.670231 20447 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.716724 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:50.717558 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 245392us
W20260709 13:07:50.678505 20525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.005s	sys 0.024s
I20260709 13:07:50.479334 20516 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:50.729663 20579 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:07:50.701284 20185 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.512849 20435 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.730613 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2113) took 1035 ms. Trace:
I20260709 13:07:50.762894 16484 rpcz_store.cc:276] 0709 13:07:49.695382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.482856 (+787474us) service_pool.cc:224] Handling call
0709 13:07:50.730558 (+247702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.725124 19986 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:50.732097 16563 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.766369 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:50.731166 20424 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:50.732874 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.768249 16637 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:50.734767 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.769645 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.744606 20564 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.738019 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:50.740828 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2107) took 1343 ms (client timeout 1643 ms). Trace:
I20260709 13:07:50.652088 20568 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.740646 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:50.797185 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56608.8us
I20260709 13:07:50.738230 20482 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:50.804468 20424 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.804952 20424 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:50.744597 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:50.724519 20437 consensus_meta.cc:287] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.167s	user 0.001s	sys 0.008s
I20260709 13:07:50.814684 20433 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:50.776316 20551 consensus_meta.cc:287] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.003s
I20260709 13:07:50.753111 20571 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:07:50.815526 20487 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:50.814821 20437 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.737198 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:50.748020 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.749068 16631 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:50.749230 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:50.731688 20471 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:50.715062 20556 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:50.499974 20550 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.757318 16638 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:50.758296 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:50.733312 20446 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:50.764719 16565 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:50.753122 20590 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.738534 20513 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:50.770318 16635 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:50.733343 20466 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:50.751691 20581 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.656606 20504 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.769798 20574 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:50.772049 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:50.773787 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2401) took 1507 ms. Trace:
W20260709 13:07:50.775755 20593 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:50.777709 16563 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:50.778395 16482 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:50.778549 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:50.780661 16489 rpcz_store.cc:269] 0709 13:07:49.397048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.501819 (+1104771us) service_pool.cc:224] Handling call
0709 13:07:50.740775 (+238956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.739207 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.728998 20582 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:50.792003 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44679.3us
I20260709 13:07:50.795485 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:50.803200 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.798331 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:50.805042 20447 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:50.776355 20567 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:50.768556 20185 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.087829 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:50.908525 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.088744 16638 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:51.088876 16560 rpcz_store.cc:276] 0709 13:07:49.265924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.096141 (+830217us) service_pool.cc:224] Handling call
0709 13:07:50.096429 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.144153 (+ 47724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.144185 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.162650 (+ 18465us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.323965 (+161315us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:50.324010 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.324070 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.773602 (+449532us) raft_consensus.cc:1685] finished
0709 13:07:50.773621 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.773738 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55288,"raft.queue_time_us":170668,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":14402,"thread_start_us":122131,"threads_started":1,"wal-append.queue_time_us":327733}
I20260709 13:07:50.830257 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.091917 16632 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:51.092658 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1380) took 1048 ms. Trace:
I20260709 13:07:51.093060 16482 rpcz_store.cc:276] 0709 13:07:50.044375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.662931 (+618556us) service_pool.cc:224] Handling call
0709 13:07:51.092600 (+429669us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.093997 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:51.111294 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.112226 16638 raft_consensus.cc:2410] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:51.087904 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:50.832352 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.134332 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 397249us
W20260709 13:07:50.810062 20383 consensus_meta.cc:287] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.271s	user 0.008s	sys 0.001s
I20260709 13:07:51.162129 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.163240 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.086898 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:51.164839 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 78046.7us
I20260709 13:07:51.165714 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:51.169574 16635 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.170161 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2346) took 1011 ms. Trace:
I20260709 13:07:51.170445 16631 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 11. Ops: []
W20260709 13:07:51.171062 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.814639 20592 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:07:51.138175 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:51.155254 20580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.006s
I20260709 13:07:51.191828 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:50.812177 19986 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.170428 16635 rpcz_store.cc:276] 0709 13:07:50.158503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.169149 (+1010646us) service_pool.cc:224] Handling call
0709 13:07:51.169417 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.169944 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.170115 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.815914 20487 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:51.174867 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:50.961673 20605 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:51.092316 20574 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:51.197497 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:50.809689 20342 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:51.198632 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.169298 20567 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:51.169068 20433 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.212746 16560 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.812474 20310 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:51.212906 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2397) took 2004 ms. Trace:
I20260709 13:07:51.200390 20437 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:51.219836 20580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.009s	sys 0.007s
I20260709 13:07:51.214213 16559 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.134971 20556 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.795863 20352 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.160425 20471 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.218631 17188 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
W20260709 13:07:51.133757 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 335499us
I20260709 13:07:51.159610 20326 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.222435 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.200080 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.250569 16482 raft_consensus.cc:2368] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:51.250706 16635 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 7: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:51.172430 20423 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:51.212339 20366 consensus_meta.cc:287] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.000s
I20260709 13:07:51.175817 20447 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.212770 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:51.232867 16562 rpcz_store.cc:276] 0709 13:07:49.208099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.081007 (+872908us) service_pool.cc:224] Handling call
0709 13:07:50.081270 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.140653 (+ 59383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.140685 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.141124 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.296425 (+155301us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:50.296460 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.296515 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.212705 (+916190us) raft_consensus.cc:1685] finished
0709 13:07:51.212736 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.212854 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59035,"raft.queue_time_us":81822,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11984,"thread_start_us":142121,"threads_started":1,"wal-append.queue_time_us":317828}
I20260709 13:07:51.133724 20581 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.238111 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.172590 16566 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.214864 20568 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:51.239863 20567 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:51.159729 20513 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:50.809302 20424 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.176469 20383 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.233418 20433 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.272511 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.276050 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1392) took 1084 ms. Trace:
I20260709 13:07:51.280690 16560 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:51.261346 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:51.271710 20609 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.275122 20366 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.273527 20447 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:51.252885 20423 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.286973 20352 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.339922 20433 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.310889 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:51.038156 20385 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:51.337224 16635 raft_consensus.cc:2368] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:51.369379 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.273689 19986 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.311126 16562 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:51.337014 16489 rpcz_store.cc:276] 0709 13:07:50.191963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.224715 (+1032752us) service_pool.cc:224] Handling call
0709 13:07:51.275997 (+ 51282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.340159 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1390) took 1165 ms. Trace:
I20260709 13:07:51.309136 16559 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:07:51.344137 16639 raft_consensus.cc:2368] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:51.400535 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:51.235859 20446 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.273689 20326 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.533209 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.328258 20613 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:51.435931 16635 raft_consensus.cc:2368] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:07:51.435909 17183 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.235719 20605 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.364552 20447 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.232121 20590 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:51.535355 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 164831us
W20260709 13:07:51.580647 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.377897 16482 rpcz_store.cc:276] 0709 13:07:50.175073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.272272 (+1097199us) service_pool.cc:224] Handling call
0709 13:07:51.340105 (+ 67833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.355741 20433 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.552114 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1396) took 1286 ms. Trace:
I20260709 13:07:51.581874 16489 rpcz_store.cc:276] 0709 13:07:50.265782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.377752 (+1111970us) service_pool.cc:224] Handling call
0709 13:07:51.552049 (+174297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.532322 20513 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:51.568722 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.583474 20516 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:51.287195 20574 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.585791 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 643) took 1240 ms. Trace:
I20260709 13:07:51.595839 17182 rpcz_store.cc:276] 0709 13:07:50.345775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.346414 (+   639us) service_pool.cc:224] Handling call
0709 13:07:50.365707 (+ 19293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.366019 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.366044 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.366468 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.821159 (+454691us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:50.821196 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.821254 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.585611 (+764357us) raft_consensus.cc:1685] finished
0709 13:07:51.585630 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.585741 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22124,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":43,"thread_start_us":357883,"threads_started":1,"wal-append.queue_time_us":863178}
I20260709 13:07:51.402285 20472 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:51.589600 16637 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:51.591862 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.301347 20487 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.614315 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:51.628345 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:51.616232 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.633286 17179 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:51.636417 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:51.637369 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 536) took 1325 ms. Trace:
I20260709 13:07:51.637739 16482 rpcz_store.cc:276] 0709 13:07:50.312322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.636150 (+1323828us) service_pool.cc:224] Handling call
0709 13:07:51.637311 (+  1161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.367844 20609 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.568111 20582 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:51.619374 17187 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 13:07:51.645547 17187 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:51.629070 16489 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:51.407197 20587 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:51.635627 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.649974 16635 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:51.650866 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.651527 16635 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:51.651765 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1385) took 1606 ms. Trace:
I20260709 13:07:51.652170 16489 rpcz_store.cc:276] 0709 13:07:50.045558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.593795 (+1548237us) service_pool.cc:224] Handling call
0709 13:07:51.651695 (+ 57900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.653522 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:51.642081 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.654290 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1405) took 1303 ms. Trace:
I20260709 13:07:51.654618 16482 rpcz_store.cc:276] 0709 13:07:50.351212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.641858 (+1290646us) service_pool.cc:224] Handling call
0709 13:07:51.654234 (+ 12376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.655442 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:51.646790 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.591006 20185 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.416036 19986 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.649205 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:51.656061 16482 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:51.659871 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1393) took 1450 ms. Trace:
I20260709 13:07:51.660653 16482 rpcz_store.cc:276] 0709 13:07:50.209122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.655208 (+1446086us) service_pool.cc:224] Handling call
0709 13:07:51.659821 (+  4613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.620656 20446 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.657423 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.668531 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.672151 20590 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.672890 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:51.673081 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:51.653003 20603 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
I20260709 13:07:51.673550 17187 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:51.673707 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1410) took 1212 ms. Trace:
I20260709 13:07:51.677438 16489 rpcz_store.cc:276] 0709 13:07:50.461407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.652798 (+1191391us) service_pool.cc:224] Handling call
0709 13:07:51.673652 (+ 20854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.673974 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.674371 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:51.674499 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.678551 17182 raft_consensus.cc:2376] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12. Re-sending same reply.
I20260709 13:07:51.682160 16635 raft_consensus.cc:2368] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:07:51.647053 20326 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:51.685549 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.664213 20574 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.689505 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:51.690416 16635 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:51.691964 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:51.696225 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.698944 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1389) took 1638 ms. Trace:
I20260709 13:07:51.699319 16489 rpcz_store.cc:276] 0709 13:07:50.060500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.678063 (+1617563us) service_pool.cc:224] Handling call
0709 13:07:51.698884 (+ 20821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.640146 20472 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.716555 16635 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 11. Ops: [9.6-9.6]
I20260709 13:07:51.717157 20472 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:51.717722 16635 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 10. Ops: []
I20260709 13:07:51.718777 16635 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:51.658658 20437 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:51.714880 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:51.702987 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.697072 20590 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.731946 20623 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 13:07:51.741115 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:51.741870 17187 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:51.634824 20567 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.750373 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:51.737686 20590 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.697180 20504 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.776306 20583 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.487s	user 0.001s	sys 0.007s
I20260709 13:07:51.758322 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:51.751008 17182 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:51.759658 20590 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.760782 20623 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:51.764240 16563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2406) took 1295 ms (client timeout 1556 ms). Trace:
W20260709 13:07:51.783102 16563 rpcz_store.cc:269] 0709 13:07:50.468710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.641276 (+172566us) service_pool.cc:224] Handling call
0709 13:07:51.764086 (+1122810us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b540040f954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:51.764186 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161589504}
I20260709 13:07:51.784613 16563 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.780912 16635 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:51.781623 20623 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.792376 20623 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.593950 20613 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.751560 20624 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.675595 20625 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:07:51.801551 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2110) took 1306 ms. Trace:
I20260709 13:07:51.801900 16563 rpcz_store.cc:276] 0709 13:07:50.483361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.784029 (+1300668us) service_pool.cc:224] Handling call
0709 13:07:51.784446 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.789785 (+  5339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.789965 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.802954 20433 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.804271 20477 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.807451 16633 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:51.775952 20471 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:51.814666 16634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 526) took 3459 ms (client timeout 2166 ms). Trace:
W20260709 13:07:51.815071 16634 rpcz_store.cc:269] 0709 13:07:48.348053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.682931 (+334878us) service_pool.cc:224] Handling call
0709 13:07:51.807141 (+3124210us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b540043b054. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:51.807268 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774529280}
W20260709 13:07:51.816601 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.817087 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.817512 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.817826 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.818015 20619 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:07:51.822674 20471 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.822921 20328 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:51.807753 20616 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:07:51.813833 20423 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.820734 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 780) took 1042 ms. Trace:
I20260709 13:07:51.826179 17182 rpcz_store.cc:276] 0709 13:07:50.778256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.806346 (+1028090us) service_pool.cc:224] Handling call
0709 13:07:51.820264 (+ 13918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.820437 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.820459 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.820499 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:51.820528 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.820576 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.820669 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.804906 19986 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:51.782228 20504 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.830154 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2111) took 1346 ms. Trace:
I20260709 13:07:51.821519 20185 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:51.835364 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2407) took 1366 ms. Trace:
I20260709 13:07:51.843690 20185 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.838567 20328 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.856204 20487 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.829620 20622 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.861282 17183 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:51.840612 20605 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.827533 20471 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.821587 20437 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.872841 20504 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.813923 20623 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:51.875680 20627 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:07:51.878499 20566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.620s	user 0.008s	sys 0.015s
I20260709 13:07:51.892715 20623 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:51.893981 20549 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 1.180s	user 0.003s	sys 0.008s
I20260709 13:07:51.894527 20549 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:51.867573 20622 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:51.898517 20562 consensus_meta.cc:287] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.172s	user 0.010s	sys 0.000s
I20260709 13:07:51.883188 20613 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:51.949018 16454 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40220 dropped due to backpressure: service queue is full with 50 items
W20260709 13:07:52.009136 20349 consensus_meta.cc:287] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 1.673s	user 0.007s	sys 0.004s
I20260709 13:07:51.935079 16483 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:51.906080 20622 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:51.838867 16563 rpcz_store.cc:276] 0709 13:07:50.483590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.807129 (+1323539us) service_pool.cc:224] Handling call
0709 13:07:51.828753 (+ 21624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.828925 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.828950 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.829899 (+   949us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:51.829938 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.829994 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.830102 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.001506 20549 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:51.951737 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2415) took 1480 ms. Trace:
I20260709 13:07:52.039189 16566 rpcz_store.cc:276] 0709 13:07:50.470794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.282894 (+812100us) service_pool.cc:224] Handling call
0709 13:07:51.283195 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.283504 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.283529 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.309956 (+ 26427us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.674486 (+364530us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:51.674525 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.674586 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.951284 (+276698us) raft_consensus.cc:1685] finished
0709 13:07:51.951319 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.951574 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":24675,"thread_start_us":260142,"threads_started":1,"wal-append.queue_time_us":501485}
W20260709 13:07:52.041085 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.041706 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.010025 20349 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.044669 20349 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:52.046710 16557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2399) took 2802 ms (client timeout 2145 ms). Trace:
I20260709 13:07:51.900592 20562 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.977001 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 323429us
I20260709 13:07:52.050359 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2398) took 2823 ms. Trace:
I20260709 13:07:52.050772 16558 rpcz_store.cc:276] 0709 13:07:49.227160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.087028 (+859868us) service_pool.cc:224] Handling call
0709 13:07:50.212106 (+125078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.296411 (+ 84305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.049972 (+1753561us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400116f50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.050171 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286996224}
W20260709 13:07:51.900322 20566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.644s	user 0.008s	sys 0.015s
W20260709 13:07:52.053966 16485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 527) took 3636 ms (client timeout 1859 ms). Trace:
W20260709 13:07:52.054458 16485 rpcz_store.cc:269] 0709 13:07:48.417156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.571110 (+153954us) service_pool.cc:224] Handling call
0709 13:07:52.053482 (+3482372us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002981d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.053712 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328261376}
I20260709 13:07:52.012854 16632 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.055449 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.056674 16634 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
W20260709 13:07:52.013010 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.936820 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2416) took 1465 ms. Trace:
I20260709 13:07:51.989969 20471 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:51.941955 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 480312us
I20260709 13:07:52.042474 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2418) took 1312 ms. Trace:
I20260709 13:07:52.060722 16566 rpcz_store.cc:276] 0709 13:07:50.730023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.041188 (+1311165us) service_pool.cc:224] Handling call
0709 13:07:52.041691 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.042112 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.042144 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.042199 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:52.042228 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.042291 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.042398 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.063012 16483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1388) took 2016 ms (client timeout 1843 ms). Trace:
W20260709 13:07:52.063563 16483 rpcz_store.cc:269] 0709 13:07:50.046241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.087688 (+1041447us) service_pool.cc:224] Handling call
0709 13:07:52.062694 (+975006us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400289954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.062914 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855900416}
I20260709 13:07:52.069993 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2408) took 1600 ms. Trace:
W20260709 13:07:52.047214 16557 rpcz_store.cc:269] 0709 13:07:49.244584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.246799 (+  2215us) service_pool.cc:224] Handling call
0709 13:07:52.046281 (+2799482us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540032afd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.046479 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173202176}
I20260709 13:07:52.058068 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1438) took 1304 ms. Trace:
I20260709 13:07:52.070390 16559 rpcz_store.cc:276] 0709 13:07:50.469173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.738997 (+269824us) service_pool.cc:224] Handling call
0709 13:07:52.069577 (+1330580us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540002c454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.069775 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283927424}
I20260709 13:07:52.074932 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1433) took 1397 ms. Trace:
W20260709 13:07:52.078909 20581 consensus_meta.cc:287] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.777s	user 0.007s	sys 0.005s
I20260709 13:07:52.079432 20581 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:51.936968 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.078855 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2417) took 1353 ms. Trace:
W20260709 13:07:52.094588 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.097841 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.098304 17185 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:52.058596 16560 rpcz_store.cc:276] 0709 13:07:50.471053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.337691 (+866638us) service_pool.cc:224] Handling call
0709 13:07:51.337988 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.338196 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:51.614851 (+276655us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.935415 (+320564us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.935895 (+   480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.935954 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:51.936073 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.936216 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.936502 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":417662,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":107,"raft.queue_time_us":49495,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":3533,"thread_start_us":488258,"threads_started":2,"wal-append.queue_time_us":258546}
W20260709 13:07:52.098773 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.094828 20447 consensus_meta.cc:287] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.004s
I20260709 13:07:52.072371 16632 rpcz_store.cc:276] 0709 13:07:50.753827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.192831 (+439004us) service_pool.cc:224] Handling call
0709 13:07:51.220120 (+ 27289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.055958 (+835838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.057694 (+  1736us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540043b554. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.057950 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805072640}
I20260709 13:07:52.100072 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1437) took 1353 ms. Trace:
I20260709 13:07:52.075310 16638 rpcz_store.cc:276] 0709 13:07:50.677271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.176025 (+498754us) service_pool.cc:224] Handling call
0709 13:07:51.176453 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.396046 (+219593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.414853 (+ 18807us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.415347 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.844206 (+428859us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:52.073918 (+229712us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.074371 (+   453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.074477 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.074563 (+    86us) raft_consensus.cc:1685] finished
0709 13:07:52.074579 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.074719 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21927,"prepare.queue_time_us":186561,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":48407,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":5867,"thread_start_us":723954,"threads_started":3,"wal-append.queue_time_us":471612}
I20260709 13:07:52.101287 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2339) took 3588 ms. Trace:
I20260709 13:07:52.102691 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 639) took 1757 ms. Trace:
I20260709 13:07:52.105669 16637 rpcz_store.cc:276] 0709 13:07:50.746920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.176383 (+429463us) service_pool.cc:224] Handling call
0709 13:07:51.220529 (+ 44146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.621227 (+400698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.099430 (+478203us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000b1b54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.099896 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839127808}
I20260709 13:07:52.106969 17184 rpcz_store.cc:276] 0709 13:07:50.344668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.344778 (+   110us) service_pool.cc:224] Handling call
0709 13:07:50.362265 (+ 17487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.731996 (+369731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.732033 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.732070 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:50.732100 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.102236 (+1370136us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b540005d2d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.102302 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.102499 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849808768}
I20260709 13:07:52.114441 20383 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.118355 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:52.121934 16631 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.122112 16603 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.124706 16484 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:52.125591 20430 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:52.123719 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1421) took 1824 ms. Trace:
I20260709 13:07:52.125991 20383 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.132485 20423 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:52.090137 16563 rpcz_store.cc:276] 0709 13:07:50.724878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.036399 (+1311521us) service_pool.cc:224] Handling call
0709 13:07:52.037069 (+   670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.037645 (+   576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.037677 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.038408 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.073492 (+ 35084us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:52.073527 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.073613 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.078522 (+  4909us) raft_consensus.cc:1685] finished
0709 13:07:52.078542 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.078684 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18830,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"thread_start_us":34649,"threads_started":1,"wal-append.queue_time_us":35105}
I20260709 13:07:52.126858 16631 rpcz_store.cc:276] 0709 13:07:50.298812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.196556 (+897744us) service_pool.cc:224] Handling call
0709 13:07:51.196840 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.122443 (+925603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.123450 (+  1007us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54002c8654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.123660 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124646272}
I20260709 13:07:52.128084 20584 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.129904 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1399) took 1827 ms (client timeout 2092 ms). Trace:
W20260709 13:07:52.138994 16489 rpcz_store.cc:269] 0709 13:07:50.298840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.936260 (+1637420us) service_pool.cc:224] Handling call
0709 13:07:52.126504 (+190244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.140260 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.140895 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:51.839469 16565 rpcz_store.cc:276] 0709 13:07:50.468946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.093960 (+625014us) service_pool.cc:224] Handling call
0709 13:07:51.094259 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.094449 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:51.396229 (+301780us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.835054 (+438825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.835107 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:51.835149 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.835209 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.835312 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28566,"prepare.queue_time_us":533463,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":17727,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2995,"thread_start_us":625988,"threads_started":2,"wal-append.queue_time_us":460702}
I20260709 13:07:52.007043 16454 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40220 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2122)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2119)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2118)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2134)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2098)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2099)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1381)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1383)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1409)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2138)
I20260709 13:07:52.106671 16633 rpcz_store.cc:276] 0709 13:07:48.512387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.108420 (+596033us) service_pool.cc:224] Handling call
0709 13:07:51.807244 (+2698824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.807899 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.100888 (+292989us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b540043b050. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.101094 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6205907840}
I20260709 13:07:52.130255 20581 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:52.141131 16489 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.139909 20584 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.120468 20422 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.126041 20430 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:52.147537 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:52.135064 16484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 538) took 1819 ms (client timeout 1570 ms). Trace:
W20260709 13:07:52.149573 16484 rpcz_store.cc:269] 0709 13:07:50.312825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.763519 (+450694us) service_pool.cc:224] Handling call
0709 13:07:52.132381 (+1368862us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000e8154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.132523 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377650432}
W20260709 13:07:52.151587 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1386) took 2103 ms (client timeout 2540 ms). Trace:
W20260709 13:07:52.151990 16489 rpcz_store.cc:269] 0709 13:07:50.045787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.139781 (+2093994us) service_pool.cc:224] Handling call
0709 13:07:52.149474 (+  9693us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.152855 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.154856 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:52.142644 20558 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.934s	user 0.008s	sys 0.030s
I20260709 13:07:52.155002 20333 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.161339 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.163599 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.164134 16635 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:52.164353 16634 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:52.163594 17183 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:07:52.151659 16530 connection.cc:256] RPC call timeout handler was delayed by -1.15653911600009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
I20260709 13:07:52.120781 20447 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:52.165828 16530 connection.cc:256] RPC call timeout handler was delayed by -1.15653911600009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:07:52.160002 20556 consensus_meta.cc:287] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.001s
W20260709 13:07:52.166226 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1358391160000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:07:52.166640 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1358391160000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:07:52.169080 20430 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.172444 20430 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:52.174332 20446 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.012s
I20260709 13:07:52.157586 20383 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:52.175107 16604 leader_election.cc:336] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.896s (SENT)
I20260709 13:07:52.170269 17181 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
W20260709 13:07:52.171442 20550 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.010s	user 0.000s	sys 0.015s
W20260709 13:07:52.167214 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1187391160000288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:07:52.172649 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:52.179412 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 54519.7us
W20260709 13:07:52.179890 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1034391160001178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 13:07:52.180447 16530 connection.cc:256] RPC call timeout handler was delayed by -1.1034391160001178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 13:07:52.180859 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0827391160000843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 13:07:52.179888 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:52.181177 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0827391160000843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 13:07:52.182123 16484 raft_consensus.cc:2410] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:52.183163 16632 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:52.184880 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.186057 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:52.190901 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.175701 20383 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.194499 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2419) took 1459 ms. Trace:
I20260709 13:07:52.191900 20550 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:52.199014 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1402) took 1877 ms (client timeout 2433 ms). Trace:
W20260709 13:07:52.199321 16489 rpcz_store.cc:269] 0709 13:07:50.319519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.160929 (+1841410us) service_pool.cc:224] Handling call
0709 13:07:52.196536 (+ 35607us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.201683 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.203083 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.182497 20556 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.205766 16638 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:52.208237 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2083) took 3803 ms. Trace:
I20260709 13:07:52.208588 16561 rpcz_store.cc:276] 0709 13:07:48.404389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.221527 (+817138us) service_pool.cc:224] Handling call
0709 13:07:49.221830 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.222156 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.222186 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.252088 (+ 29902us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.353884 (+101796us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:49.354239 (+   355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.354363 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.141798 (+2787435us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:52.203856 (+ 62058us) raft_consensus.cc:1685] finished
0709 13:07:52.203879 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.208048 (+  4169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":16019,"spinlock_wait_cycles":155005184,"thread_start_us":69023,"threads_started":1,"wal-append.queue_time_us":709554}
I20260709 13:07:52.194936 16558 rpcz_store.cc:276] 0709 13:07:50.730286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.051713 (+1321427us) service_pool.cc:224] Handling call
0709 13:07:52.127440 (+ 75727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.128576 (+  1136us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:52.128948 (+   372us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.188422 (+ 59474us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.188464 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:52.189736 (+  1272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.189798 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.189897 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":718,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":7534,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2943,"thread_start_us":38268,"threads_started":1}
I20260709 13:07:52.210258 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.212736 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2097) took 3035 ms. Trace:
I20260709 13:07:52.214408 16490 rpcz_store.cc:276] 0709 13:07:49.177134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.213672 (+ 36538us) service_pool.cc:224] Handling call
0709 13:07:49.232619 (+ 18947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.103767 (+871148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.210379 (+2106612us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400331dd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.212115 (+  1736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001957120}
I20260709 13:07:52.223271 20447 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.223548 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.225206 16490 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:52.225740 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2114) took 1140 ms. Trace:
I20260709 13:07:52.226023 16490 rpcz_store.cc:276] 0709 13:07:51.085521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.223232 (+1137711us) service_pool.cc:224] Handling call
0709 13:07:52.225651 (+  2419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.226958 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.227777 16490 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:52.229883 20352 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.830s	user 0.013s	sys 0.005s
I20260709 13:07:52.230937 16482 raft_consensus.cc:2410] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:07:52.232064 16482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1387) took 2186 ms (client timeout 2295 ms). Trace:
W20260709 13:07:52.232429 16482 rpcz_store.cc:269] 0709 13:07:50.046011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.673768 (+1627757us) service_pool.cc:224] Handling call
0709 13:07:52.231864 (+558096us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400258354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.232018 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269955968}
I20260709 13:07:52.233492 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.234162 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2118) took 1074 ms. Trace:
I20260709 13:07:52.234445 16482 rpcz_store.cc:276] 0709 13:07:51.159980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.233209 (+1073229us) service_pool.cc:224] Handling call
0709 13:07:52.234104 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.235297 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.237290 20469 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.237764 20469 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.239035 20469 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.239295 20488 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:52.239910 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.237334 20556 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:52.242300 20469 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.244475 20496 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.245389 20614 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.229416 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.246097 20614 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.240516 20488 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.253173 16603 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.222517 20333 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.253293 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.259752 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1382) took 2212 ms. Trace:
I20260709 13:07:52.260165 16490 rpcz_store.cc:276] 0709 13:07:50.044877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.228383 (+2183506us) service_pool.cc:224] Handling call
0709 13:07:52.257493 (+ 29110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.264648 20419 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.265056 20419 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:52.271001 20419 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:52.272266 16491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2101) took 3040 ms (client timeout 1954 ms). Trace:
W20260709 13:07:52.272718 16491 rpcz_store.cc:269] 0709 13:07:49.231903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.268655 (+ 36752us) service_pool.cc:224] Handling call
0709 13:07:52.271818 (+3003163us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b5400178254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.272083 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2013605632}
I20260709 13:07:52.254220 20333 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.272207 20419 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.274641 20333 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.276183 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.276846 17184 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:52.277913 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:52.279035 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.279471 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2119) took 1106 ms. Trace:
I20260709 13:07:52.279886 16489 rpcz_store.cc:276] 0709 13:07:51.173059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.222232 (+1049173us) service_pool.cc:224] Handling call
0709 13:07:52.279417 (+ 57185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.281926 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 62511.3us
I20260709 13:07:52.282166 16482 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.288741 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.287551 20427 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.280092 20517 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.293395 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.290334 20427 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.296708 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.299741 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2125) took 1059 ms. Trace:
I20260709 13:07:52.300118 16490 rpcz_store.cc:276] 0709 13:07:51.240722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.284532 (+1043810us) service_pool.cc:224] Handling call
0709 13:07:52.299686 (+ 15154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.298992 20614 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.299304 20427 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.315985 17184 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:52.317399 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2404) took 1838 ms. Trace:
I20260709 13:07:52.318035 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:52.318917 17184 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.322213 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2094) took 3200 ms. Trace:
I20260709 13:07:52.322597 16486 rpcz_store.cc:276] 0709 13:07:49.121818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.166121 (+ 44303us) service_pool.cc:224] Handling call
0709 13:07:52.321842 (+3155721us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000e7754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.322037 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2946534784}
I20260709 13:07:52.329128 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:52.329648 16632 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.330893 16638 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.332077 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.332233 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.333220 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:52.334019 16631 raft_consensus.cc:2368] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11.
I20260709 13:07:52.334882 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:52.335649 20556 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:52.336265 20556 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.336903 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.337276 16632 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:07:52.338114 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.338306 20556 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.339002 16489 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.339444 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1408) took 1930 ms. Trace:
W20260709 13:07:52.340546 16639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2351) took 2180 ms (client timeout 2109 ms). Trace:
W20260709 13:07:52.340942 16639 rpcz_store.cc:269] 0709 13:07:50.159659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.489188 (+329529us) service_pool.cc:224] Handling call
0709 13:07:52.340170 (+1850982us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54000fd2d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.340359 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536740224}
I20260709 13:07:52.342248 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 533) took 3170 ms. Trace:
I20260709 13:07:52.342577 16488 rpcz_store.cc:276] 0709 13:07:49.171602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.195068 (+ 23466us) service_pool.cc:224] Handling call
0709 13:07:49.195307 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.087592 (+892285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.341865 (+2254273us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54000e7c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.342110 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050613120}
I20260709 13:07:52.343873 17184 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:52.344527 17188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 777) took 1627 ms (client timeout 1787 ms). Trace:
W20260709 13:07:52.344923 17188 rpcz_store.cc:269] 0709 13:07:50.717173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.743543 (+ 26370us) service_pool.cc:224] Handling call
0709 13:07:52.344214 (+1600671us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54004cb154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.344368 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369429248}
I20260709 13:07:52.346067 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.346753 17188 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:52.347903 17187 raft_consensus.cc:2410] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:52.349735 17182 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:52.350219 20530 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.351311 20530 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.351962 20551 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.335626 16634 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:52.352048 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.343631 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:52.353550 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.353713 16488 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.354624 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.355293 16488 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.323690 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.358664 16486 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:52.359025 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:52.351707 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 648) took 1130 ms. Trace:
I20260709 13:07:52.360703 20499 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:52.360637 17182 rpcz_store.cc:276] 0709 13:07:51.221049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.041460 (+820411us) service_pool.cc:224] Handling call
0709 13:07:52.349265 (+307805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.350116 (+   851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.351504 (+  1388us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54004cb150. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.351624 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706275200}
W20260709 13:07:52.359679 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.317759 16564 rpcz_store.cc:276] 0709 13:07:50.468228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.765283 (+297055us) service_pool.cc:224] Handling call
0709 13:07:50.765554 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.285270 (+519716us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:51.558944 (+273674us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.941345 (+382401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.941467 (+   122us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:51.941600 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.306351 (+364751us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54001c8754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.306392 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.306554 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":397946,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":44271,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":187,"spinlock_wait_cycles":1194726272,"thread_start_us":608158,"threads_started":2,"wal-append.queue_time_us":318643}
I20260709 13:07:52.361956 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.339731 16489 rpcz_store.cc:276] 0709 13:07:50.409267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.337856 (+1928589us) service_pool.cc:224] Handling call
0709 13:07:52.339399 (+  1543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.363951 17188 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.363023 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.364784 16490 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.344923 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.355647 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1407) took 1959 ms. Trace:
I20260709 13:07:52.366007 16488 rpcz_store.cc:276] 0709 13:07:50.395904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.354325 (+1958421us) service_pool.cc:224] Handling call
0709 13:07:52.355596 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.361352 20478 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.367683 17184 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:52.368603 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 649) took 1138 ms. Trace:
I20260709 13:07:52.369016 17188 rpcz_store.cc:276] 0709 13:07:51.227231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.347295 (+1120064us) service_pool.cc:224] Handling call
0709 13:07:52.347681 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.365571 (+ 17890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.365793 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.369801 20478 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.371533 17188 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:52.372062 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.371768 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.376462 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.367830 20419 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:52.372489 20478 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.372987 20586 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.373481 20499 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:52.373996 17185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 640) took 2029 ms (client timeout 1665 ms). Trace:
I20260709 13:07:52.374485 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.367044 16486 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:52.385075 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:52.385447 16487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2105) took 3076 ms (client timeout 1787 ms). Trace:
I20260709 13:07:52.394541 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.394697 16632 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.395066 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.395717 16485 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:52.395833 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:52.396188 16485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1404) took 2054 ms (client timeout 2174 ms). Trace:
W20260709 13:07:52.396518 16485 rpcz_store.cc:269] 0709 13:07:50.341932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.394790 (+2052858us) service_pool.cc:224] Handling call
0709 13:07:52.396134 (+  1344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.397550 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.397846 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.399010 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.401286 20499 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:52.401692 16455 connection.cc:256] RPC call timeout handler was delayed by -1.7547502959999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:07:52.402568 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.402987 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.403242 16455 connection.cc:256] RPC call timeout handler was delayed by -1.5198502959999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:07:52.403519 16455 connection.cc:256] RPC call timeout handler was delayed by -1.4919502959999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 13:07:52.404165 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2115) took 1318 ms. Trace:
I20260709 13:07:52.404539 16488 rpcz_store.cc:276] 0709 13:07:51.085796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.371503 (+1285707us) service_pool.cc:224] Handling call
0709 13:07:52.404107 (+ 32604us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.392813 17185 rpcz_store.cc:269] 0709 13:07:50.344952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.345041 (+    89us) service_pool.cc:224] Handling call
0709 13:07:52.373790 (+2028749us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400576cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.373922 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3856729472}
W20260709 13:07:52.407258 16455 connection.cc:256] RPC call timeout handler was delayed by -1.3051509900000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:07:52.407971 16455 connection.cc:256] RPC call timeout handler was delayed by -1.2777502959999083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 13:07:52.409256 16485 raft_consensus.cc:2410] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:07:52.393863 16487 rpcz_store.cc:269] 0709 13:07:49.308583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.385097 (+3076514us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:52.385272 (+   175us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:52.391016 20586 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:52.412015 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.412505 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.411988 16632 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:52.411146 16489 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:52.413992 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2117) took 1327 ms. Trace:
I20260709 13:07:52.414261 16489 rpcz_store.cc:276] 0709 13:07:51.086253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.374223 (+1287970us) service_pool.cc:224] Handling call
0709 13:07:52.413941 (+ 39718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.413828 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1395) took 2156 ms. Trace:
I20260709 13:07:52.352494 20551 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.415030 16488 rpcz_store.cc:276] 0709 13:07:50.257987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.405155 (+2147168us) service_pool.cc:224] Handling call
0709 13:07:52.413777 (+  8622us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.414381 16455 connection.cc:256] RPC call timeout handler was delayed by -1.0378509900000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260709 13:07:52.416108 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.416831 16485 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:52.417208 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:52.417368 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:52.418407 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:52.419042 16633 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.418958 16638 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:52.417274 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2127) took 1141 ms. Trace:
I20260709 13:07:52.420760 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.419636 17179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 776) took 1709 ms. Trace:
I20260709 13:07:52.411111 20586 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.420974 16485 rpcz_store.cc:276] 0709 13:07:51.275758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.411457 (+1135699us) service_pool.cc:224] Handling call
0709 13:07:52.417229 (+  5772us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.421451 17182 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:52.421801 16483 raft_consensus.cc:2368] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:07:52.420354 20419 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.423646 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:52.425292 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.425673 20419 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:52.426100 20618 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.891s	user 0.002s	sys 0.000s
I20260709 13:07:52.427461 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.427582 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.421664 17179 rpcz_store.cc:276] 0709 13:07:50.709860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.738593 (+ 28733us) service_pool.cc:224] Handling call
0709 13:07:52.419285 (+1680692us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540005dcd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.419454 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1368552704}
I20260709 13:07:52.431160 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2120) took 1230 ms. Trace:
W20260709 13:07:52.431495 16483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1414) took 1793 ms (client timeout 1854 ms). Trace:
I20260709 13:07:52.431512 16485 rpcz_store.cc:276] 0709 13:07:51.201047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.423126 (+1222079us) service_pool.cc:224] Handling call
0709 13:07:52.431109 (+  7983us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:52.432657 16483 rpcz_store.cc:269] 0709 13:07:50.638597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.376155 (+1737558us) service_pool.cc:224] Handling call
0709 13:07:52.431446 (+ 55291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.422536 20338 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.438210 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.438645 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.439381 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.439728 16487 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.440397 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2099) took 3226 ms. Trace:
I20260709 13:07:52.440544 16485 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:52.441155 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 535) took 3259 ms. Trace:
I20260709 13:07:52.441431 16485 rpcz_store.cc:276] 0709 13:07:49.181903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.440019 (+3258116us) service_pool.cc:224] Handling call
0709 13:07:52.440346 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.440940 (+   594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.441091 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.442512 16485 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.443053 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2100) took 3211 ms. Trace:
I20260709 13:07:52.443324 16485 rpcz_store.cc:276] 0709 13:07:49.231604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.442042 (+3210438us) service_pool.cc:224] Handling call
0709 13:07:52.442357 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.442864 (+   507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.442993 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.443823 20338 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.444293 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.445109 16489 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.446049 16489 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.446557 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2110) took 2889 ms. Trace:
I20260709 13:07:52.446830 16489 rpcz_store.cc:276] 0709 13:07:49.556809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.445580 (+2888771us) service_pool.cc:224] Handling call
0709 13:07:52.445890 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.446361 (+   471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.446513 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.447697 20430 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.439375 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2116) took 1353 ms. Trace:
I20260709 13:07:52.448262 20430 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:52.447081 20338 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.449286 20430 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.451855 16488 rpcz_store.cc:276] 0709 13:07:51.086022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.415669 (+1329647us) service_pool.cc:224] Handling call
0709 13:07:52.439321 (+ 23652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.453085 16488 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.453609 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1383) took 2408 ms. Trace:
I20260709 13:07:52.453895 16488 rpcz_store.cc:276] 0709 13:07:50.045117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.452620 (+2407503us) service_pool.cc:224] Handling call
0709 13:07:52.452904 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.453402 (+   498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.453564 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.454416 16633 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:52.454744 20586 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.455394 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 539) took 2142 ms. Trace:
I20260709 13:07:52.455955 20424 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:52.456593 20424 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.458681 20424 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.455775 16482 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:52.460287 20649 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:07:52.455757 16488 rpcz_store.cc:276] 0709 13:07:50.313077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.454534 (+2141457us) service_pool.cc:224] Handling call
0709 13:07:52.454841 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.455087 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.455112 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.455167 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:52.455196 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.455246 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.455351 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.460371 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2129) took 1117 ms. Trace:
I20260709 13:07:52.464329 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.464833 16488 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.460403 20427 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.473263 20477 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.473793 20477 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.430622 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:52.475889 16482 rpcz_store.cc:276] 0709 13:07:51.342526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.235035 (+892509us) service_pool.cc:224] Handling call
0709 13:07:52.460299 (+225264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.477065 16486 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.479099 16487 rpcz_store.cc:276] 0709 13:07:49.213910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.439230 (+3225320us) service_pool.cc:224] Handling call
0709 13:07:52.439576 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.440176 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.440327 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.480742 16489 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 8. Ops: []
I20260709 13:07:52.494333 20333 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.495600 16635 raft_consensus.cc:2368] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12.
I20260709 13:07:52.497428 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1381) took 2446 ms. Trace:
I20260709 13:07:52.497673 16488 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:52.498011 16489 rpcz_store.cc:276] 0709 13:07:50.044641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.447503 (+2402862us) service_pool.cc:224] Handling call
0709 13:07:52.480565 (+ 33062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.490703 (+ 10138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.490899 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.501008 16490 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:52.501379 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2126) took 1252 ms. Trace:
I20260709 13:07:52.501557 16490 rpcz_store.cc:276] 0709 13:07:51.249125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.307778 (+1058653us) service_pool.cc:224] Handling call
0709 13:07:52.501340 (+193562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.504652 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:52.516461 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 108648us
I20260709 13:07:52.516806 16486 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.518000 16486 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.518229 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:52.520021 20499 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.520815 20499 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.523116 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:52.524677 17186 raft_consensus.cc:2410] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:07:52.527983 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.532752 20609 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.535276 20586 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.535909 16482 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:52.536511 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1409) took 2089 ms. Trace:
I20260709 13:07:52.536839 16482 rpcz_store.cc:276] 0709 13:07:50.446993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.489914 (+2042921us) service_pool.cc:224] Handling call
0709 13:07:52.502592 (+ 12678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.536281 (+ 33689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.536460 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.538275 16636 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:07:52.518567 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1412) took 2036 ms. Trace:
I20260709 13:07:52.504963 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:52.544046 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 57152.2us
I20260709 13:07:52.555693 20584 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:52.555886 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.569406 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:52.569682 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.570545 16487 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.570911 20538 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.571324 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.556124 17180 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.572270 16487 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.572681 20611 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:52.573083 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.539063 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.547400 16486 rpcz_store.cc:276] 0709 13:07:50.481801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.517475 (+2035674us) service_pool.cc:224] Handling call
0709 13:07:52.517828 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.518371 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.518519 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.578943 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.579916 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.580579 16486 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:52.581236 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.582101 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.582768 16486 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:52.583387 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.548319 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.584129 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.584321 20488 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.584616 16603 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.585685 20370 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.586081 20370 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.586396 20370 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.548663 17182 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.550877 20477 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:52.586797 20564 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:52.584852 20488 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:52.554049 17181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 579) took 2045 ms (client timeout 1800 ms). Trace:
W20260709 13:07:52.588557 17181 rpcz_store.cc:269] 0709 13:07:50.508988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.509688 (+   700us) service_pool.cc:224] Handling call
0709 13:07:52.553835 (+2044147us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400610dd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.553985 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043093888}
I20260709 13:07:52.552385 16482 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 10. Ops: []
I20260709 13:07:52.589079 20488 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.544971 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 522) took 4222 ms. Trace:
I20260709 13:07:52.561087 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2109) took 2078 ms. Trace:
I20260709 13:07:52.545194 20419 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:52.561798 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82af48cecc58434e959547ec318fa4c5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:52.574605 20427 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.544711 16488 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.575001 16455 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.545428 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.606149 16634 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:52.592941 16562 rpcz_store.cc:276] 0709 13:07:50.483094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.413760 (+930666us) service_pool.cc:224] Handling call
0709 13:07:51.414072 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.615203 (+201131us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:51.941262 (+326059us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.138633 (+197371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.145513 (+  6880us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.160658 (+ 15145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.560767 (+400109us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400019854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.560808 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.560939 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19763,"prepare.queue_time_us":100460,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":19765,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":758,"spinlock_wait_cycles":462047104,"thread_start_us":450429,"threads_started":2,"wal-append.queue_time_us":168142}
I20260709 13:07:52.551998 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.606841 16487 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.576404 20611 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.584859 17185 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:52.589756 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1413) took 2088 ms. Trace:
I20260709 13:07:52.608384 16489 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:07:52.559684 16484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1397) took 2276 ms (client timeout 2370 ms). Trace:
I20260709 13:07:52.544209 17187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 781) took 1717 ms. Trace:
I20260709 13:07:52.590025 16486 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:52.595907 16490 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:52.601699 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.592670 16640 rpcz_store.cc:276] 0709 13:07:48.322603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.003634 (+681031us) service_pool.cc:224] Handling call
0709 13:07:50.337381 (+1333747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.362588 (+ 25207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.507095 (+2144507us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003f1e50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.544822 (+ 37727us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3066640768}
I20260709 13:07:52.566406 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:52.607501 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2121) took 1390 ms. Trace:
I20260709 13:07:52.608374 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:52.609619 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1411) took 2132 ms. Trace:
I20260709 13:07:52.610483 16482 rpcz_store.cc:276] 0709 13:07:50.500998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.551871 (+2050873us) service_pool.cc:224] Handling call
0709 13:07:52.552230 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.589520 (+ 37290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.589709 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.612761 17181 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.608302 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:52.610664 16484 rpcz_store.cc:269] 0709 13:07:50.282992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.154537 (+1871545us) service_pool.cc:224] Handling call
0709 13:07:52.559521 (+404984us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54000e8654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.559637 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48538368}
I20260709 13:07:52.612011 16487 rpcz_store.cc:276] 0709 13:07:51.217361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.593024 (+1375663us) service_pool.cc:224] Handling call
0709 13:07:52.604409 (+ 11385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.607279 (+  2870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.607450 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.612756 16488 rpcz_store.cc:276] 0709 13:07:50.473688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.507478 (+2033790us) service_pool.cc:224] Handling call
0709 13:07:52.544508 (+ 37030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.605396 (+ 60888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.605590 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.610796 17187 rpcz_store.cc:276] 0709 13:07:50.826891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.758074 (+931183us) service_pool.cc:224] Handling call
0709 13:07:52.502426 (+744352us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400415ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.544140 (+ 41714us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304531840}
I20260709 13:07:52.620821 17179 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.609778 16373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 45424.5us
W20260709 13:07:52.622177 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50366.4us
W20260709 13:07:52.623216 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.609988 20611 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.613648 20586 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:52.627367 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2123) took 1401 ms. Trace:
I20260709 13:07:52.630308 16486 rpcz_store.cc:276] 0709 13:07:51.225891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.611080 (+1385189us) service_pool.cc:224] Handling call
0709 13:07:52.619311 (+  8231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.627059 (+  7748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.627085 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.627128 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.627157 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.627219 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.627318 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.633563 16489 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.634950 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2103) took 3371 ms. Trace:
I20260709 13:07:52.635353 16485 rpcz_store.cc:276] 0709 13:07:49.263359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.443955 (+3180596us) service_pool.cc:224] Handling call
0709 13:07:52.444371 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.457562 (+ 13191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.457594 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.458032 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.498622 (+ 40590us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:52.498648 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.498725 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.634711 (+135986us) raft_consensus.cc:1685] finished
0709 13:07:52.634733 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.634874 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12261,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":23296,"thread_start_us":38861,"threads_started":1,"wal-append.queue_time_us":160067}
I20260709 13:07:52.646677 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:52.628564 20338 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.649786 17181 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
W20260709 13:07:52.652887 17186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 644) took 2306 ms (client timeout 2206 ms). Trace:
W20260709 13:07:52.653344 17186 rpcz_store.cc:269] 0709 13:07:50.346131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.346481 (+   350us) service_pool.cc:224] Handling call
0709 13:07:52.652612 (+2306131us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400593654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.652798 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4619825408}
I20260709 13:07:52.656406 20538 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.656849 20538 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:52.657294 20538 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.657040 20383 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:52.658048 20383 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.658416 20383 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:52.659335 20383 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.660104 20338 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.660712 20383 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.661082 20338 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.665361 20424 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:52.665908 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 99572.8us
I20260709 13:07:52.666436 20349 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.666836 20349 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.667649 20349 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.661201 17180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 775) took 1951 ms. Trace:
I20260709 13:07:52.672246 16490 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:52.672899 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2124) took 1435 ms. Trace:
I20260709 13:07:52.673180 16490 rpcz_store.cc:276] 0709 13:07:51.237267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.615357 (+1378090us) service_pool.cc:224] Handling call
0709 13:07:52.632164 (+ 16807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.672685 (+ 40521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.672851 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.620458 20419 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.672302 17180 rpcz_store.cc:276] 0709 13:07:50.709595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.746663 (+ 37068us) service_pool.cc:224] Handling call
0709 13:07:52.555840 (+1809177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.572246 (+ 16406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.661039 (+ 88793us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400610dd0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.661153 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4131062528}
I20260709 13:07:52.646816 17179 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:52.681872 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.682586 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 58573.5us
W20260709 13:07:52.683326 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51397.6us
I20260709 13:07:52.684763 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.691035 20185 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:52.693387 16636 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1427) took 2321 ms (client timeout 2134 ms). Trace:
W20260709 13:07:52.693749 16636 rpcz_store.cc:269] 0709 13:07:50.371587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.670805 (+299218us) service_pool.cc:224] Handling call
0709 13:07:52.693209 (+2022404us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54000b1654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:52.693322 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4151048064}
I20260709 13:07:52.694851 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:52.695961 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.696415 17188 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:52.697424 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.698200 16486 raft_consensus.cc:2410] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:07:52.706718 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.707823 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.708328 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.708561 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 785) took 1506 ms. Trace:
I20260709 13:07:52.708906 17183 rpcz_store.cc:276] 0709 13:07:51.202577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.862639 (+660062us) service_pool.cc:224] Handling call
0709 13:07:51.862926 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.164969 (+302043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.708295 (+543326us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400592c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:52.708488 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673540864}
I20260709 13:07:52.709476 16490 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:52.689007 17186 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 7.
W20260709 13:07:52.710204 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.711218 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.705868 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.713745 17181 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:52.714215 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:52.715055 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.679177 20424 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:07:52.740175 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.743314 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.385810 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.748668 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:52.749277 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:52.744720 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:52.748369 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.751219 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.751894 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:52.752655 16558 raft_consensus.cc:2410] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:07:52.750979 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:52.754500 16491 raft_consensus.cc:2376] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10. Re-sending same reply.
I20260709 13:07:52.755430 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.736526 20423 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.698060 20586 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.758083 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:52.762800 20237 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.763304 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:52.723819 20538 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.764065 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:52.762921 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:52.758509 16562 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.758828 16561 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.768137 17180 raft_consensus.cc:2410] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:07:52.766944 16604 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 5.067s (SENT) [suppressed 61 similar messages]
I20260709 13:07:52.772279 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:52.769547 17186 raft_consensus.cc:2376] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9. Re-sending same reply.
I20260709 13:07:52.771741 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:52.771410 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:52.785085 16557 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.785774 16566 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.785913 17183 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:52.786244 17183 pending_rounds.cc:85] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 7
I20260709 13:07:52.786875 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:52.779188 16565 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:52.767783 20423 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:52.790756 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.792315 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 61606.5us
I20260709 13:07:52.787946 16560 raft_consensus.cc:2376] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12. Re-sending same reply.
I20260709 13:07:52.795229 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:52.786448 17183 pending_rounds.cc:107] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:52.796007 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:52.796226 17183 raft_consensus.cc:2889] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.800153 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:52.801945 16562 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:52.802790 20415 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:52.803292 20415 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.804239 20415 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.808168 16557 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:52.812887 20423 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.815094 20551 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:52.817865 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.820019 20538 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.784755 20469 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:52.824117 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2098) took 3623 ms. Trace:
I20260709 13:07:52.824517 16483 rpcz_store.cc:276] 0709 13:07:49.200386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.477542 (+3277156us) service_pool.cc:224] Handling call
0709 13:07:52.535879 (+ 58337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.536337 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.536366 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.536840 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.676158 (+139318us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:52.676194 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.676265 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.823863 (+147598us) raft_consensus.cc:1685] finished
0709 13:07:52.823885 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.824033 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2928,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5882,"thread_start_us":138874,"threads_started":1,"wal-append.queue_time_us":245330}
I20260709 13:07:52.768352 20611 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.829546 20611 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.830571 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.831547 20333 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:52.832998 20586 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.835191 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:52.835870 16489 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.841377 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:52.842739 20424 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:52.843271 20424 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.800949 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:52.845918 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 58113.8us
I20260709 13:07:52.800825 16564 raft_consensus.cc:2376] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11. Re-sending same reply.
I20260709 13:07:52.849321 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.839493 16566 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:52.852348 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.856251 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:52.856972 17179 raft_consensus.cc:2368] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12.
I20260709 13:07:52.854172 16563 raft_consensus.cc:2376] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12. Re-sending same reply.
I20260709 13:07:52.862214 16636 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
W20260709 13:07:52.864353 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.867728 16489 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:52.811472 20370 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.871759 16559 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:52.872763 16455 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:52.855365 20538 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.879004 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:52.881678 20601 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:52.882611 20601 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.882922 20601 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:52.883809 20601 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.885013 20601 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.888533 16563 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:52.855156 20490 consensus_queue.cc:1175] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "035eaa2f12374a81a4df7868a5453d3c" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:07:52.876434 20349 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.866611 20586 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.901099 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:52.877192 20333 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:52.902310 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:52.875782 20424 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:52.904834 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 43893.2us
W20260709 13:07:52.882078 20661 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:07:52.919914 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.921525 16561 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:07:52.902541 20538 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:52.924016 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.926930 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 140227us
I20260709 13:07:52.925637 20551 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.929368 20551 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:52.929734 20500 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:52.930629 20537 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:52.930985 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:52.931268 20174 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.931324 20551 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:52.922107 20469 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.942438 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:52.930953 20537 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.945108 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:52.947216 16455 leader_election.cc:400] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11.
I20260709 13:07:52.948552 16455 leader_election.cc:403] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.948738 16454 leader_election.cc:400] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12.
I20260709 13:07:52.949028 16454 leader_election.cc:403] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.902323 20333 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:52.949681 16485 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:52.931927 20174 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:52.952816 20591 consensus_queue.cc:1059] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:52.953878 20488 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.964927 20549 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.954464 16636 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:52.956079 20472 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:52.955631 20422 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.964150 16530 leader_election.cc:400] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:07:52.957041 16604 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:52.950953 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:52.947033 20185 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.968755 16530 leader_election.cc:403] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.967939 20591 consensus_queue.cc:1243] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:52.938166 20490 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:52.965131 20338 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.977584 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:52.971889 20472 consensus_queue.cc:1243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:52.970264 20185 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.980264 20419 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.995404 16455 leader_election.cc:400] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:52.996132 16455 leader_election.cc:403] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.968640 20500 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:52.989073 20185 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.989764 20422 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:53.041951 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64456.2us
I20260709 13:07:52.987583 20586 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
W20260709 13:07:53.014783 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.981349 20477 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:07:52.975178 20488 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:53.044207 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 49740.4us
I20260709 13:07:52.990836 20490 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.049028 16529 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:07:53.049994 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54740us
I20260709 13:07:52.995457 20613 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:53.052551 16636 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:53.052495 20568 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:53.052976 20591 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10.
I20260709 13:07:53.053326 20517 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.053597 20663 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:53.053839 20488 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:53.057415 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 59538.1us
I20260709 13:07:53.059603 20419 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:53.061743 20419 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:53.062116 20419 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.062323 16530 leader_election.cc:400] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:07:53.062638 16530 leader_election.cc:403] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.985221 20538 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.063135 20237 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:07:53.078508 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.079890 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.080687 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:53.081301 17183 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.067520 20370 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:53.070971 20591 raft_consensus.cc:3055] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:53.073559 20586 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.045886 20174 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.093093 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:53.087668 20662 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.108s	user 0.003s	sys 0.000s
I20260709 13:07:53.060578 20490 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.088487 20591 raft_consensus.cc:740] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:53.101758 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.094960 17179 pending_rounds.cc:85] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 9
I20260709 13:07:53.103257 17179 pending_rounds.cc:107] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:53.103502 17179 raft_consensus.cc:2889] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.069386 20517 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.098636 20333 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:53.114650 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:53.113077 20517 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:53.125341 20490 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:53.114698 16488 raft_consensus.cc:2410] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:53.137460 17181 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:53.137943 20549 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11.
I20260709 13:07:53.121598 20537 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.140959 20537 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:53.116650 17152 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.859s (SENT)
W20260709 13:07:53.111095 16605 leader_election.cc:336] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.954s (SENT)
I20260709 13:07:53.143966 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.105085 20591 consensus_queue.cc:260] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.144739 20477 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.139333 17183 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:53.106834 20446 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:53.116660 20665 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:07:53.143770 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:53.143100 20664 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:07:53.146600 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.128998 20668 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:07:53.155324 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 88208.9us
I20260709 13:07:53.144819 20591 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.161737 16603 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:53.131142 16389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 240) took 12277 ms (client timeout 15000 ms). Trace:
I20260709 13:07:53.145857 20469 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:53.169585 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 106046us
I20260709 13:07:53.174784 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:53.146193 20446 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:53.184346 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.210978 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.215977 20585 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:53.170449 20333 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.219506 20446 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.220769 20446 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:53.224289 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47659.7us
I20260709 13:07:53.225229 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.226989 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.227706 20601 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.228338 20601 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:53.229571 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.174937 20370 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:53.230403 20370 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:53.231276 20370 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.229517 17183 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:53.219971 20338 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12.
I20260709 13:07:53.133486 20419 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.229925 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.168972 20469 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:53.240302 20664 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:53.249426 20333 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:53.261541 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 199348us
I20260709 13:07:53.262627 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.250380 20586 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
W20260709 13:07:53.269750 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 180400us
I20260709 13:07:53.251905 20613 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:53.280445 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.285029 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.312067 16529 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:53.313798 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 83938.7us
W20260709 13:07:53.165943 16389 rpcz_store.cc:269] 0709 13:07:40.853699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.854570 (+   871us) service_pool.cc:224] Handling call
0709 13:07:53.130941 (+12276371us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:44.553027 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:44.557620 (+  4593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:44.557664 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:44.557682 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:44.623273 (+ 65591us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:44.623344 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:44.623378 (+    34us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:07:44.625460 (+  2082us) tablet.cc:701] Row locks acquired
0709 13:07:44.625510 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:07:44.625675 (+   165us) write_op.cc:270] Start()
0709 13:07:44.625812 (+   137us) write_op.cc:276] Timestamp: P: 1783602464625618 usec, L: 0
0709 13:07:44.625829 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:07:44.670784 (+ 44955us) log.cc:844] Serialized 10404 byte log entry
0709 13:07:45.782349 (+1111565us) op_driver.cc:464] REPLICATION: finished
0709 13:07:46.717955 (+935606us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f06333810ac 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f0639ec1ef0
0709 13:07:47.003766 (+285811us) write_op.cc:301] APPLY: starting
0709 13:07:47.003863 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:47.004319 (+   456us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:47.004343 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:47.389058 (+384715us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:47.431288 (+ 42230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 13:07:47.431339 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:47.431782 (+   443us) log.cc:844] Serialized 182 byte log entry
0709 13:07:47.536633 (+104851us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:47.548980 (+ 12347us) write_op.cc:454] Released schema lock
0709 13:07:47.553417 (+  4437us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:47.602908 (+ 49491us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:47.617651 (+ 14743us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":131396,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":1221158,"apply.run_cpu_time_us":17292,"apply.run_wall_time_us":585403,"num_ops":27,"prepare.queue_time_us":123118,"prepare.run_cpu_time_us":12323,"prepare.run_wall_time_us":228666,"raft.queue_time_us":736825,"raft.run_cpu_time_us":28577,"raft.run_wall_time_us":1491762,"replication_time_us":1156331,"spinlock_wait_cycles":135535360,"thread_start_us":2422852,"threads_started":5,"wal-append.queue_time_us":272313,"wal-append.run_cpu_time_us":97568,"wal-append.run_wall_time_us":2902123}]]}
W20260709 13:07:53.322724 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.326107 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.273026 20469 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:53.335232 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.338594 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.317746 20586 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:07:53.344249 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 281830us
I20260709 13:07:53.348018 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2128) took 2005 ms. Trace:
I20260709 13:07:53.346838 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.347223 16529 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.348415 16482 rpcz_store.cc:276] 0709 13:07:51.335298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.615395 (+1280097us) service_pool.cc:224] Handling call
0709 13:07:52.631362 (+ 15967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.639332 (+  7970us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:52.639595 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.858963 (+219368us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.907414 (+ 48451us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.907824 (+   410us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.908206 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.915463 (+  7257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.916084 (+   621us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.142486 (+226402us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:53.340712 (+198226us) raft_consensus.cc:1685] finished
0709 13:07:53.340736 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.340853 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8583,"prepare.queue_time_us":21504,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":24086,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":16162,"spinlock_wait_cycles":4162816,"thread_start_us":218968,"threads_started":1,"wal-append.queue_time_us":340149}
W20260709 13:07:53.345561 20667 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.362s	user 0.002s	sys 0.002s
W20260709 13:07:53.357405 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 94874.2us
I20260709 13:07:53.360291 16455 leader_election.cc:400] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12.
I20260709 13:07:53.359248 20537 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.337769 20472 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:07:53.365777 20472 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:53.366153 20472 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:53.367012 20472 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.369134 20472 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.372892 20586 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.351670 20423 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.350713 20679 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:53.359262 16388 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 7 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 9 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.383908 20419 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:53.387372 20419 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.386941 16388 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:53.388087 20419 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:53.381731 20613 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.397974 16604 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.394104 20679 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:53.408159 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.408741 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.409404 16488 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:53.395164 20537 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:53.406126 16388 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 7 to 11, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:53.414992 16488 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:07:53.416005 16388 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.414841 20537 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.428357 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.429018 16482 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:53.405217 20679 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.434163 16388 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 6 to 8, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 8 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:53.437153 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.437813 16488 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:07:53.438016 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.438642 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:53.439159 16489 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.439188 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:53.440093 16488 raft_consensus.cc:2410] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:53.440454 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:53.440907 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.417647 20472 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.441471 16491 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:53.401470 20185 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.445384 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:53.446398 16489 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:53.453933 17186 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:53.455441 20333 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:53.435894 20691 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:53.457036 20691 consensus_queue.cc:1243] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:53.457492 20691 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:53.457806 20691 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:53.458671 20691 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.459268 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.460075 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.460345 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.460493 20685 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.460948 20685 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:53.461304 20685 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.459702 20472 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:53.462517 20472 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.463343 20675 raft_consensus.cc:2764] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:07:53.464547 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.461474 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:53.459394 20680 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:53.471388 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.471437 16388 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:53.470841 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 131651us
I20260709 13:07:53.477255 20691 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.481992 20469 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:53.469774 20676 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:07:53.464133 20488 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:53.490437 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.472273 20586 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:53.496302 20422 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.497875 16529 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.502738 16564 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:53.503813 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.504124 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.505124 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.505404 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.508957 16559 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:53.509717 20685 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.515058 16482 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:53.518157 20185 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:53.520730 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:53.521278 16632 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.521577 20333 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:53.521965 20333 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:53.522780 20333 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.525401 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.526773 16604 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.527556 16632 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:53.528340 20383 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.528735 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:53.529161 16565 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:53.529515 20488 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:53.529909 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.530298 20488 consensus_queue.cc:1243] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:53.530611 20477 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.531131 20477 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:53.532511 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.533408 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:53.534032 16564 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.534353 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.531970 20477 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.537914 16483 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:53.544516 16484 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:53.545240 16489 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:53.546393 16561 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:53.547569 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.493829 20694 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.558090 20422 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:53.528784 20383 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.568316 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.537705 20685 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:53.574277 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:53.577818 16388 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 10, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.531596 20488 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:07:53.586627 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.579128 20675 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.602659 20675 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:53.551826 20568 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:53.603976 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:53.606117 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.561348 20694 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:53.580246 20383 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.617267 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:53.619356 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.589598 20691 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:53.620831 16388 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 3 to 8, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:53.603201 20422 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:53.906836 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.855072 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.840189 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.629374 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:53.920609 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.706862 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 78879.6us
W20260709 13:07:53.699453 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 165150us
I20260709 13:07:53.669516 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:53.922122 16604 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:53.794991 16635 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:53.655390 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:53.768534 16634 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
W20260709 13:07:53.921355 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.699595 16632 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:53.702872 16565 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:07:53.800073 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.826057 16564 raft_consensus.cc:2410] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:53.924008 16561 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:53.795439 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:53.667341 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.927551 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.625233 16483 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:53.936458 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:53.725630 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:53.938948 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.939476 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.939111 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.939109 16484 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
W20260709 13:07:53.940740 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 155704us
I20260709 13:07:53.942585 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.941598 16637 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:53.943866 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:53.727093 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:53.943233 16560 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
W20260709 13:07:53.770802 20693 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:07:53.952697 16562 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.615283 20568 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:53.630226 20700 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.338s
I20260709 13:07:53.698567 20370 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.706581 20333 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.954841 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:53.628703 20694 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.668493 20338 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.765173 20675 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:53.937417 20691 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.955933 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.958055 20185 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.966473 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:53.980176 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.794060 20679 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:53.982893 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:53.987102 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:53.990393 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.002307 16631 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:54.002411 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.003594 16631 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:07:54.004402 20698 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:07:54.005055 16631 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:53.983413 16640 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:54.016240 16560 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.994087 16635 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:54.003261 20185 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:53.991074 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.000610 16565 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:07:54.019721 16562 raft_consensus.cc:2410] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:07:54.027335 16564 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:54.029070 16634 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
W20260709 13:07:54.032246 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 69535.2us
I20260709 13:07:54.032116 20591 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:54.035426 20591 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.036137 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.037192 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.042923 16636 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:07:54.044881 20185 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:54.046141 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.046875 16558 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:54.047622 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.048010 20446 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.048514 20446 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:54.049562 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.049620 16558 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.050381 20446 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:54.050843 16558 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:54.051605 20549 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:54.052489 20707 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:54.053417 16639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.054s	sys 0.127s
W20260709 13:07:54.053956 16639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.054s	sys 0.127s
I20260709 13:07:54.054486 16561 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.051443 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.057402 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.058511 16559 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:53.693042 20701 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.314s
I20260709 13:07:54.061961 16565 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:54.066320 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.066531 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:54.066905 20707 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:54.037451 20591 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:54.070832 16455 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:53.986606 20338 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.161101 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.129266 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.165934 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:54.161531 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 120968us
I20260709 13:07:54.131381 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.170903 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:54.138751 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.159888 16562 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:54.124012 16604 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:54.172144 16488 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.172207 16482 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:54.171093 16484 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:54.076817 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.028342 20472 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.177809 16559 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:53.987668 20691 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.057032 20568 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.200894 16488 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:54.207082 16566 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:54.207396 16483 raft_consensus.cc:2410] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:07:54.126597 20427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.011s	sys 0.032s
I20260709 13:07:54.123665 20710 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:54.192472 20708 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:07:54.077256 20707 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.278891 16559 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:54.282609 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 202509us
I20260709 13:07:54.181399 20591 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.128803 20477 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.074739 20446 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.123857 20601 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:07:54.302241 20710 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:54.074221 20701 consensus_queue.cc:1243] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:54.290879 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 110728us
I20260709 13:07:54.178925 20472 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:54.307659 20472 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.308772 20472 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.294281 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.081073 20613 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.202s
W20260709 13:07:54.296708 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 244805us
I20260709 13:07:54.317502 20707 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:54.317778 16456 leader_election.cc:336] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.556s (SENT)
I20260709 13:07:54.298306 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:54.286621 20427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.018s	sys 0.039s
I20260709 13:07:54.272799 20715 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.304967 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:54.306182 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:54.312286 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.292224 20713 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:54.322546 16483 raft_consensus.cc:2368] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:54.327919 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.325333 16566 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
W20260709 13:07:54.321995 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.328956 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 258187us
W20260709 13:07:54.329483 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.329613 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.328042 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.332157 16559 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.338155 16484 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:54.339054 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.337625 17152 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:54.350106 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.354326 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.321218 20679 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:54.363512 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.366223 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:54.369244 16482 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:54.331332 20613 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:54.338641 20477 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.336048 20591 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.372135 16566 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:54.376363 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.379225 20674 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:54.370559 20237 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:54.380002 20537 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.380417 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.383484 16558 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.384408 16564 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:54.384908 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.404011 16561 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.404093 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.385481 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.387470 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.404861 16482 raft_consensus.cc:2410] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:07:54.389420 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.395018 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 215024us
W20260709 13:07:54.405748 16530 connection.cc:256] RPC call timeout handler was delayed by -1.5702011060000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:07:54.406076 16530 connection.cc:256] RPC call timeout handler was delayed by -1.5125018310000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.394s for a response
W20260709 13:07:54.406342 16530 connection.cc:256] RPC call timeout handler was delayed by -1.2588011059999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260709 13:07:54.373340 20185 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.416986 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.418253 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.327756 20713 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.402812 20537 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.435079 16561 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:07:54.436034 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:54.440227 16635 raft_consensus.cc:2368] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:54.436420 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.439121 16560 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:54.439890 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.441864 16633 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:54.442951 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:54.432315 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:54.445343 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 65009.9us
I20260709 13:07:54.395124 20677 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:54.394666 20613 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.459601 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.459738 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.323453 20710 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.452406 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.460441 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.442708 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.460484 16566 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:54.461639 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.452979 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.462288 16482 raft_consensus.cc:2376] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12. Re-sending same reply.
I20260709 13:07:54.413123 20185 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.460413 16637 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:54.454710 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:54.455541 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.455648 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:54.419153 20551 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.451700 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.400810 20349 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:54.468519 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:54.401589 20424 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:07:54.461696 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.470037 16560 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:54.453691 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:54.464893 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:54.465437 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.471503 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.469548 16561 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:54.467147 16638 raft_consensus.cc:2368] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:54.472046 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.473719 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.445169 20537 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.473951 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:54.477981 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.475968 16640 raft_consensus.cc:2393] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:54.474364 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.477101 16633 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:54.478578 16484 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:54.479097 16632 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:54.479981 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.480726 16566 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:54.481317 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.483374 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:54.489575 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.490890 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.492064 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.492372 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.493078 16638 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:54.494205 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:54.495515 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76638.6us
I20260709 13:07:54.496871 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.497606 20469 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.497978 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.498263 20469 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.502002 20611 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.502432 20611 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:54.503192 20611 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:54.503883 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.504436 20611 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.506019 20713 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:54.507135 20551 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.507577 20551 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:54.507984 20551 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.514667 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.515190 16557 raft_consensus.cc:2376] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12. Re-sending same reply.
I20260709 13:07:54.515880 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:54.465481 20679 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.517086 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.516901 20679 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.517588 16564 raft_consensus.cc:2376] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12. Re-sending same reply.
I20260709 13:07:54.518422 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.518919 16564 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:54.468470 20185 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:54.504549 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47766.1us
I20260709 13:07:54.519646 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.521082 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:54.521190 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:54.521366 16564 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:54.520572 16566 raft_consensus.cc:2410] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:07:54.522950 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.523605 16484 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:54.523747 16559 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:54.524971 16488 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:07:54.525326 16488 pending_rounds.cc:85] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 8
I20260709 13:07:54.525542 16488 pending_rounds.cc:107] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:07:54.525800 16488 raft_consensus.cc:2889] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.530992 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:54.532231 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 48946.5us
I20260709 13:07:54.532917 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:54.533713 16564 raft_consensus.cc:1240] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:54.539268 16482 raft_consensus.cc:1217] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[10.7-13.9]   Dedup: 10.7->[11.8-13.9]
I20260709 13:07:54.539727 16482 pending_rounds.cc:85] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 7
I20260709 13:07:54.539974 16482 pending_rounds.cc:107] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:07:54.540201 16482 raft_consensus.cc:2889] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.541942 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:54.543035 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.543212 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.543591 16557 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:07:54.518994 20679 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:54.507079 20675 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.546777 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.547255 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:54.546496 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 48578.1us
I20260709 13:07:54.549377 16485 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.529740 20517 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.551745 16566 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:54.556291 16634 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:54.574190 16639 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:54.557638 20333 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.000s
I20260709 13:07:54.559954 20722 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:54.560678 20601 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:54.561271 20709 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.545324 20713 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.570389 16631 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:07:54.562458 20613 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:54.526538 20677 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.547144 20477 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:54.564262 20370 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:54.564743 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:54.564924 20705 consensus_queue.cc:1059] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:54.565564 20700 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:54.567137 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.570248 16559 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:54.570673 20422 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:54.571029 20675 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.563983 20701 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:07:54.581526 16635 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:54.576949 20185 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:54.592600 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.596997 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.602926 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 143383us
I20260709 13:07:54.603670 17153 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.604200 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:54.577239 20677 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.575204 20691 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.607452 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:07:54.592938 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 100658us
I20260709 13:07:54.595078 16634 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:54.601643 20713 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.615870 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:54.620568 16563 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:54.614365 20383 consensus_meta.cc:287] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.000s
I20260709 13:07:54.618940 20237 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.615242 20731 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:07:54.608856 20701 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:54.611975 20427 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.606525 20488 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:07:54.631073 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:54.626289 20237 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:54.639575 20568 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.616636 20713 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:54.640630 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.640654 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.619400 20477 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:54.625510 20710 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.718293 20349 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.750893 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 147286us
I20260709 13:07:54.732357 20237 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.753784 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 122777us
I20260709 13:07:54.631240 20613 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.119s
W20260709 13:07:54.748833 20694 consensus_meta.cc:287] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.760s	user 0.003s	sys 0.007s
I20260709 13:07:54.631418 20383 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.787323 16562 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:54.755357 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:54.787648 16561 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:07:54.796396 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.745980 20705 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:54.788594 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 148043us
W20260709 13:07:54.762967 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.747584 20738 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.799543 16561 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:54.643875 20732 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.149s
W20260709 13:07:54.800063 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44248.6us
I20260709 13:07:54.803504 16631 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:54.799141 20694 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.812583 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:54.641651 20701 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.757102 20537 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.814868 20701 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:54.737296 20423 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:07:54.797480 20549 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:54.753561 20349 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.816335 20677 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:54.817277 16563 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.818084 20349 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:54.818598 20537 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:54.818504 16565 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.820125 16565 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:54.747584 20739 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.806172 20383 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:54.828485 20701 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.837607 16560 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:07:54.837746 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 197132us
I20260709 13:07:54.838634 20517 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:54.839156 20349 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:54.829651 16565 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.819391 20720 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.846851 20720 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:54.847255 20720 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.749933 20488 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.809381 16561 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:54.842002 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:54.809882 20731 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:54.810496 20185 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:54.810734 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:54.854621 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:54.753023 20733 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.816408 20549 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:54.826855 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.827387 20739 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:54.845108 20691 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:54.807912 20713 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.836540 20679 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:54.799396 20705 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:54.867395 20694 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:54.867096 20705 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.862681 20713 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:54.850827 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51762.3us
I20260709 13:07:54.851536 17186 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.849957 16456 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.860930 16565 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.862946 16486 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:54.863286 17179 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:54.865291 17184 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:54.860759 20732 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.886051 20185 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:54.886559 20185 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.887347 20237 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.888561 20185 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:54.888723 17153 leader_election.cc:336] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.570s (SENT)
I20260709 13:07:54.756626 20477 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.750080 20710 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:54.852646 20517 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.868197 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:54.852177 20488 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:54.868839 20691 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.861816 20747 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.892931 16562 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:54.893452 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 43580.5us
I20260709 13:07:54.940007 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.895018 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.895533 17185 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:54.896346 20427 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:54.901582 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:54.982750 17179 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.855209 20731 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.883327 20549 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:54.988013 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.894045 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:54.892647 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:54.754767 20551 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:54.912297 16563 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:54.863324 20739 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.865906 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:54.914491 17180 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:54.931308 17187 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:54.977372 16640 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:54.913381 20349 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.902872 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:54.989133 16564 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:54.908660 16565 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:55.001891 16565 pending_rounds.cc:85] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:07:55.002135 16565 pending_rounds.cc:107] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:55.002360 16565 raft_consensus.cc:2889] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.930783 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:54.988649 16561 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:07:54.904485 20738 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.913774 20710 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.005685 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:55.006953 16558 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.007226 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:54.987674 17181 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.007895 17186 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.990134 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:54.999207 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 59260.3us
I20260709 13:07:54.922520 20517 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.009666 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:54.984031 20237 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:55.008813 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:55.009505 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:54.923594 20488 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.010843 17183 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:55.013401 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:55.014772 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:55.015390 17180 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 7.
I20260709 13:07:54.939119 20747 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:55.018765 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 152915us
I20260709 13:07:54.999887 20349 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:55.024101 20722 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.028616 20422 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.028851 20746 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:55.029791 20677 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:55.021317 20611 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.028569 20537 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:55.002856 20749 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:55.011148 20733 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.011588 20517 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.011711 20700 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.061710 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:55.009089 20383 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:55.049682 16558 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:55.050637 16563 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:55.051900 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:55.054311 16483 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:55.027976 20613 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:55.024881 20747 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.048967 20349 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.048300 17179 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:55.068904 17184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:07:55.072389 16489 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:55.012056 20738 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.010943 20735 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:07:55.051349 20611 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:55.079195 16558 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:55.049597 20422 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.085893 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:55.118709 16483 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.105399 17184 raft_consensus.cc:606] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:55.112547 16563 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:07:55.116453 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 94465.1us
I20260709 13:07:55.119623 17184 raft_consensus.cc:614] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:55.119401 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:55.055661 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:55.079569 20679 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.124691 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:55.105369 20427 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:55.126694 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.106240 20691 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:07:55.130147 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 70945.1us
I20260709 13:07:55.118093 20611 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.060178 20751 consensus_queue.cc:1059] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:07:55.113502 20370 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:55.124562 20746 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.129720 20735 raft_consensus.cc:2764] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:55.141265 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:55.120851 20722 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:55.142743 20749 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:55.151412 16483 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:07:55.140594 20679 raft_consensus.cc:3055] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:55.132652 20691 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.138607 20427 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:07:55.195757 20760 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:55.178494 20755 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:07:55.152737 20741 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 13:07:55.187107 20738 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.187428 20732 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.191596 20691 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:55.193596 20749 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.142234 20746 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.159502 20679 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:55.227479 17186 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:55.206115 20422 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.196259 20517 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.233903 20679 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.241163 20679 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.241652 20517 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:55.234616 20746 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:55.245846 20488 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.251009 20739 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.207828 20732 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.253544 20732 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:55.261910 20734 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.627s	user 0.005s	sys 0.007s
I20260709 13:07:55.270090 20720 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.271131 20733 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.274830 20747 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.281548 20611 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.251534 20710 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.257337 20488 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.282805 17188 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:55.283818 20611 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.283918 20747 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.278959 20739 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.286250 20710 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.287453 20349 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.290589 20349 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:55.299448 20720 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.556733 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2446) took 1129 ms. Trace:
I20260709 13:07:55.557798 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2453) took 1129 ms. Trace:
I20260709 13:07:55.560009 16562 rpcz_store.cc:276] 0709 13:07:54.428568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.798884 (+370316us) service_pool.cc:224] Handling call
0709 13:07:54.822136 (+ 23252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.939307 (+117171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.557583 (+618276us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b540040f954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:55.557745 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162160384}
I20260709 13:07:55.559156 16566 rpcz_store.cc:276] 0709 13:07:54.427002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.572625 (+145623us) service_pool.cc:224] Handling call
0709 13:07:54.572892 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.605836 (+ 32944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.605865 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.605904 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.605937 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.556478 (+950541us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b540007e4d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:55.556525 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.556672 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75333888}
I20260709 13:07:55.487396 20747 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.561959 20333 raft_consensus.cc:3055] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:55.561582 20747 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.564589 20747 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.562405 20333 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:55.567886 20333 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.571467 20333 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:55.587502 20736 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.781s	user 0.003s	sys 0.007s
I20260709 13:07:55.590023 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2164) took 1060 ms. Trace:
I20260709 13:07:55.590384 16488 rpcz_store.cc:276] 0709 13:07:54.538279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.538425 (+   146us) service_pool.cc:224] Handling call
0709 13:07:54.565498 (+ 27073us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:54.565881 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.565910 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:54.566549 (+   639us) log.cc:844] Serialized 78 byte log entry
0709 13:07:54.618360 (+ 51811us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:54.731553 (+113193us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.737523 (+  5970us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.737789 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.805995 (+ 68206us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b18003c54a0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:54.851933 (+ 45938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.855556 (+  3623us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.554394 (+698838us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b18003c54a0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:55.586896 (+ 32502us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:55.589753 (+  2857us) raft_consensus.cc:1685] finished
0709 13:07:55.589776 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.589941 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":323920,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":20955,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":3519,"spinlock_wait_cycles":34481920,"thread_start_us":207474,"threads_started":3,"wal-append.queue_time_us":180511}
W20260709 13:07:55.600503 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 472266us
W20260709 13:07:55.602701 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.604837 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.607216 20710 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.607758 20710 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.609813 20710 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.612016 20710 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:55.612499 20710 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.614514 20710 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.616358 20768 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.616803 20768 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.618409 20768 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.621563 16603 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:55.622289 20768 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.622900 20768 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:55.623829 20768 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.633081 20338 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:55.637881 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.639199 20733 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.639665 20733 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.641556 20733 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.642946 16486 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:55.644433 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:55.654440 20551 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.654490 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.657439 16565 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:55.658573 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:55.659080 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 499608us
I20260709 13:07:55.659192 16565 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.659658 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:55.660212 16562 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.660282 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:55.661162 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:55.665874 17187 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:55.666643 20735 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.667066 20735 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:55.667439 20735 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.667953 20679 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.668337 20679 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:55.668694 20679 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.670255 16565 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:55.684574 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.685245 16565 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:55.686005 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.686507 16565 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:07:55.687199 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.677932 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:55.688743 20722 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.689093 20722 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.689507 20722 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.689033 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:55.690311 17187 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:55.679304 20733 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:55.688074 16565 raft_consensus.cc:2410] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:55.691519 20679 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.692461 17186 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:55.693511 20422 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.693992 20422 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:55.670081 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:55.694810 20422 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.696928 16530 leader_election.cc:400] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:55.696699 20370 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:55.695169 20733 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:55.697485 20370 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:55.697959 20370 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:55.698374 20568 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:55.698796 20370 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:55.699600 16564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.016s	sys 0.009s
I20260709 13:07:55.697522 20754 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:55.671732 20740 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.867s	user 0.022s	sys 0.014s
I20260709 13:07:55.697494 20733 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:55.702553 20733 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:55.699949 16564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.018s	sys 0.009s
I20260709 13:07:55.700255 20754 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:55.715093 20754 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.716236 20754 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.699935 20370 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.683316 16562 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:07:55.728230 16530 leader_election.cc:403] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.730029 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:55.731457 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:55.737032 16562 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:55.726459 20731 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.733932 20701 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.753893 20701 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.757272 20701 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:55.758394 16490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.033s	sys 0.020s
W20260709 13:07:55.758742 16490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.033s	sys 0.020s
I20260709 13:07:55.683467 20735 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.763550 20691 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:07:55.756836 20679 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.772921 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:55.775511 20679 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.767778 20701 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.775266 20709 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.785347 20701 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.785883 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:55.787104 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.787271 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:55.790092 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:55.803228 16562 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:55.794188 20730 log.cc:927] Time spent T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 1.170s	user 0.004s	sys 0.019s
W20260709 13:07:55.810985 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 79589.3us
I20260709 13:07:55.800726 20735 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:55.802760 16636 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:07:55.810165 16562 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:07:55.812506 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:55.815879 20784 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.816416 20784 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.819447 20701 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:55.820013 20701 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:55.820863 20701 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.822288 20722 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.823348 16635 raft_consensus.cc:2393] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:55.783192 20568 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:55.814072 20782 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:55.843717 17152 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:55.823475 20700 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:07:55.847198 20731 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.847577 20731 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.847896 20731 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.848322 20568 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:55.849363 20568 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.860387 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:07:55.812646 20709 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:55.879657 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:55.882261 20733 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:55.882875 20733 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:55.885247 20722 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.885754 20733 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:55.888402 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:55.889089 20709 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:55.871441 20735 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.893074 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:55.892189 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.896324 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:55.899670 20735 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.900844 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:55.902796 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.903358 16566 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:55.904458 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.900758 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 2147) took 1514 ms. Trace:
I20260709 13:07:55.903031 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.904975 16560 rpcz_store.cc:276] 0709 13:07:54.386540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.490643 (+104103us) service_pool.cc:224] Handling call
0709 13:07:55.900571 (+1409928us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400210cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:55.900700 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795556608}
I20260709 13:07:55.905172 16562 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:55.905503 16565 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:55.905802 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:55.907437 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.907614 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:55.908175 16565 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.908005 16564 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:07:55.913930 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.914499 16562 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:55.917476 16565 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:07:55.944018 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:55.974917 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.975658 16566 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:07:55.983745 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:55.985394 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:55.985939 16564 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.915970 20735 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:56.005048 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 61133.7us
I20260709 13:07:56.049127 20722 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.049647 20722 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.049579 16564 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:56.052407 20700 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.977324 20701 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.056080 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:56.054543 20709 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.058650 20709 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.060887 20709 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.062379 20701 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.064508 20701 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.041808 20735 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:56.065486 20735 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.068568 20551 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.069044 20551 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:56.069427 20551 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.044909 20733 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.070092 20733 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.072144 20733 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:56.073150 20779 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260709 13:07:56.073946 20731 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.075510 20731 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.076179 20722 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.056885 20768 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:56.076745 20722 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.076838 20768 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.078758 20768 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:56.079342 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.083576 20735 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.085680 20735 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.095434 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 561) took 1048 ms. Trace:
I20260709 13:07:56.096525 16486 rpcz_store.cc:276] 0709 13:07:55.046843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.047130 (+   287us) service_pool.cc:224] Handling call
0709 13:07:56.095235 (+1048105us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400258354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:56.095371 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201236864}
I20260709 13:07:56.101624 20768 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.103937 20768 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.106400 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:56.121003 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.122705 20768 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.123148 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:56.123554 20768 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:56.123728 16563 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.129094 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2392) took 1664 ms. Trace:
I20260709 13:07:56.129456 16639 rpcz_store.cc:276] 0709 13:07:54.464457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.486380 (+ 21923us) service_pool.cc:224] Handling call
0709 13:07:54.573864 (+ 87484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.574502 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.128884 (+1554382us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b54002fce50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:56.129014 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66044800}
W20260709 13:07:56.131655 16456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.019s	sys 0.029s
W20260709 13:07:56.131975 16456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.019s	sys 0.029s
W20260709 13:07:56.132228 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 1.01216e+06us
I20260709 13:07:56.136118 16563 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:56.138273 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:56.138346 20551 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.139313 20707 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:56.139825 20707 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:56.140640 20707 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:56.144071 16491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.008s	sys 0.012s
W20260709 13:07:56.144387 16491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.008s	sys 0.012s
I20260709 13:07:56.145051 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2161) took 1616 ms. Trace:
I20260709 13:07:56.145375 16491 rpcz_store.cc:276] 0709 13:07:54.528382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.528482 (+   100us) service_pool.cc:224] Handling call
0709 13:07:55.042049 (+513567us) spinlock_profiling.cc:243] Waited 953 us on lock 0x7b5800003398. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366eee 0000000000375939 00007f063b3da1e0 00007f063b4a30c4 00007f063b4a3131 00007f063b464fc0 00007f063b44f929 00007f063b44f3d2 00007f06349c6bd4
0709 13:07:55.042221 (+   172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.117460 (+ 75239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.117491 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.139242 (+ 21751us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.144679 (+1005437us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:56.144716 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.144779 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.144819 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:56.144829 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.145000 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8137,"raft.queue_time_us":84477,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2655,"spinlock_wait_cycles":2191232,"thread_start_us":1060181,"threads_started":2,"wal-append.queue_time_us":109282}
I20260709 13:07:56.139369 20768 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.149034 20760 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:56.149158 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 1.00788e+06us
I20260709 13:07:56.151994 20551 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.157346 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.157992 16485 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:56.158970 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.160122 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.161227 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.162216 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.163674 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.164319 16488 raft_consensus.cc:2368] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:07:56.165180 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.165869 16488 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:56.166548 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.168422 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.168916 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2165) took 1630 ms. Trace:
I20260709 13:07:56.169309 16482 rpcz_store.cc:276] 0709 13:07:54.538722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.538816 (+    94us) service_pool.cc:224] Handling call
0709 13:07:54.539094 (+   278us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:54.548097 (+  9003us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:54.548126 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.548616 (+   490us) log.cc:844] Serialized 52 byte log entry
0709 13:07:54.626649 (+ 78033us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:54.626680 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.626724 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.671184 (+1044460us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:56.168637 (+497453us) raft_consensus.cc:1685] finished
0709 13:07:56.168659 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.168864 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7857,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":75,"spinlock_wait_cycles":15576320,"thread_start_us":35803,"threads_started":1,"wal-append.queue_time_us":162840}
I20260709 13:07:56.170949 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.172188 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.173313 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.174316 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.175770 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.176666 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2154) took 1282 ms. Trace:
I20260709 13:07:56.177029 16561 rpcz_store.cc:276] 0709 13:07:54.893884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.003768 (+109884us) service_pool.cc:224] Handling call
0709 13:07:55.004160 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:55.014229 (+ 10069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.014257 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:55.014678 (+   421us) log.cc:844] Serialized 52 byte log entry
0709 13:07:55.120420 (+105742us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:55.120466 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.120535 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.176459 (+1055924us) raft_consensus.cc:1685] finished
0709 13:07:56.176480 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.176613 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15645,"raft.queue_time_us":3992,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7006,"thread_start_us":66999,"threads_started":1,"wal-append.queue_time_us":106565}
I20260709 13:07:56.149206 20768 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.169117 16483 raft_consensus.cc:2368] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:07:56.163146 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.285791 20784 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.308213 20735 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.533243 20735 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.534337 20700 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:56.535245 20735 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.315442 20783 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.536278 20783 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.169309 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.537190 16488 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.538755 20783 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.336411 16491 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:56.540758 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.541854 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.542374 16491 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.362710 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:56.362920 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:56.432094 20694 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:56.363042 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:56.425941 16559 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.380744 20349 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.547156 20349 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.392117 20551 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:56.548944 20551 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.412657 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 816) took 1556 ms. Trace:
I20260709 13:07:56.549926 17183 rpcz_store.cc:276] 0709 13:07:54.856229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.856326 (+    97us) service_pool.cc:224] Handling call
0709 13:07:54.861890 (+  5564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.013010 (+151120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.412391 (+1399381us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54005d11d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:56.412598 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342156672}
I20260709 13:07:56.551177 17186 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.546149 20694 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:56.552747 20694 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.553793 20694 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:56.386442 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.454933 20422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.047s	sys 0.103s
W20260709 13:07:56.561441 20422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.047s	sys 0.103s
I20260709 13:07:56.457163 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.562706 16482 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:07:56.563460 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.564062 16482 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:56.564778 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.565706 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.566650 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.484778 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:56.569947 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 85247.1us
I20260709 13:07:56.570333 16488 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:07:56.571240 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.571990 20691 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.421339 16483 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:56.875298 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.876087 16483 raft_consensus.cc:2410] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:56.876812 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.877710 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.878665 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.454299 20808 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.476914 16486 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:56.576792 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.465772 16485 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:56.567503 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.587498 16491 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
W20260709 13:07:56.587914 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.472s	user 0.006s	sys 0.018s
I20260709 13:07:56.881029 16482 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:56.881275 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.765s	user 0.006s	sys 0.018s
W20260709 13:07:56.589139 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.881963 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.882266 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.632387 20783 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:56.640880 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.439443 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2396) took 1860 ms. Trace:
I20260709 13:07:56.698943 20446 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:56.699906 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 567066us
W20260709 13:07:56.698830 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 548743us
I20260709 13:07:56.711814 20705 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.713907 17186 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:07:56.723904 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2448) took 2296 ms. Trace:
I20260709 13:07:56.889475 16559 rpcz_store.cc:276] 0709 13:07:54.427452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.609058 (+181606us) service_pool.cc:224] Handling call
0709 13:07:56.425770 (+1816712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.546649 (+120879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.723661 (+177012us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400210cd0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:56.723844 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4150893824}
I20260709 13:07:56.730150 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2160) took 1805 ms. Trace:
W20260709 13:07:56.731765 17153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.013s	sys 0.004s
I20260709 13:07:56.232847 20338 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.735601 20517 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.889235 20765 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.893766 20765 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.888145 20783 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.190724 16638 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:07:56.896045 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 567) took 1107 ms. Trace:
W20260709 13:07:56.740061 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.896245 20765 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.743463 20784 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.743868 20422 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.899868 20784 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.900228 20422 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.901930 20784 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.902913 20422 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.752883 20568 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.903584 20568 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.905615 20568 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.753298 20601 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.906286 20601 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.757104 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.764111 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.908489 16634 raft_consensus.cc:2410] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:07:56.767746 20551 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.768662 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.770037 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.771016 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.326195 20701 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:56.780125 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 302850us
I20260709 13:07:56.781344 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 566) took 1722 ms. Trace:
I20260709 13:07:56.785364 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.911211 16632 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:56.789747 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.522293 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:56.523810 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 675) took 1629 ms. Trace:
I20260709 13:07:56.570639 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:56.915966 20701 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:56.916973 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 346434us
I20260709 13:07:56.917989 20701 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.918154 16530 leader_election.cc:400] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:56.918488 16530 leader_election.cc:403] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:56.919463 20446 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.919961 20755 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.921222 20446 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.891388 20760 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.922520 20760 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.923581 16488 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:56.886790 20808 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.926026 20766 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.926307 20808 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.801638 20349 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.927307 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.867514 16385 catalog_manager.cc:5697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 11, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.928345 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.899776 20338 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.929016 16454 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:56.928598 16385 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.930567 20338 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.931052 20749 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:56.931398 20749 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.930883 16385 catalog_manager.cc:5697] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 6 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 9 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.883205 16491 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.956653 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.881055 16485 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.886448 16631 rpcz_store.cc:276] 0709 13:07:54.579157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.579288 (+   131us) service_pool.cc:224] Handling call
0709 13:07:54.579552 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.808932 (+229380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.439189 (+1630257us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540015ca54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:56.439380 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514665856}
I20260709 13:07:56.960398 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:56.961159 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 210334us
I20260709 13:07:56.961535 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.962507 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.962992 16631 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:07:56.890002 16486 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:56.964567 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.886324 16487 raft_consensus.cc:2376] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14. Re-sending same reply.
W20260709 13:07:56.890882 17153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.014s	sys 0.004s
I20260709 13:07:56.890511 16558 rpcz_store.cc:276] 0709 13:07:54.924783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.121165 (+196382us) service_pool.cc:224] Handling call
0709 13:07:55.121461 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.131198 (+  9737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.131230 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.131268 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:55.131297 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.729940 (+1598643us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b5400019854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:56.729985 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.730097 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21998464}
I20260709 13:07:56.965785 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.966384 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:56.959645 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:56.967339 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 911236us
I20260709 13:07:56.968014 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:56.969000 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:56.892717 16482 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:56.896359 16638 rpcz_store.cc:276] 0709 13:07:55.788574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.175530 (+386956us) service_pool.cc:224] Handling call
0709 13:07:56.895992 (+720462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:56.957688 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.970341 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.968245 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:56.971150 16485 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.971329 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.966841 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.909389 16637 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:07:56.911882 16633 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:56.973073 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.970582 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.973948 16491 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:56.974639 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.975229 16491 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:56.912410 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.886509 20709 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.912446 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.976148 20818 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 6. Current term is 7.
I20260709 13:07:56.913077 17181 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:56.976442 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:56.362227 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.975826 20551 raft_consensus.cc:2764] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:56.977098 20818 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.932117 16483 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:56.977674 20551 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.977525 20818 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.978924 16483 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:56.979259 16483 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:56.979557 20818 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.979897 16483 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.980791 16483 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.930917 20757 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:56.935041 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:56.912802 17188 rpcz_store.cc:276] 0709 13:07:54.894556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.017175 (+122619us) service_pool.cc:224] Handling call
0709 13:07:55.021384 (+  4209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.283190 (+261806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.523521 (+1240331us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400576cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:56.523733 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600761216}
I20260709 13:07:56.983088 20818 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.936251 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:56.983632 16560 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.977483 20800 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.984282 20800 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:56.984400 16559 raft_consensus.cc:2410] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:56.966934 16558 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:56.985319 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:56.937453 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.985693 16558 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.937760 20517 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:56.986395 20517 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.987576 16482 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:07:56.988327 20517 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.931718 20749 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.989778 16560 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:07:56.992465 20517 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:56.992937 20517 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.994905 20517 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.983683 20818 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:56.963692 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.997879 20818 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.940233 20601 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.940874 20783 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:56.942023 20760 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:56.943392 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:57.001699 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 60167.8us
I20260709 13:07:57.003259 16633 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:56.945320 20763 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:56.945487 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 564) took 1887 ms. Trace:
I20260709 13:07:57.017333 20517 consensus_queue.cc:1059] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.946663 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.017692 20763 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:57.018154 16564 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:57.019161 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.019691 16564 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:57.017678 16490 rpcz_store.cc:276] 0709 13:07:55.058522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.058632 (+   110us) service_pool.cc:224] Handling call
0709 13:07:55.072967 (+ 14335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.127957 (+ 54990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.127987 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.130851 (+  2864us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.759061 (+628210us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:56.788422 (+1029361us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.945194 (+156772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.945277 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.945320 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:56.945335 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.945438 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1010699,"prepare.queue_time_us":1113791,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":93112,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5176,"spinlock_wait_cycles":1737600,"thread_start_us":814170,"threads_started":4,"wal-append.queue_time_us":119093,"wal-append.run_cpu_time_us":1715,"wal-append.run_wall_time_us":1016773}
I20260709 13:07:57.020509 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.020704 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:57.021173 16486 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:57.021198 16490 raft_consensus.cc:2376] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13. Re-sending same reply.
I20260709 13:07:57.022241 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:57.022866 16490 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:56.950867 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:56.951156 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.024070 16565 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:07:57.024430 20517 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.024782 20517 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:57.024852 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.025527 16565 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:57.026228 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.026376 16486 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:57.026794 16486 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:57.026898 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:57.025578 20517 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.027995 20517 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.028429 16565 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
W20260709 13:07:57.028129 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.027943 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:57.031685 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:56.899355 20691 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.952099 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:56.952447 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.033700 16566 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:56.951311 20700 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.954627 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:57.034274 20691 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:57.034579 16373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 80002.9us
I20260709 13:07:56.976065 16634 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:07:57.035238 16564 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:56.910431 16489 rpcz_store.cc:276] 0709 13:07:55.058920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.131000 (+ 72080us) service_pool.cc:224] Handling call
0709 13:07:55.138155 (+  7155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.149978 (+ 11823us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:55.674870 (+524892us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.072666 (+397796us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:56.149385 (+ 76719us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.149804 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.149959 (+   155us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:56.756357 (+606398us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.780995 (+ 24638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.781066 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.781171 (+   105us) raft_consensus.cc:1685] finished
0709 13:07:56.781183 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.781295 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3793655,"prepare.queue_time_us":1250217,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"raft.queue_time_us":496535,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":14560,"spinlock_wait_cycles":3184896,"thread_start_us":64229,"threads_started":1,"wal-append.queue_time_us":80396}
I20260709 13:07:57.034243 20700 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.038076 20691 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:57.036815 16564 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:07:57.039191 20700 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:56.886278 20694 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:57.039844 20694 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:57.040123 16486 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.041024 16486 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.977211 16639 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.984654 20800 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.046360 16483 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:07:56.949275 16640 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:57.048928 16634 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.969105 16385 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 11, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.976018 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:56.927587 20735 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:57.003945 20760 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.006453 16558 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:07:57.052357 16558 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:57.006641 20709 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:56.938899 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:57.059727 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 120882us
I20260709 13:07:57.060860 16640 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:57.007826 16482 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:56.996088 16638 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:57.011931 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.013540 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.014298 16485 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:07:57.062978 16560 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
W20260709 13:07:57.063176 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 49711us
I20260709 13:07:57.022714 20757 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:57.033867 16562 raft_consensus.cc:2410] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:07:57.058867 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:57.023708 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:56.999712 16635 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:57.055226 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:57.072610 16558 raft_consensus.cc:2368] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
I20260709 13:07:57.014719 20749 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:57.063966 17153 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.050563 20694 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:57.071900 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 48252.4us
I20260709 13:07:57.072391 16385 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 9 to 11, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.073889 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:57.074088 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:57.082221 16565 raft_consensus.cc:2368] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13.
I20260709 13:07:57.082924 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:57.083555 16565 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:57.089596 16566 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:57.022189 20763 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:57.091820 17184 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:57.076772 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.092397 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.092033 16385 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.092106 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.093609 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.075448 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:57.078001 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 159973us
I20260709 13:07:57.050510 20808 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.086160 16455 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:57.095544 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.050832 20735 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:57.097209 16560 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:57.098275 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.101109 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.104417 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.104609 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.106946 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.075909 20701 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.118819 20701 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.099638 16566 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:07:57.077386 20517 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.073702 20747 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:57.108629 16487 raft_consensus.cc:2368] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9.
I20260709 13:07:57.120223 20747 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:57.120667 20747 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.090828 20705 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:57.123996 20705 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.124398 20705 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.119272 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:57.107820 16561 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:57.136179 16565 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.140878 20747 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:57.142983 20747 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:57.135658 20705 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.145569 20705 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:57.154394 16565 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:57.143549 20747 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:57.101785 20765 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.105818 20735 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.150686 16385 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 12, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.119227 20701 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:57.185477 16388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 130) took 14015 ms (client timeout 15000 ms). Trace:
I20260709 13:07:57.089382 20601 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:07:57.109045 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08000a9ba0 after lost signal to thread 15384
W20260709 13:07:57.201148 16661 debug-util.cc:398] Leaking SignalData structure 0x7b080013f340 after lost signal to thread 15387
I20260709 13:07:57.117970 20551 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:57.195250 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 88365.4us
I20260709 13:07:57.217124 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.218250 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:57.202106 16661 debug-util.cc:398] Leaking SignalData structure 0x7b080013f3a0 after lost signal to thread 16423
I20260709 13:07:57.105715 20757 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:57.196390 16388 rpcz_store.cc:269] 0709 13:07:43.132688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.229507 (+ 96819us) service_pool.cc:224] Handling call
0709 13:07:43.314087 (+ 84580us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400002490. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633367640 00007f063c23eb76 00007f063c348c3e 00007f063a8092a4 00007f063a809232 00007f063a809161 00007f063a8090dc 00007f063a808392 00007f06347c648c 00007f06347c58c6
0709 13:07:57.147688 (+13833601us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:54.562971 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:54.563614 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:54.563660 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:07:54.563679 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:54.564540 (+   861us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:54.564615 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:54.564643 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:54.565364 (+   721us) tablet.cc:701] Row locks acquired
0709 13:07:54.565412 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:07:54.565569 (+   157us) write_op.cc:270] Start()
0709 13:07:54.565719 (+   150us) write_op.cc:276] Timestamp: P: 1783602474565510 usec, L: 0
0709 13:07:54.565740 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:54.602314 (+ 36574us) log.cc:844] Serialized 3206 byte log entry
0709 13:07:55.040483 (+438169us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b180022be80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e557 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:55.706894 (+666411us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b180022be80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:07:55.722552 (+ 15658us) op_driver.cc:464] REPLICATION: finished
0709 13:07:55.897720 (+175168us) write_op.cc:301] APPLY: starting
0709 13:07:55.897858 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:55.903719 (+  5861us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:55.903768 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:56.048559 (+144791us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:56.048859 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:07:56.048906 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:56.049210 (+   304us) log.cc:844] Serialized 65 byte log entry
0709 13:07:56.050378 (+  1168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.050497 (+   119us) write_op.cc:454] Released schema lock
0709 13:07:56.050552 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:56.132181 (+ 81629us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.132420 (+   239us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"spinlock_wait_cycles":34564096,"child_traces":[["op",{"apply.queue_time_us":174912,"apply.run_cpu_time_us":3366,"apply.run_wall_time_us":201513,"num_ops":8,"prepare.queue_time_us":209753,"prepare.run_cpu_time_us":15371,"prepare.run_wall_time_us":232693,"raft.queue_time_us":13320,"raft.run_cpu_time_us":15649,"raft.run_wall_time_us":141922,"replication_time_us":1156647,"spinlock_wait_cycles":15542272,"thread_start_us":320843,"threads_started":4,"wal-append.queue_time_us":196078,"wal-append.run_cpu_time_us":11405,"wal-append.run_wall_time_us":1343536}]]}
W20260709 13:07:57.204870 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 106883us
I20260709 13:07:57.223613 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:57.225307 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:07:57.213039 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 109602us
W20260709 13:07:57.219911 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08003d00c0 after lost signal to thread 16515
W20260709 13:07:57.231074 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4be0 after lost signal to thread 16516
I20260709 13:07:57.219986 16566 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.194895 20766 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.117847 20762 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
W20260709 13:07:57.227022 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 163119us
I20260709 13:07:57.229621 16385 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.232177 16661 debug-util.cc:398] Leaking SignalData structure 0x7b080008b480 after lost signal to thread 16590
I20260709 13:07:57.187259 20705 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:57.105042 20808 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:57.200891 20818 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:57.201241 20747 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:57.251081 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08003e03c0 after lost signal to thread 16664
I20260709 13:07:57.273530 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:57.218124 20765 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:57.221009 20757 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:57.276561 16661 debug-util.cc:398] Leaking SignalData structure 0x7b080018f940 after lost signal to thread 16665
I20260709 13:07:57.194903 20700 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:07:57.282482 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd420 after lost signal to thread 17212
I20260709 13:07:57.232343 20422 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:57.235949 20814 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.289453 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:07:57.286041 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7c20 after lost signal to thread 17213
I20260709 13:07:57.287225 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:57.295437 16635 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:57.232213 20820 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:57.288219 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 63021.4us
I20260709 13:07:57.279100 20762 consensus_queue.cc:1243] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:57.282737 20757 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.249122 20551 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:57.287649 20488 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:57.299314 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:57.311074 16456 leader_election.cc:400] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
I20260709 13:07:57.332057 16456 leader_election.cc:403] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.312592 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:57.291164 20813 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:07:57.330328 16385 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 11, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.297573 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.273036 20766 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.345465 20766 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:57.332782 16566 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:57.285593 20601 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.346509 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:57.347066 16566 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.296733 20827 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:57.314571 20551 consensus_queue.cc:1243] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:57.357918 16385 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.363912 16486 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:57.364329 16486 pending_rounds.cc:85] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 7
I20260709 13:07:57.364586 16486 pending_rounds.cc:107] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:07:57.364848 16486 raft_consensus.cc:2889] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.294977 20422 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.314810 20488 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:07:57.367846 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 59154us
I20260709 13:07:57.338191 20820 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.373024 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.375041 16456 leader_election.cc:400] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13.
I20260709 13:07:57.380676 16456 leader_election.cc:403] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:07:57.367274 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 148962us
I20260709 13:07:57.362818 20766 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
I20260709 13:07:57.393281 20333 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:57.382503 20824 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:07:57.398521 16639 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:07:57.380136 20749 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:57.383570 20709 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:57.408232 16385 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 11, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.459394 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.416406 16530 leader_election.cc:400] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
I20260709 13:07:57.368402 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.375787 16638 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.393187 20760 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:57.401512 20812 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:07:57.369700 20827 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:57.384195 20705 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:57.377278 16566 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
W20260709 13:07:57.437808 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 206516us
I20260709 13:07:57.442715 20333 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:57.375998 20700 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:57.539479 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.440995 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.441994 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51944 (request call id 571) took 1080 ms. Trace:
W20260709 13:07:57.441531 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 367488us
I20260709 13:07:57.444561 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.540946 17182 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:57.540901 16639 rpcz_store.cc:276] 0709 13:07:56.361839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.361977 (+   138us) service_pool.cc:224] Handling call
0709 13:07:57.441938 (+1079961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:57.379989 20820 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:57.372577 20765 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:57.543972 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 169055us
W20260709 13:07:57.444247 20815 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:07:57.509940 17183 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:07:57.454695 20816 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:07:57.435329 20755 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:57.385154 20831 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:57.363076 20747 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:57.514458 20825 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:07:57.538425 16530 leader_election.cc:403] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.544147 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:57.543825 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.543224 17186 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:57.794605 16557 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
W20260709 13:07:57.536729 20813 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:07:57.516369 20847 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:07:57.548817 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:57.547386 16564 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.013s
I20260709 13:07:57.547478 17152 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:07:57.510353 20832 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:57.573498 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4aa0 after lost signal to thread 15384
W20260709 13:07:57.590858 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.541466 20333 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.606977 16385 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 12, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.540603 20808 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:57.548501 20828 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.643846 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2160) took 3116 ms. Trace:
I20260709 13:07:57.551281 20755 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:57.633533 20815 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:57.798043 20422 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:57.800139 16385 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 7 to 8, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.801741 16385 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 12, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.803874 16564 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.001s	sys 0.013s
I20260709 13:07:57.790436 20349 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:57.805188 20349 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:57.805661 20762 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.806104 20762 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:57.798429 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 382106us
I20260709 13:07:57.807466 16561 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [8.7-9.8]
I20260709 13:07:57.808159 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.808264 20349 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.626765 20705 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.790935 20831 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.547827 16638 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:57.791947 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 492663us
I20260709 13:07:57.550757 20846 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.846078 17186 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:57.793618 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.545287 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.803092 16385 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.809242 20814 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.799041 16484 rpcz_store.cc:276] 0709 13:07:54.527678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.527777 (+    99us) service_pool.cc:224] Handling call
0709 13:07:54.528030 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.156037 (+628007us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:57.114949 (+1958912us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.433944 (+318995us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.434003 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.434050 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.643554 (+209504us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54002e36d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:57.643607 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.643760 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1268427,"prepare.queue_time_us":1716637,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":98,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":2533,"spinlock_wait_cycles":1443831680,"thread_start_us":674892,"threads_started":2,"wal-append.queue_time_us":398142}
W20260709 13:07:57.811767 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08000613a0 after lost signal to thread 15387
I20260709 13:07:57.799165 17182 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:57.811743 17181 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:57.846349 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2399) took 1074 ms. Trace:
W20260709 13:07:57.814339 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 270234us
I20260709 13:07:57.819833 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:57.849473 16637 rpcz_store.cc:276] 0709 13:07:56.772154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.974121 (+201967us) service_pool.cc:224] Handling call
0709 13:07:56.974438 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:57.004515 (+ 30077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.004543 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:57.005051 (+   508us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.173660 (+168609us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.545948 (+372288us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.548017 (+  2069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.548090 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.846155 (+298065us) raft_consensus.cc:1685] finished
0709 13:07:57.846175 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.846295 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58926,"prepare.queue_time_us":110215,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":33592,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":58397,"thread_start_us":487584,"threads_started":2,"wal-append.queue_time_us":271616}
I20260709 13:07:57.809370 20349 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.852653 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:57.853238 16638 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:57.853523 16637 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:57.854049 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:57.854313 16638 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:07:57.849247 16587 debug-util.cc:398] Leaking SignalData structure 0x7b080018f600 after lost signal to thread 16423
I20260709 13:07:57.855023 16637 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:57.856086 16587 debug-util.cc:398] Leaking SignalData structure 0x7b0800373620 after lost signal to thread 16515
W20260709 13:07:57.856422 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4340 after lost signal to thread 16516
I20260709 13:07:57.857240 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.857955 17181 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 8: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:57.857869 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:57.858922 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.859099 16639 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:57.827021 20835 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.310s	user 0.006s	sys 0.002s
W20260709 13:07:57.860582 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 315340us
I20260709 13:07:57.812422 20446 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:57.861828 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.861547 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:57.872306 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.870432 17181 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:57.865999 16456 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:57.827567 20338 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.798593 20843 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 7. Current term is 8.
W20260709 13:07:57.884289 17153 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.985s (SENT) [suppressed 22 similar messages]
I20260709 13:07:57.883373 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:57.883566 16639 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
W20260709 13:07:57.884220 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08003fbbc0 after lost signal to thread 16590
I20260709 13:07:57.827507 20831 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:57.852802 20841 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.343s	user 0.006s	sys 0.003s
I20260709 13:07:57.852969 20827 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:57.881484 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:57.855996 20422 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:57.887912 16587 debug-util.cc:398] Leaking SignalData structure 0x7b0800250140 after lost signal to thread 16664
W20260709 13:07:57.902109 16587 debug-util.cc:398] Leaking SignalData structure 0x7b080008e7a0 after lost signal to thread 16665
W20260709 13:07:57.903342 16587 debug-util.cc:398] Leaking SignalData structure 0x7b080029fd60 after lost signal to thread 17212
W20260709 13:07:57.903604 16587 debug-util.cc:398] Leaking SignalData structure 0x7b080037c640 after lost signal to thread 17213
I20260709 13:07:57.870551 20754 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.852226 20762 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:57.862095 20766 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.869081 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:57.907068 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6c20 after lost signal to thread 20517
W20260709 13:07:57.923763 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08003362c0 after lost signal to thread 20549
W20260709 13:07:57.923604 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 376120us
W20260709 13:07:57.924405 16587 debug-util.cc:398] Leaking SignalData structure 0x7b0800292260 after lost signal to thread 20591
W20260709 13:07:57.924750 16587 debug-util.cc:398] Leaking SignalData structure 0x7b080025fd40 after lost signal to thread 20611
W20260709 13:07:57.925066 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6b80 after lost signal to thread 20613
I20260709 13:07:57.925263 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:57.925534 16587 debug-util.cc:398] Leaking SignalData structure 0x7b0800369f40 after lost signal to thread 20674
I20260709 13:07:57.914315 16529 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:57.871713 20446 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:57.927994 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:57.930630 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 49232.1us
W20260709 13:07:57.939549 16587 debug-util.cc:398] Leaking SignalData structure 0x7b0800161ce0 after lost signal to thread 20742
W20260709 13:07:57.942257 16587 debug-util.cc:398] Leaking SignalData structure 0x7b0800391ee0 after lost signal to thread 20746
W20260709 13:07:57.942493 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8de0 after lost signal to thread 20749
W20260709 13:07:57.942677 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb5e0 after lost signal to thread 20754
W20260709 13:07:57.942878 16587 debug-util.cc:398] Leaking SignalData structure 0x7b08003ff620 after lost signal to thread 20757
W20260709 13:07:57.943040 16587 debug-util.cc:398] Leaking SignalData structure 0x7b080033cb20 after lost signal to thread 20758
I20260709 13:07:57.953116 17152 leader_election.cc:400] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9.
I20260709 13:07:57.953465 17152 leader_election.cc:403] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.896271 20848 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:57.960074 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 151973us
I20260709 13:07:57.960772 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.961373 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2403) took 1188 ms. Trace:
I20260709 13:07:57.961920 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.962931 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:57.961704 16631 rpcz_store.cc:276] 0709 13:07:56.773064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.996820 (+223756us) service_pool.cc:224] Handling call
0709 13:07:56.997102 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.013395 (+ 16293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.013426 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.013856 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.095006 (+ 81150us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:57.095044 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.095100 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.961174 (+866074us) raft_consensus.cc:1685] finished
0709 13:07:57.961195 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.961320 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15618,"raft.queue_time_us":15799,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":77282,"threads_started":1,"wal-append.queue_time_us":268673}
I20260709 13:07:57.877740 20828 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:57.827723 20832 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:57.977337 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 91044.3us
I20260709 13:07:57.891099 20749 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:57.974962 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:57.985299 16564 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:07:57.960829 20677 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:57.948753 20691 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.982530 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2404) took 1209 ms. Trace:
I20260709 13:07:57.958411 20827 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:57.929045 20766 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:57.975708 20762 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:57.888269 20338 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:57.899899 20830 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:07:58.007743 20758 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
W20260709 13:07:58.008906 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 142986us
W20260709 13:07:58.007431 20800 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.918s	user 0.015s	sys 0.000s
I20260709 13:07:57.981057 20843 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.960741 20814 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:57.986296 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:57.976466 20808 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:58.016785 16564 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:57.988533 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 119509us
I20260709 13:07:58.000679 20852 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.007282 20706 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.984926 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:57.972484 20848 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.011284 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:57.983541 20784 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:58.013955 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 130643us
I20260709 13:07:58.018229 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:07:58.026787 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 73806.3us
W20260709 13:07:58.027612 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 143343us
I20260709 13:07:57.994745 16636 rpcz_store.cc:276] 0709 13:07:56.773379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.032894 (+259515us) service_pool.cc:224] Handling call
0709 13:07:57.033148 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.175915 (+142767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.175943 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.176341 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.293848 (+117507us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:57.294124 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.800225 (+506101us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b54002fc954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:57.800267 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.977882 (+177615us) raft_consensus.cc:1685] finished
0709 13:07:57.977902 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.982473 (+  4571us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10285,"raft.queue_time_us":103219,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":5148,"spinlock_wait_cycles":150626048,"thread_start_us":183641,"threads_started":2,"wal-append.queue_time_us":223197}
I20260709 13:07:58.033370 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:58.039191 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 54337.2us
I20260709 13:07:58.002111 20766 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.003068 20762 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.998615 20551 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.054920 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:58.009331 20677 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:58.065032 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 102156us
I20260709 13:07:58.065749 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:58.068460 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:57.998113 20763 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:07:58.069020 17188 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:07:58.072945 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:07:58.030000 20827 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:58.029634 20814 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:58.007723 20858 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:07:58.029445 20848 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.057404 20705 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:58.088362 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 128496us
W20260709 13:07:58.060053 20822 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.558s	user 0.012s	sys 0.004s
I20260709 13:07:58.059661 20762 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.064458 20852 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:58.029994 20800 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.183506 16455 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:57.988775 20831 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.052999 20784 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:58.069828 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:58.029474 20446 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:58.064633 20735 consensus_meta.cc:287] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.008s
I20260709 13:07:58.292856 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:58.257519 17182 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.256301 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:58.230187 20863 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:07:58.229363 20868 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 13:07:58.073284 20749 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:58.230749 20857 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 13:07:58.229156 20851 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:07:58.332937 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2486) took 1050 ms. Trace:
I20260709 13:07:58.292595 20870 consensus_queue.cc:1059] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:58.305114 20755 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:58.266547 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 233240us
I20260709 13:07:58.306890 20832 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:58.305536 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 247914us
I20260709 13:07:58.297873 20422 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.306140 20694 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.300395 20821 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:07:58.291850 20338 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:58.304248 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2419) took 1361 ms. Trace:
W20260709 13:07:58.077690 20701 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.857s	user 0.015s	sys 0.000s
I20260709 13:07:58.129105 16564 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
W20260709 13:07:58.305884 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 240201us
I20260709 13:07:58.255467 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:58.339406 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 155981us
I20260709 13:07:58.299036 20691 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.384996 20831 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.369979 17181 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:58.291294 20877 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.386107 20765 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.307871 20836 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.517s	user 0.002s	sys 0.001s
W20260709 13:07:58.291939 20859 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:07:58.369218 20735 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.378535 16565 rpcz_store.cc:276] 0709 13:07:57.282180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.810396 (+528216us) service_pool.cc:224] Handling call
0709 13:07:57.819052 (+  8656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.950911 (+131859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.951126 (+   215us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.952208 (+  1082us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.183616 (+231408us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:58.183657 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.183727 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.332745 (+149018us) raft_consensus.cc:1685] finished
0709 13:07:58.332764 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.332885 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40734,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":283206,"threads_started":2,"wal-append.queue_time_us":291721}
I20260709 13:07:58.425168 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2485) took 1149 ms. Trace:
I20260709 13:07:58.120553 20845 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.070604 20864 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:58.383913 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 352743us
I20260709 13:07:58.297179 20488 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:58.387079 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.291158 20758 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:58.332721 20861 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 13:07:58.077719 20829 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.181306 20705 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:58.307596 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2416) took 1365 ms. Trace:
I20260709 13:07:58.208478 20763 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.215698 20843 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.225239 20517 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:58.369460 20349 consensus_meta.cc:287] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.517s	user 0.001s	sys 0.007s
I20260709 13:07:58.116740 20862 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.071141 20820 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:58.188732 20838 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.450017 20758 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.403752 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:58.077606 20760 consensus_meta.cc:287] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.561s	user 0.014s	sys 0.004s
I20260709 13:07:58.076834 20706 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.320s
I20260709 13:07:58.338847 20814 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.372466 20749 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:07:58.292086 20823 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:07:58.397521 16634 rpcz_store.cc:276] 0709 13:07:56.943044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.094616 (+151572us) service_pool.cc:224] Handling call
0709 13:07:57.117032 (+ 22416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.148649 (+ 31617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.148678 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.291472 (+142794us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b2c00128e18. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:07:57.296816 (+  5344us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.791908 (+495092us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.791948 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.792009 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.303913 (+511904us) raft_consensus.cc:1685] finished
0709 13:07:58.303933 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.304185 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33135,"raft.queue_time_us":130620,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6544,"spinlock_wait_cycles":3547008,"thread_start_us":265463,"threads_started":1,"wal-append.queue_time_us":982398}
I20260709 13:07:58.486680 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2400) took 1714 ms. Trace:
I20260709 13:07:58.487016 16632 rpcz_store.cc:276] 0709 13:07:56.772392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.983660 (+211268us) service_pool.cc:224] Handling call
0709 13:07:56.985931 (+  2271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:57.004590 (+ 18659us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:57.004857 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.174152 (+169295us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:57.174793 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.174924 (+   131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.174954 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.175014 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.486486 (+1311472us) raft_consensus.cc:1685] finished
0709 13:07:58.486505 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.486628 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18290,"prepare.queue_time_us":588,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":93962,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5586,"thread_start_us":168946,"threads_started":1,"wal-append.queue_time_us":559451}
I20260709 13:07:58.463369 20488 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.077034 20842 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.516s
I20260709 13:07:58.489194 20842 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:58.489516 20842 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:58.490262 20842 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:58.419814 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 364912us
W20260709 13:07:58.367192 16373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 302936us
I20260709 13:07:58.396341 20422 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.492246 20705 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.492974 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:58.493384 20705 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.493794 20884 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.494210 20884 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.494521 20884 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.228726 20333 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.496495 20800 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:58.491849 20709 consensus_queue.cc:1175] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "035eaa2f12374a81a4df7868a5453d3c" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 12 index: 9 } }
I20260709 13:07:58.333225 20854 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:07:58.498631 20854 consensus_queue.cc:1243] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:58.478816 20867 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.500365 20766 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:58.074958 20757 consensus_meta.cc:287] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.004s
I20260709 13:07:58.397207 20755 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:58.425913 16565 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.407684 20691 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.407738 20338 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.245186 20677 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:58.386927 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 314030us
I20260709 13:07:58.254496 20830 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 13:07:58.514335 20691 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:58.433526 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.402782 20870 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:58.434762 16559 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:58.405062 20701 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.427289 20845 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:58.331562 20852 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.440377 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2466) took 1370 ms. Trace:
I20260709 13:07:58.401940 20694 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.450379 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2471) took 1341 ms. Trace:
I20260709 13:07:58.510936 20757 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.456420 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:58.465519 16633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2411) took 1529 ms. Trace:
I20260709 13:07:58.463924 17184 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.467689 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2182) took 1518 ms. Trace:
I20260709 13:07:58.549918 16563 rpcz_store.cc:276] 0709 13:07:56.949529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.949638 (+   109us) service_pool.cc:224] Handling call
0709 13:07:56.949898 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.979964 (+ 30066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.979997 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.980414 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.214162 (+233748us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:57.214204 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.214274 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.299758 (+1085484us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:58.455271 (+155513us) raft_consensus.cc:1685] finished
0709 13:07:58.455291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.467617 (+ 12326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26761,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"spinlock_wait_cycles":11898240,"thread_start_us":263142,"threads_started":2,"wal-append.queue_time_us":999028}
I20260709 13:07:58.400117 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:58.471832 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2481) took 1235 ms. Trace:
I20260709 13:07:58.430270 20601 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:58.463042 20517 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:58.424772 20765 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:58.476408 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72715.8us
W20260709 13:07:58.476712 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.552659 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 96325us
I20260709 13:07:58.477269 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2192) took 2001 ms. Trace:
I20260709 13:07:58.452107 20829 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.478086 20760 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13.
I20260709 13:07:58.481442 20820 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:58.481820 20840 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:58.482275 20722 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:58.484460 16564 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:58.484308 20749 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.457816 20864 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:58.434149 20827 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.425586 16561 rpcz_store.cc:276] 0709 13:07:57.276080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.808176 (+532096us) service_pool.cc:224] Handling call
0709 13:07:57.808448 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.808737 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.808764 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.809158 (+   394us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.906878 (+ 97720us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.907021 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.907384 (+   363us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.424932 (+517548us) raft_consensus.cc:1685] finished
0709 13:07:58.424959 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.425096 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":313,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":96952,"threads_started":1,"wal-append.queue_time_us":185836}
I20260709 13:07:58.501942 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2489) took 1203 ms. Trace:
I20260709 13:07:58.518968 20338 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.470976 20838 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:58.491492 20842 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:58.515558 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 95838.6us
W20260709 13:07:58.516990 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.477317 20758 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.457898 20828 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:58.594226 20800 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.590469 20722 consensus_queue.cc:1243] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:58.522639 20755 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:58.527325 16562 rpcz_store.cc:276] 0709 13:07:57.070395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.074924 (+  4529us) service_pool.cc:224] Handling call
0709 13:07:57.075176 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.075500 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:57.075527 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.090538 (+ 15011us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.273527 (+182989us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.273566 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.273775 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.307182 (+1033407us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:58.440081 (+132899us) raft_consensus.cc:1685] finished
0709 13:07:58.440102 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.440321 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1084,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":13669,"spinlock_wait_cycles":37692672,"thread_start_us":122689,"threads_started":1,"wal-append.queue_time_us":341163}
I20260709 13:07:58.515725 20884 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.530937 16560 rpcz_store.cc:276] 0709 13:07:57.109292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.109489 (+   197us) service_pool.cc:224] Handling call
0709 13:07:57.109769 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.109976 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.110001 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.118167 (+  8166us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.790514 (+672347us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:57.790558 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.790626 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.450139 (+659513us) raft_consensus.cc:1685] finished
0709 13:07:58.450172 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.450317 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":448305,"threads_started":1,"wal-append.queue_time_us":676945}
I20260709 13:07:58.451552 16640 rpcz_store.cc:276] 0709 13:07:56.942313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.074333 (+132020us) service_pool.cc:224] Handling call
0709 13:07:57.074610 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.074955 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.074981 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.075369 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.175278 (+ 99909us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.175330 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.175400 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.307408 (+1132008us) raft_consensus.cc:1685] finished
0709 13:07:58.307427 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.307546 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8251,"raft.queue_time_us":6534,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":8183,"thread_start_us":68307,"threads_started":1,"wal-append.queue_time_us":972921}
I20260709 13:07:58.499415 20867 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.517472 20873 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.594738 20874 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:58.548354 16633 rpcz_store.cc:276] 0709 13:07:56.936439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.058541 (+122102us) service_pool.cc:224] Handling call
0709 13:07:57.089923 (+ 31382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:57.307341 (+217418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.307376 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:57.330080 (+ 22704us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.460980 (+130900us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.461017 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.461090 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.465278 (+1004188us) raft_consensus.cc:1685] finished
0709 13:07:58.465299 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.465450 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11387,"raft.queue_time_us":57057,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":35023,"thread_start_us":293669,"threads_started":2,"wal-append.queue_time_us":658124}
I20260709 13:07:58.552228 16566 rpcz_store.cc:276] 0709 13:07:57.236572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.537822 (+301250us) service_pool.cc:224] Handling call
0709 13:07:57.543748 (+  5926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.544077 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.544105 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.565111 (+ 21006us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.900166 (+335055us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.900226 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.900352 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.471609 (+571257us) raft_consensus.cc:1685] finished
0709 13:07:58.471629 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.471748 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":588,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":42363,"thread_start_us":103668,"threads_started":1,"wal-append.queue_time_us":187954}
I20260709 13:07:58.551932 16563 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.556566 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:58.553207 16558 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:07:58.555516 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 155484us
W20260709 13:07:58.551926 16559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 2186) took 1596 ms (client timeout 2106 ms). Trace:
I20260709 13:07:58.556102 16488 rpcz_store.cc:276] 0709 13:07:56.475869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.925904 (+450035us) service_pool.cc:224] Handling call
0709 13:07:56.926233 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.926562 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.926588 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.926987 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.173295 (+246308us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.175468 (+  2173us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.187972 (+ 12504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.188043 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.651970 (+463927us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:07:58.476983 (+825013us) raft_consensus.cc:1685] finished
0709 13:07:58.477076 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.477212 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12266,"prepare.queue_time_us":1756,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":13464,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":21028,"spinlock_wait_cycles":3036416,"thread_start_us":177180,"threads_started":1,"wal-append.queue_time_us":351858}
W20260709 13:07:58.568003 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 50594.6us
W20260709 13:07:58.554651 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.591022 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:58.526340 20845 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.592288 16565 rpcz_store.cc:276] 0709 13:07:57.298554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.425490 (+1126936us) service_pool.cc:224] Handling call
0709 13:07:58.425755 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.501688 (+ 75933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.501884 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:58.497852 20333 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:58.549110 20843 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:58.560029 20830 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:58.596041 16561 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:58.581472 20829 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.602345 20881 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:58.602983 20701 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:58.607461 20517 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.608932 20885 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.498657 20880 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:58.586113 20709 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.511096 20862 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:58.627593 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2488) took 1338 ms. Trace:
I20260709 13:07:58.593611 20858 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:07:58.609184 20765 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:58.629892 20749 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.687867 16488 pending_rounds.cc:85] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 8
I20260709 13:07:58.594871 20568 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:07:58.667138 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 73948.1us
I20260709 13:07:58.736270 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:58.737534 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:58.599010 20838 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.500972 20854 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:58.670641 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:58.681823 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:58.673998 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 117504us
I20260709 13:07:58.678094 16487 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:07:58.668349 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.679292 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:07:58.674744 16559 rpcz_store.cc:269] 0709 13:07:56.955284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.985080 (+ 29796us) service_pool.cc:224] Handling call
0709 13:07:58.551708 (+1566628us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540004a454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:58.551871 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3309606656}
I20260709 13:07:58.674937 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:58.685926 16482 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:58.729297 16488 pending_rounds.cc:107] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:07:58.730201 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:58.680414 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:58.589114 20784 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:58.731647 16564 rpcz_store.cc:276] 0709 13:07:57.289031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.401879 (+1112848us) service_pool.cc:224] Handling call
0709 13:07:58.402155 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.586920 (+184765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.627346 (+ 40426us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b540040ea54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:58.627532 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188515200}
I20260709 13:07:58.733091 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:58.735291 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:58.551560 20754 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.741701 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:58.738234 16636 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:58.805650 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:58.796443 16488 raft_consensus.cc:2889] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.796840 16484 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:58.797178 16560 raft_consensus.cc:2410] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:07:58.742811 16562 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:58.741308 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 61568.4us
I20260709 13:07:58.670271 20884 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:58.682570 20873 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:58.669850 20338 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:58.820257 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 145385us
W20260709 13:07:58.822950 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 147496us
I20260709 13:07:58.687288 20867 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:58.632905 20800 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.673074 20820 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:58.820675 20707 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.830090 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:58.835157 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.738982 20735 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:58.864346 20735 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:58.864847 20735 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:58.865742 20735 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.740375 20830 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:58.867993 20830 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.733845 20709 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:58.872031 20709 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.741971 20893 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.599401 20864 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:58.861382 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 125205us
I20260709 13:07:58.719053 20880 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:58.882607 20880 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.883857 20880 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:58.822358 20846 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.957s	user 0.002s	sys 0.007s
W20260709 13:07:58.817552 20848 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.002s
I20260709 13:07:58.817653 20895 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:07:59.000777 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 96207.9us
I20260709 13:07:58.886842 20846 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.861205 20820 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.818641 20754 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:59.003711 20551 consensus_meta.cc:287] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.004s
I20260709 13:07:59.046233 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2464) took 1989 ms. Trace:
I20260709 13:07:58.831207 20870 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.206s
I20260709 13:07:58.739187 20843 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.056874 16558 rpcz_store.cc:276] 0709 13:07:57.056385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.073227 (+ 16842us) service_pool.cc:224] Handling call
0709 13:07:58.552996 (+1479769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.682710 (+129714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.046047 (+363337us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540004a450. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:59.046169 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3402395008}
W20260709 13:07:59.055147 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 230827us
W20260709 13:07:59.041996 20831 consensus_meta.cc:287] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.004s
W20260709 13:07:59.062321 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.057544 17183 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:59.062661 16486 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:59.032361 20784 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.060108 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 178143us
I20260709 13:07:58.834671 20755 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:58.763743 20885 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.048015 20868 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:07:59.062973 16605 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:58.689059 20874 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.035570 20828 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:58.739353 20881 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:59.094400 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 264368us
I20260709 13:07:59.041746 20904 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.084987 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:07:59.094326 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 270759us
I20260709 13:07:59.062420 20551 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 8. Current term is 9.
I20260709 13:07:59.059696 20852 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:59.011953 20848 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:59.114193 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51282.4us
I20260709 13:07:59.115473 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:59.091122 20846 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.040709 20895 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.137108 16566 raft_consensus.cc:2410] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:59.111805 20757 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:07:59.154500 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.111501 20694 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:59.131073 20814 consensus_meta.cc:287] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.000s
I20260709 13:07:59.122491 20882 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.122725 20568 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:59.096843 20784 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.035192 20893 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.172039 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:07:59.162389 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 77477.2us
I20260709 13:07:59.158767 20814 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.113829 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:07:59.178769 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:59.113135 20868 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.168771 20694 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:59.197885 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:07:59.176862 20488 consensus_meta.cc:287] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.002s
I20260709 13:07:59.191067 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.193046 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:59.194235 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.198766 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:59.194445 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 79064.4us
I20260709 13:07:59.195170 20913 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.195374 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.207942 16561 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.133554 20852 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.196820 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.121835 20828 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.191480 16565 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:59.216197 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.216748 16633 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:07:59.176613 20870 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:07:59.166412 20551 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.203305 16558 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:59.195449 20919 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.242468 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.243124 16558 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:59.217195 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.217089 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.244151 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.244828 16565 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:59.201941 16562 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:07:59.221490 20900 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:07:59.221900 20905 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:59.265930 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 837) took 1719 ms. Trace:
W20260709 13:07:59.266839 20691 consensus_meta.cc:287] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.745s	user 0.006s	sys 0.001s
W20260709 13:07:59.206683 20705 consensus_meta.cc:287] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.713s	user 0.004s	sys 0.005s
I20260709 13:07:59.094270 20862 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.223641 20892 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:07:59.224756 20848 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:59.225507 20842 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.000s
I20260709 13:07:59.213757 20694 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:59.137339 20904 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:07:59.180732 20568 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:59.231066 16561 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:07:59.215716 20707 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.154534 20846 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.266307 17183 rpcz_store.cc:276] 0709 13:07:57.548041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.550599 (+  2558us) service_pool.cc:224] Handling call
0709 13:07:57.793013 (+242414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.062979 (+1269966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.265727 (+202748us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54004a6d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:59.265871 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907736320}
I20260709 13:07:59.270416 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.287715 16565 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.222551 20828 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.200829 20908 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.196610 16373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 98657.9us
I20260709 13:07:59.208630 20735 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.281607 20901 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:07:59.269460 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.215848 20882 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:59.277611 16562 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:07:59.217671 20913 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:59.283722 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 471760us
W20260709 13:07:59.285058 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.249183 20831 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.285972 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 92992.6us
W20260709 13:07:59.317157 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.319438 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.270004 20691 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.280695 20762 consensus_meta.cc:287] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.902s	user 0.001s	sys 0.007s
I20260709 13:07:59.321907 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.347591 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.349751 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.353333 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:59.373919 16562 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:07:59.374856 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.373445 16634 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 7.
I20260709 13:07:59.373162 16561 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:07:59.376816 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.377812 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:07:59.322047 20422 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.000s
I20260709 13:07:59.381273 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.375412 16562 raft_consensus.cc:2376] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10. Re-sending same reply.
I20260709 13:07:59.384276 16558 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 7: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:59.309074 20349 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.394644 16565 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:59.320819 20707 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.268023 20551 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.279232 20830 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.345459 20754 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.267560 20870 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.421056 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:59.352293 20735 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.430372 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.271382 20919 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.383486 20864 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.482790 20921 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.483428 20921 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.485091 20913 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.485455 20735 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.485844 20867 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:59.486485 20916 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:59.391613 20868 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.487483 20914 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.464896 16634 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:59.443245 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.460791 16561 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:07:59.462466 16558 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:59.427407 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.400413 20422 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.391381 20762 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.481083 16562 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:59.481769 20893 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.482237 20919 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.392136 20831 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.505149 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:59.493866 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2487) took 2207 ms. Trace:
I20260709 13:07:59.465268 16631 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:59.491895 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.492295 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:59.515954 17182 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:59.491720 20749 consensus_meta.cc:287] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.757s	user 0.003s	sys 0.003s
I20260709 13:07:59.471468 20830 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.509471 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.531292 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:07:59.532356 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.528043 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.534672 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.535174 16562 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
I20260709 13:07:59.536077 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.537079 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:07:59.537552 16562 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.523674 16557 rpcz_store.cc:276] 0709 13:07:57.286711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.374751 (+1088040us) service_pool.cc:224] Handling call
0709 13:07:58.393885 (+ 19134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.403069 (+  9184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.403100 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.422052 (+ 18952us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.633101 (+211049us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:58.633224 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.633422 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.493675 (+860253us) raft_consensus.cc:1685] finished
0709 13:07:59.493695 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.493807 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2952,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17108,"thread_start_us":176233,"threads_started":1,"wal-append.queue_time_us":377832}
I20260709 13:07:59.526166 16637 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:07:59.527619 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:59.529263 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:07:59.551999 20898 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.552479 20898 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:59.553069 20898 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.529958 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.554019 17182 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:07:59.554790 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.555972 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:59.475292 20899 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260709 13:07:59.493036 20845 consensus_meta.cc:287] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.758s	user 0.005s	sys 0.002s
I20260709 13:07:59.552452 16565 raft_consensus.cc:2410] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:07:59.471128 20918 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:59.555920 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.560077 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:59.483924 20907 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:59.473266 20924 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.558615 16640 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:59.485316 20923 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.492105 20920 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:07:59.524451 16639 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.012s	sys 0.000s
I20260709 13:07:59.564365 16565 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:59.556704 20838 consensus_meta.cc:287] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.000s
I20260709 13:07:59.432413 20842 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:07:59.472798 20915 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.474206 20870 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:59.477602 20709 consensus_meta.cc:287] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.605s	user 0.003s	sys 0.005s
I20260709 13:07:59.523738 20814 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:59.596546 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 223828us
I20260709 13:07:59.555735 20895 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.504944 20874 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:07:59.576419 16639 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.013s	sys 0.000s
I20260709 13:07:59.440433 20568 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.563265 20784 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.601729 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.601897 16562 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:59.604554 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.605659 16638 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:59.609736 17188 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:07:59.610502 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.573239 20923 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.619015 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.616101 17183 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 6.
I20260709 13:07:59.464246 20694 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.626806 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.592162 20852 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.628793 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.629691 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.636667 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.637297 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.637566 20927 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:59.638087 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:59.638187 16636 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:07:59.643528 20722 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.643709 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.644124 20722 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.645042 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:59.645761 20762 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.605316 20709 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.646991 16635 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.651691 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:07:59.652266 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:07:59.653252 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.653859 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:07:59.654953 16530 connection.cc:256] RPC call timeout handler was delayed by -2.02616720900005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:07:59.655416 16530 connection.cc:256] RPC call timeout handler was delayed by -1.8335672090000799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:07:59.655743 16530 connection.cc:256] RPC call timeout handler was delayed by -1.76336720900008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:07:59.656059 16530 connection.cc:256] RPC call timeout handler was delayed by -1.6949672090000831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 13:07:59.656392 16530 connection.cc:256] RPC call timeout handler was delayed by -1.6256672090000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:07:59.656680 16530 connection.cc:256] RPC call timeout handler was delayed by -1.6166672090000702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 13:07:59.656980 16530 connection.cc:256] RPC call timeout handler was delayed by -1.6139672090000658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260709 13:07:59.484576 20926 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
W20260709 13:07:59.657322 16530 connection.cc:256] RPC call timeout handler was delayed by -1.5455672090000689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 13:07:59.614178 20911 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:59.565382 20845 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:59.661129 16530 connection.cc:256] RPC call timeout handler was delayed by -1.4150672090000853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2319s for a response
I20260709 13:07:59.662704 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2494) took 1062 ms. Trace:
W20260709 13:07:59.666347 16530 connection.cc:256] RPC call timeout handler was delayed by -1.3691672090000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23700000000000002s for a response
I20260709 13:07:59.666476 16564 rpcz_store.cc:276] 0709 13:07:58.600473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.798112 (+197639us) service_pool.cc:224] Handling call
0709 13:07:58.798438 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.129734 (+331296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.129763 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.129801 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:59.129828 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.662475 (+532647us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000d48d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:59.662520 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.662641 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761479552}
I20260709 13:07:59.667060 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:59.621116 20923 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.590126 20838 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.638134 20927 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:59.675107 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:59.679642 20722 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.660485 20827 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.661906 20852 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:59.684757 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 81355.9us
I20260709 13:07:59.690177 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.690431 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.690835 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.691658 16484 raft_consensus.cc:2368] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:07:59.691756 16491 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:59.692185 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.692687 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.663816 20709 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:59.690979 16487 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:59.694571 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.695101 16484 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:07:59.693262 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.696108 16483 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:07:59.668685 20846 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:59.700889 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.700976 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:59.684389 20880 consensus_meta.cc:287] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.800s	user 0.005s	sys 0.009s
I20260709 13:07:59.702147 16489 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:07:59.707756 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.708033 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.710326 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:07:59.720259 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.710014 17183 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:59.747242 16485 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:07:59.750241 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:07:59.683115 20848 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:59.752445 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:07:59.755932 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 402639us
I20260709 13:07:59.754396 17152 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:07:59.753765 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.759032 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.686933 20691 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.693909 20852 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:07:59.763803 17180 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:59.755558 16483 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:07:59.770574 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.771175 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.771842 16485 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:07:59.777284 16632 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
W20260709 13:07:59.763774 20932 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:07:59.760154 20884 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.787642 20884 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.789516 20884 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.737703 20882 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:07:59.767783 20852 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.578421 20924 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.790448 20882 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.483834 20921 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.792531 20924 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.763567 20762 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:59.793232 20921 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.782649 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2440) took 1052 ms. Trace:
I20260709 13:07:59.763468 20883 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:59.787200 20829 consensus_meta.cc:287] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.030s	user 0.008s	sys 0.000s
I20260709 13:07:59.794540 16639 rpcz_store.cc:276] 0709 13:07:58.730166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.735753 (+  5587us) service_pool.cc:224] Handling call
0709 13:07:58.815370 (+ 79617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.815571 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:59.602636 (+787065us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.781903 (+179267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.781977 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:59.782335 (+   358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.782423 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.782577 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14433,"prepare.queue_time_us":435292,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":22,"raft.queue_time_us":14594,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":8331,"thread_start_us":950979,"threads_started":2}
I20260709 13:07:59.803118 20873 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.796478 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.798205 20883 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.785753 20927 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.763286 20848 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:07:59.782259 20422 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:59.349387 20908 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.766348 20846 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.578174 20920 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.800171 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:59.808112 20885 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.604832 20915 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.875016 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 116984us
W20260709 13:07:59.802652 20934 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:07:59.805124 20705 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.823047 20838 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:59.785903 20933 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:59.806190 20881 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.573688 20907 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:59.827200 20758 consensus_meta.cc:287] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 1.185s	user 0.003s	sys 0.003s
I20260709 13:07:59.860710 20921 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:59.860087 20829 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.809829 17188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 690) took 1554 ms (client timeout 2069 ms). Trace:
W20260709 13:07:59.893692 17188 rpcz_store.cc:269] 0709 13:07:58.255113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.255233 (+   120us) service_pool.cc:224] Handling call
0709 13:07:59.809677 (+1554444us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54003bddd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:59.809776 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683389184}
I20260709 13:07:59.487979 20914 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.819523 20800 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:07:59.801615 20802 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:07:56.141823 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.15.6.2:34831 (local address 127.0.0.1:60922)
0709 13:07:56.148147 (+  6324us) negotiation.cc:107] Waiting for socket to connect
0709 13:07:56.148212 (+    65us) client_negotiation.cc:175] Beginning negotiation
0709 13:07:56.148487 (+   275us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:07:59.418848 (+3270361us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.15.6.2:34831: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":5626,"thread_start_us":4912,"threads_started":1}
I20260709 13:07:59.815215 20446 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.817593 20517 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.813959 20707 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.826865 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2495) took 1226 ms. Trace:
I20260709 13:07:59.802409 16485 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.855964 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.908115 16566 rpcz_store.cc:276] 0709 13:07:58.600709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.728801 (+128092us) service_pool.cc:224] Handling call
0709 13:07:59.826704 (+1097903us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540032aad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:07:59.826816 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779490048}
I20260709 13:07:59.856809 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.859486 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.707952 20937 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:07:59.861565 16483 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:07:59.668040 20911 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.907981 20904 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.866052 20883 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.861052 20827 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:07:59.886978 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86874.7us
I20260709 13:07:59.914767 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:59.914534 20827 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.915172 20820 consensus_meta.cc:287] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.856s	user 0.001s	sys 0.007s
I20260709 13:07:59.916344 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:07:59.888079 16558 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
W20260709 13:07:59.889271 16532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.014s
W20260709 13:07:59.889906 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 133007us
W20260709 13:07:59.802095 20936 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:59.869930 20766 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.921249 20762 consensus_queue.cc:1059] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.922032 20947 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:59.922557 20914 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.923090 20914 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.891512 16564 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:59.923467 20940 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:07:59.800061 20842 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:07:59.900785 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.925472 16482 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:07:59.887784 20896 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.890697 20895 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.889119 20705 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.909910 20937 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:59.795827 20831 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:59.893280 20884 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.912674 15384 auto_leader_rebalancer.cc:438] leader transfer for tablet 8a89d28915e9486ba50f8fdafb99a037 from 035eaa2f12374a81a4df7868a5453d3c to f842280ae2ac4c68b0b7f6c093e27357 failed: Timed out: Client connection negotiation failed: client connection to 127.15.6.2:34831: received 0 of 4 requested bytes
I20260709 13:07:59.913203 20911 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.918497 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:07:59.919065 16532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.009s	sys 0.014s
I20260709 13:07:59.925350 20842 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.924897 20907 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.884754 20846 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:07:59.904971 20867 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.903560 20873 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.906041 20891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.019s	sys 0.014s
I20260709 13:07:59.919919 20893 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.925302 20845 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:59.954850 20846 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.955708 20852 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:07:59.957756 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.958956 20852 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.959475 16564 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:07:59.959967 16564 pending_rounds.cc:85] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 9
I20260709 13:07:59.960219 16564 pending_rounds.cc:107] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:59.960443 16564 raft_consensus.cc:2889] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:59.952773 20891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.019s	sys 0.014s
I20260709 13:07:59.963728 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.964799 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.965194 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.931901 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.931471 20707 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:07:59.933027 20705 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:07:59.933622 20884 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.935271 20895 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.968997 20884 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.951970 20949 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.970304 20949 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.935842 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2434) took 1255 ms. Trace:
I20260709 13:07:59.970932 16640 rpcz_store.cc:276] 0709 13:07:58.680122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.680286 (+   164us) service_pool.cc:224] Handling call
0709 13:07:58.680557 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.566593 (+886036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.935581 (+368988us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54002fc454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:07:59.935761 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018722176}
I20260709 13:07:59.938130 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.917361 16456 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:07:59.972313 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55022.7us
I20260709 13:07:59.931576 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.972929 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:07:59.917309 20915 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.915568 20820 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:07:59.943944 20902 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.854s	user 0.007s	sys 0.006s
I20260709 13:07:59.893046 20758 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:07:59.981530 20820 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.981967 20758 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:07:59.982414 20843 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.948601 17152 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:07:59.946141 20943 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:07:59.480446 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:60922 (local address 127.15.6.2:34831)
0709 13:07:59.798690 (+318244us) server_negotiation.cc:207] Beginning negotiation
0709 13:07:59.798727 (+    37us) server_negotiation.cc:400] Waiting for connection header
0709 13:07:59.798774 (+    47us) server_negotiation.cc:408] Connection header received
0709 13:07:59.798921 (+   147us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:07:59.798947 (+    26us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:07:59.799187 (+   240us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:07:59.801119 (+  1932us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60922: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":168786,"thread_start_us":116857,"threads_started":1}
I20260709 13:07:59.952899 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:07:59.965407 16489 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:07:59.970635 20949 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.939515 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:07:59.974129 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:07:59.997056 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.974291 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.997725 16491 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.977182 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:07:59.979501 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:07:59.969035 20895 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:07:59.923422 20914 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.930092 20937 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:07:59.937398 20898 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.974210 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:00.000731 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:00.006945 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:00.002676 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:00.003623 20422 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.999100 20867 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.939008 20848 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.988209 20904 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:00.014690 20904 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.015475 20904 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:00.016323 20957 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:00.016031 20895 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:00.017277 20707 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.017668 20707 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.018007 20707 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.007772 16484 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:00.019186 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:00.019910 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:00.020120 20829 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:00.020143 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:00.021018 20920 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:00.021140 16485 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.019932 16484 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:00.020867 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:00.022424 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:00.021224 20838 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.023244 17188 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.020433 16489 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.022646 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:00.002876 20852 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:00.032722 20908 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:00.026930 20828 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.036837 16482 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:00.038043 20707 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:07:59.976244 20873 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.003839 20914 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.028090 20852 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:00.041260 16486 raft_consensus.cc:2410] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:00.041786 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.066234 17188 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:00.051393 16485 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:00.067438 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:00.068241 16485 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:00.052539 16491 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:00.054603 16604 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:00.001402 20891 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.059569 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:00.095760 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 100126us
I20260709 13:08:00.060326 16487 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:08:00.096514 16487 pending_rounds.cc:85] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 7
I20260709 13:08:00.096932 16487 pending_rounds.cc:107] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:08:00.097189 16487 raft_consensus.cc:2889] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.098074 16482 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:00.047318 16489 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:00.067373 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:00.073884 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:00.099922 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:00.094985 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:00.067909 20852 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.101874 16489 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:00.103202 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:00.105144 16482 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:00.105162 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:00.100073 20568 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.095917 20910 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.108295 16489 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:00.098798 20754 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.109190 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:00.110219 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.095234 20867 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.111581 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.111759 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:00.112802 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.107100 20831 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.099865 20758 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:00.102885 20828 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:00.113915 17188 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:08:00.115348 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:00.117208 17186 raft_consensus.cc:2376] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9. Re-sending same reply.
I20260709 13:08:00.118208 17188 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:00.118613 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:00.108031 20829 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.106814 20904 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.132807 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:00.112753 20842 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:00.113672 20422 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.103896 20846 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:08:00.110872 20891 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.140111 20891 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.113832 20838 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:00.127898 20758 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.145641 20758 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:00.146139 20954 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:08:00.147259 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 576) took 1470 ms. Trace:
I20260709 13:08:00.055261 20937 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.134411 17188 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.116321 20831 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:00.104740 20747 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:00.156523 16635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2438) took 1426 ms. Trace:
I20260709 13:08:00.157488 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:00.116822 20848 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.151088 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:00.153538 16640 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.160986 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.147630 16488 rpcz_store.cc:276] 0709 13:07:58.676702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.680885 (+  4183us) service_pool.cc:224] Handling call
0709 13:07:58.687645 (+  6760us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:59.098570 (+410925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.098629 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:59.804711 (+706082us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:07:59.805182 (+   471us) log.cc:844] Serialized 52 byte log entry
0709 13:07:59.898928 (+ 93746us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:59.900477 (+  1549us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.906707 (+  6230us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.906893 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.906961 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.145629 (+238668us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:00.147067 (+  1438us) raft_consensus.cc:1685] finished
0709 13:08:00.147085 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.147207 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103892,"prepare.queue_time_us":1533,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":227178,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":21973,"spinlock_wait_cycles":77008896,"thread_start_us":330208,"threads_started":2,"wal-append.queue_time_us":93719}
I20260709 13:08:00.147094 20883 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.159368 20831 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.114908 20754 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.163928 16488 pending_rounds.cc:85] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:08:00.164212 16488 pending_rounds.cc:107] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:08:00.155867 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:00.164647 16634 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.156968 16635 rpcz_store.cc:276] 0709 13:07:58.729629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.729801 (+   172us) service_pool.cc:224] Handling call
0709 13:07:58.744101 (+ 14300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.647328 (+903227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.156310 (+508982us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540015d454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:00.156467 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076003584}
I20260709 13:08:00.164309 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.158895 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:00.165691 16631 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:00.132460 20829 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.155186 16638 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.166111 16488 raft_consensus.cc:2889] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.114085 20910 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.137779 20422 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.120206 20568 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:08:00.167943 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.134832 20828 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:00.124047 20923 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.127692 20868 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:00.172472 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.179039 17188 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:00.182590 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:00.151845 20898 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:00.190917 20862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.006s	sys 0.006s
W20260709 13:08:00.191325 20862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.006s	sys 0.006s
I20260709 13:08:00.196780 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.194589 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.200850 16635 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:08:00.201064 20910 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:00.176110 20829 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.203194 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:00.204284 20707 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:00.204541 20966 log.cc:927] Time spent T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:00.196491 20755 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.205369 20755 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.206176 20755 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:00.194278 20960 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:08:00.172005 20848 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:00.209936 20848 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.214918 20828 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.136530 20904 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.159595 20758 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:00.216521 20758 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:00.216847 20758 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.217558 20758 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.217906 20873 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:00.164402 20949 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.218669 20758 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.176313 20422 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.221643 16633 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.152463 20446 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:00.221892 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.226420 16635 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:00.222498 16484 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:00.194449 20800 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.231380 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.213430 20914 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.180918 20950 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:00.236578 16633 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:00.239918 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:00.313499 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.377636 16636 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:00.474355 16482 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:08:00.494958 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.239964 20950 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:00.499017 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.500571 16633 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:00.501892 20963 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:08:00.502975 20914 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:00.506629 16634 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:00.489802 20949 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:00.506728 20965 log.cc:927] Time spent T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:08:00.519550 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.524978 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.529227 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:00.529989 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:00.530112 16484 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.530601 16634 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
W20260709 13:08:00.548377 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:00.550661 16489 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:00.569083 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:00.564689 16636 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:00.564458 16484 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:00.572552 16378 maintenance_manager.cc:419] P 424acc41090849a586f609f5c6254e5b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033354
W20260709 13:08:00.558952 20967 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:08:00.580542 16633 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:00.558290 20923 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:00.538353 20831 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.593268 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:00.593953 16632 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.596546 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:00.598124 20969 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:00.528851 20950 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.599313 20950 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.604001 20923 consensus_queue.cc:1059] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:00.604454 20953 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.604605 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:00.605396 20854 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:00.606058 20968 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:00.614138 20931 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.605998 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:00.615685 16455 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:00.616361 20910 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.616734 20910 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.617038 20910 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.618266 20884 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.618785 20884 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.619585 20884 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.620618 20864 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:00.621117 20864 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.623000 20864 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:00.623210 20923 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:00.623605 20923 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.623624 20349 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:00.614670 20931 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.625625 20735 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:00.626152 20735 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.626507 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2500) took 1446 ms. Trace:
I20260709 13:08:00.627084 20931 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:00.628008 20874 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.628475 20874 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:00.628016 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 960942us
I20260709 13:08:00.626876 16563 rpcz_store.cc:276] 0709 13:07:59.180379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.195869 (+ 15490us) service_pool.cc:224] Handling call
0709 13:07:59.196130 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.196326 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:59.427073 (+230747us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.923004 (+495931us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:00.626172 (+703168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.626222 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:00.626282 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.626339 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.626451 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1027816,"prepare.queue_time_us":248021,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":8925,"raft.queue_time_us":1029032,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":61,"spinlock_wait_cycles":65045248,"thread_start_us":381448,"threads_started":2,"wal-append.queue_time_us":257155}
I20260709 13:08:00.629962 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:00.624749 20895 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:00.628808 20874 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.656296 16485 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:00.644383 16632 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:00.650537 20914 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:00.623559 20913 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.629089 20921 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:08:00.660516 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 550) took 1211 ms. Trace:
I20260709 13:08:00.658911 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:00.663225 16485 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:00.665720 16560 rpcz_store.cc:276] 0709 13:07:59.448856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.924699 (+475843us) service_pool.cc:224] Handling call
0709 13:07:59.924990 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.660184 (+735194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.660212 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.660250 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:00.660296 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.660356 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.660462 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734898,"raft.queue_time_us":735775,"spinlock_wait_cycles":7066496}
I20260709 13:08:00.657635 20854 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:08:00.664356 20914 consensus_queue.cc:1243] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:00.670758 20953 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.664137 20735 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:00.671247 20953 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.672093 20953 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.627104 20829 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.678901 20829 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:00.679613 16639 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:00.680696 20831 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:00.640908 20446 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:00.653043 20895 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.682410 20895 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.683529 20895 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.688098 20551 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:00.622906 20422 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.694978 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:00.708338 16485 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:00.706374 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.711601 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.712208 16558 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.714043 16563 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:00.716817 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 86954.5us
I20260709 13:08:00.718246 16530 leader_election.cc:400] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:00.718536 16530 leader_election.cc:403] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.719462 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.721436 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:00.721746 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.681593 20446 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:00.624778 20923 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:00.689746 20974 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:08:00.724414 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.644789 20349 consensus_queue.cc:1059] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:08:00.663738 20907 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.724609 16558 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:00.757647 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.758219 16558 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.726660 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.727515 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.729611 17184 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:00.730500 16604 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:00.730727 16485 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:00.690375 20913 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:00.732582 20852 consensus_meta.cc:287] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.000s
I20260709 13:08:00.681530 20910 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.725955 20446 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.740442 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:00.799899 17188 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:00.742452 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.743053 16560 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:00.743750 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.747054 16638 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:08:00.767259 17153 leader_election.cc:336] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.654s (SENT)
I20260709 13:08:00.793525 20915 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.809782 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.810352 16563 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.757686 20864 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:00.818718 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 100580us
I20260709 13:08:00.768193 16558 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:00.771907 17181 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:08:00.797024 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 66598us
I20260709 13:08:00.792517 20848 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.831887 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.832545 16558 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:00.833088 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:00.830390 16560 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:00.833494 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:00.834393 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.798208 20950 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:00.840389 16563 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:00.843425 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.844018 16560 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.814430 20757 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:00.846413 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2497) took 2245 ms. Trace:
I20260709 13:08:00.850878 16560 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:00.793319 20907 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.811254 20923 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.799700 20852 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.842756 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.857511 16563 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:00.858659 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.859635 16563 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:00.852936 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.816519 20931 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:00.850291 16559 rpcz_store.cc:276] 0709 13:07:58.601203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.800895 (+199692us) service_pool.cc:224] Handling call
0709 13:07:58.831343 (+ 30448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.831544 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:59.271509 (+439965us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.613685 (+1342176us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b180000c1c0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f0636483060 00007f0636495716 00007f06364a6287 00007f06364a6208
0709 13:08:00.846072 (+232387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.846123 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:00.846188 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.846254 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.846357 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5716,"prepare.queue_time_us":581316,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":1195823,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":11708160,"thread_start_us":798783,"threads_started":3,"wal-append.queue_time_us":291151,"wal-append.run_cpu_time_us":1905,"wal-append.run_wall_time_us":1225998}
I20260709 13:08:00.845640 20939 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.852774 20757 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:00.860502 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.863584 16558 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:00.814565 20935 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:00.867923 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.835738 20874 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.867210 16563 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.868527 16530 leader_election.cc:400] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:08:00.871696 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.846290 20950 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:00.873157 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.876626 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.876786 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:00.878540 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:00.879585 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.880333 16560 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:00.853521 20446 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:00.880842 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.882730 16563 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:00.883260 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.887192 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.888742 16563 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:00.874245 20691 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:00.933847 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.934867 17180 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:00.935525 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 57057.8us
I20260709 13:08:00.936340 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:00.947098 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:00.948822 16563 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.881233 20939 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.950121 16563 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:00.949995 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:00.950626 17188 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.948700 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.955566 17188 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:08:00.956782 16563 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.959383 16560 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:00.961663 16560 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.962182 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1460) took 1272 ms. Trace:
I20260709 13:08:00.962546 16486 rpcz_store.cc:276] 0709 13:07:59.689554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.690911 (+  1357us) service_pool.cc:224] Handling call
0709 13:08:00.962018 (+1271107us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400289e54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:00.962127 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762985344}
I20260709 13:08:00.965292 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:00.949277 20976 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:08:00.949388 20977 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:00.925100 20891 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:00.976300 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:00.902784 20883 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:00.889959 20931 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:00.971419 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.891920 20422 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:00.976538 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2212) took 1761 ms. Trace:
I20260709 13:08:00.969496 16530 leader_election.cc:400] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:08:00.949266 20446 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.994045 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:00.998466 17180 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:00.997408 16530 leader_election.cc:403] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.999747 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:00.966152 20935 raft_consensus.cc:2764] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:08:01.039844 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2220) took 1820 ms. Trace:
I20260709 13:08:01.040222 16566 rpcz_store.cc:276] 0709 13:07:59.219381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.909008 (+689627us) service_pool.cc:224] Handling call
0709 13:07:59.910855 (+  1847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.658324 (+747469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.658352 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.690191 (+ 31839us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.879396 (+189205us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:00.879436 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.879494 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.039621 (+160127us) raft_consensus.cc:1685] finished
0709 13:08:01.039640 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.039771 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":747130,"raft.queue_time_us":748785,"spinlock_wait_cycles":4793728,"thread_start_us":140124,"threads_started":1,"wal-append.queue_time_us":182413}
I20260709 13:08:01.041810 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.042793 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:01.000780 16563 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:01.001888 17188 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.982439 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.000506 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:01.005844 20885 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11.
I20260709 13:08:01.007539 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2219) took 1788 ms. Trace:
I20260709 13:08:01.008028 20939 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.010017 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2215) took 1791 ms. Trace:
W20260709 13:08:01.011143 20983 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:08:01.011869 20955 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.112s	user 0.013s	sys 0.004s
I20260709 13:08:01.012343 20705 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:01.076004 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 93621.5us
I20260709 13:08:01.076772 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:01.013145 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.002193 20953 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.013526 20766 raft_consensus.cc:3055] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:01.087970 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.082249 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:01.020085 20931 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:01.020635 20754 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:01.078893 20953 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.096154 20953 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.096462 20868 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:01.028329 20981 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:01.031315 20910 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:01.032209 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2212) took 1175 ms. Trace:
I20260709 13:08:01.032543 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2227) took 1171 ms. Trace:
I20260709 13:08:01.032673 20842 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.033399 20874 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:01.033286 20827 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:01.038781 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 213935us
W20260709 13:08:01.039265 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 101612us
I20260709 13:08:00.997298 16565 rpcz_store.cc:276] 0709 13:07:59.214814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.575005 (+360191us) service_pool.cc:224] Handling call
0709 13:07:59.575291 (+   286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:00.623964 (+1048673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.623993 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:00.624562 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:08:00.854816 (+230254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:00.854854 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.854916 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.976336 (+121420us) raft_consensus.cc:1685] finished
0709 13:08:00.976354 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.976484 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1048320,"raft.queue_time_us":1049518,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":229889,"threads_started":1,"wal-append.queue_time_us":270201}
I20260709 13:08:01.107833 17180 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:01.067085 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.108474 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.108528 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:00.975963 20951 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:08:01.046790 16566 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:08:01.069936 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 69493.9us
I20260709 13:08:01.113538 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:01.070281 16562 rpcz_store.cc:276] 0709 13:07:59.218255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.636988 (+418733us) service_pool.cc:224] Handling call
0709 13:07:59.664862 (+ 27874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.628257 (+963395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.628286 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.628715 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.876015 (+247300us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:00.876053 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.876115 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.009840 (+133725us) raft_consensus.cc:1685] finished
0709 13:08:01.009858 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.009965 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1026945,"raft.queue_time_us":971888,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1195,"thread_start_us":247047,"threads_started":1,"wal-append.queue_time_us":379688}
I20260709 13:08:01.113649 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:00.997556 20913 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:01.014379 20982 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:01.120070 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:01.120263 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:01.121353 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:01.122182 20944 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.122577 20944 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.122918 20944 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.071638 16561 rpcz_store.cc:276] 0709 13:07:59.219167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.819511 (+600344us) service_pool.cc:224] Handling call
0709 13:07:59.819929 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.652311 (+832382us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:00.859721 (+207410us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.964036 (+104315us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.968474 (+  4438us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.969669 (+  1195us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:00.969695 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.969736 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.007345 (+ 37609us) raft_consensus.cc:1685] finished
0709 13:08:01.007364 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.007481 (+   117us) inbound_call.cc:177] Queueing success response
0709 13:08:01.030495 (+ 23014us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b18001f3a20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
Metrics: {"mutex_wait_us":839920,"prepare.queue_time_us":266579,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":843849,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":7200,"spinlock_wait_cycles":13054720,"thread_start_us":281775,"threads_started":2,"wal-append.queue_time_us":137592}
I20260709 13:08:01.094476 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.100050 16487 rpcz_store.cc:276] 0709 13:07:59.856768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.857253 (+   485us) service_pool.cc:224] Handling call
0709 13:07:59.857505 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.097623 (+240118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.031971 (+934348us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002981d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:01.032148 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455448320}
I20260709 13:08:01.103286 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:01.104090 17187 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:01.100157 16488 rpcz_store.cc:276] 0709 13:07:59.861185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.163473 (+302288us) service_pool.cc:224] Handling call
0709 13:08:00.163732 (+   259us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:00.168012 (+  4280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.168041 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:00.168512 (+   471us) log.cc:844] Serialized 52 byte log entry
0709 13:08:00.579274 (+410762us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:00.579313 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.579379 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.032348 (+452969us) raft_consensus.cc:1685] finished
0709 13:08:01.032366 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.032488 (+   122us) inbound_call.cc:177] Queueing success response
0709 13:08:01.034991 (+  2503us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b48001a0658. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063b3b4aa1 00007f063b3abb37 00007f063b3ab9ca 00007f063b4a326f 00007f063b4a2f37 00007f063b4b755c 00007f063b4b7508 00007f063b4b7488 00007f063b4b7443 00007f063b4b66ec 00007f063a3e0a96
Metrics: {"mutex_wait_us":1187,"raft.queue_time_us":1283,"raft.run_cpu_time_us":10569,"raft.run_wall_time_us":865602,"spinlock_wait_cycles":27219840,"thread_start_us":348517,"threads_started":1,"wal-append.queue_time_us":587357}
I20260709 13:08:00.895720 20757 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.096222 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:01.125831 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:01.136202 17187 pending_rounds.cc:85] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 8
I20260709 13:08:00.996585 20831 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.136605 17187 pending_rounds.cc:107] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:01.107925 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:01.126415 17179 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:01.126399 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.114526 16565 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:01.117074 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.117583 20868 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:01.118448 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.136922 17187 raft_consensus.cc:2889] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.140354 16562 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.075307 20917 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.045009 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:01.137691 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:01.142167 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.131174 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.094998 20873 raft_consensus.cc:2764] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:01.112546 16603 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:01.129540 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.142230 16565 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:01.074447 20705 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:01.073259 20939 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:01.139374 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.102125 20842 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:01.169021 16564 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:01.170204 16564 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.958595 20691 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.044979 20907 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:01.145392 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 542) took 1933 ms. Trace:
I20260709 13:08:01.177057 16557 rpcz_store.cc:276] 0709 13:07:59.212326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.554532 (+342206us) service_pool.cc:224] Handling call
0709 13:07:59.986681 (+432149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.986835 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.986859 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.986889 (+    30us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:59.986906 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.986940 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.145214 (+1158274us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540006d1d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:01.145319 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993137024}
I20260709 13:08:01.178155 20915 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:01.178364 16557 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:01.178751 16557 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:01.104192 20766 raft_consensus.cc:740] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:01.179371 16557 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:01.165230 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 70839.3us
I20260709 13:08:01.180529 20971 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:01.181419 20931 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:01.182330 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.072400 20985 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:08:01.183255 20985 consensus_queue.cc:1243] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:01.164372 20757 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.183768 20985 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:01.184224 20985 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:01.184641 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2240) took 1037 ms. Trace:
I20260709 13:08:01.184940 20985 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.186228 20985 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.188786 16558 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:01.189213 20848 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.189625 20848 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:01.189968 20848 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.190352 20828 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:01.190876 20828 raft_consensus.cc:697] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:01.191624 20828 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.103922 20551 consensus_queue.cc:1059] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:08:01.184993 16489 rpcz_store.cc:276] 0709 13:08:00.147534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.567307 (+419773us) service_pool.cc:224] Handling call
0709 13:08:00.567562 (+   255us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:00.569042 (+  1480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.569070 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:00.569587 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 13:08:00.831585 (+261998us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:00.831628 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.831696 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.184451 (+352755us) raft_consensus.cc:1685] finished
0709 13:08:01.184471 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.184593 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4392,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1164,"thread_start_us":239392,"threads_started":1,"wal-append.queue_time_us":294443}
I20260709 13:08:01.194250 20854 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.183106 20944 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.194005 20842 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.195267 20842 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.196403 16557 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.143983 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:01.111714 20827 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:01.174727 16563 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:01.165541 20939 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.182454 20937 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.138556 20852 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:01.170258 16565 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.073421 20891 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.208554 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.159268 20874 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.217880 16562 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:08:01.142375 20882 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.145008 20709 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:01.111358 20800 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:08:01.249115 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:01.249552 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 105646us
I20260709 13:08:01.255292 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:01.258553 16557 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:08:01.258890 16557 pending_rounds.cc:85] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 10
I20260709 13:08:01.259094 16557 pending_rounds.cc:107] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:08:01.259307 16557 raft_consensus.cc:2889] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:01.250211 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.162508 20913 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.143394 20917 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:01.167325 20349 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.253525 16563 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:01.172735 20950 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:01.212782 20944 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:01.256021 20907 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:01.274189 20814 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:01.268090 20862 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:01.269627 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.270709 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:01.271719 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:01.295068 16557 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:01.173158 20758 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.277660 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:01.251689 20854 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.262617 20913 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:01.281991 20895 consensus_meta.cc:287] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 13:08:01.172400 20868 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:08:01.265118 20917 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.295099 16562 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:01.275846 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.298214 16565 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:01.251519 20874 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:01.274659 20885 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.254587 20882 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:01.157761 20831 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.275022 20709 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:01.301546 20758 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.316563 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.325193 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.325906 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:01.326691 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:01.326797 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.326984 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:01.327711 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:01.328619 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:01.329813 16490 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:01.330710 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:01.331763 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:01.334009 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 195834us
I20260709 13:08:01.276242 20754 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.337108 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.278393 20852 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:08:01.299841 20907 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:01.310880 20913 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:01.467973 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 130927us
I20260709 13:08:01.323556 20910 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.469759 16487 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:08:01.470819 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.471546 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:01.334892 20874 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.473964 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:01.518433 16566 raft_consensus.cc:2368] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8.
I20260709 13:08:01.470108 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:01.469026 20944 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.479274 17184 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:01.479234 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.478251 20907 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.484133 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:01.472477 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 155984us
I20260709 13:08:01.309263 20862 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:01.276202 20705 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:01.524199 20864 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.491389 20904 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:01.467530 20758 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.498102 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:01.505594 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:01.512042 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:01.514290 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.484213 20881 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:08:01.519119 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 49061us
I20260709 13:08:01.469179 16557 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:01.476902 20895 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:01.522804 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 43651.1us
I20260709 13:08:01.559546 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.560596 16557 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:01.560758 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.447664 20882 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.523031 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:01.523849 20422 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:01.538296 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.523978 20709 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:01.489384 20921 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.539633 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:01.565871 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.566295 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:01.538528 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 400863us
I20260709 13:08:01.524124 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:01.566996 16638 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:01.540877 16487 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.541051 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.309021 20827 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.542439 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.533252 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.572156 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.544317 20705 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.546670 20953 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.550403 20939 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:01.555648 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.556053 16563 raft_consensus.cc:2410] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:01.579389 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:01.582664 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.584437 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:01.586066 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.562649 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.565712 16485 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:01.566442 16639 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:01.540011 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 427490us
I20260709 13:08:01.568080 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:01.567133 16565 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:01.568856 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.569190 16640 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.592115 16640 raft_consensus.cc:1240] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:01.572402 16637 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:01.596513 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.566125 20944 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:01.564774 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 468589us
I20260709 13:08:01.579283 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.585867 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.574090 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.588951 16631 pending_rounds.cc:85] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 5
I20260709 13:08:01.604581 16631 pending_rounds.cc:107] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:08:01.586843 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:01.604869 16631 raft_consensus.cc:2889] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.606456 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.606594 16632 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:08:01.571902 20763 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.572083 20691 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:01.579972 20910 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.609090 16488 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:01.572921 20921 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:01.573410 20864 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.597911 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:01.637006 16638 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.610535 16484 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.611711 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.612336 20951 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.612752 20814 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.618621 20848 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.542951 20766 consensus_queue.cc:260] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:01.623962 20996 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:08:01.625403 20939 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:01.563512 20838 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:01.606006 20997 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:01.634843 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.563299 20829 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:01.643887 16639 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:01.635977 20827 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.608063 20891 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:01.647882 20944 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.660440 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.606707 20985 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:01.666612 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:01.685949 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 81657.8us
I20260709 13:08:01.687177 16488 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:01.668771 16633 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 13: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:08:01.672106 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 198046us
I20260709 13:08:01.688350 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:01.688278 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.676296 16639 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:01.637140 20895 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:08:01.657925 20923 consensus_meta.cc:287] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.802s	user 0.009s	sys 0.000s
I20260709 13:08:01.636849 20757 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:01.689224 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:01.610901 20904 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.690205 16488 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.696851 20949 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:01.697386 16559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:01.742754 20904 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.743237 16559 raft_consensus.cc:606] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.743602 16559 raft_consensus.cc:614] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:01.664464 20766 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.711431 16557 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:01.745868 16557 pending_rounds.cc:85] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 10
I20260709 13:08:01.746101 16557 pending_rounds.cc:107] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:01.746325 16557 raft_consensus.cc:2889] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.646198 20854 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:01.678460 16638 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:08:01.665864 20910 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.669265 20422 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:01.733222 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 83545.6us
I20260709 13:08:01.689462 20893 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:01.756086 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.739240 16482 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
W20260709 13:08:01.739202 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 50040.7us
I20260709 13:08:01.658936 20735 consensus_queue.cc:1059] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:08:01.684326 20755 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.740664 20999 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.749956 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:01.737576 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.757474 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.766201 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:01.739778 20864 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:01.689631 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:01.767524 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:01.784466 17153 leader_election.cc:400] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8.
I20260709 13:08:01.784731 17153 leader_election.cc:403] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:01.756736 16639 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
W20260709 13:08:01.772845 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.775125 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.786610 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:01.680740 20997 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.742870 20949 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:01.787731 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.840385 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56038.3us
I20260709 13:08:01.841702 17153 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:01.842762 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 56218.2us
I20260709 13:08:01.844242 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:01.776098 20937 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.002s
I20260709 13:08:01.761416 20757 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:08:01.784734 20998 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.859612 16559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:01.923597 16559 raft_consensus.cc:606] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:01.924160 16559 raft_consensus.cc:614] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:01.788492 20691 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:01.925024 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 237686us
I20260709 13:08:01.789294 20931 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:01.845530 20949 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.761619 20893 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:01.849622 20939 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.935526 16565 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:01.849886 20551 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 7. Current term is 8.
I20260709 13:08:01.934010 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:01.789057 16373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 104690us
I20260709 13:08:01.789958 20747 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.953740 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:01.783151 20846 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.958565 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:01.784979 20735 consensus_queue.cc:1243] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:01.852119 20950 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:08:01.857405 20999 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:01.926993 20971 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.970427 16487 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:01.970577 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:01.922888 20895 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.986363 16639 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:01.860359 20985 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:01.959419 20953 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:02.004169 20985 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:01.984896 20937 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:02.008831 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 74910.9us
I20260709 13:08:02.013356 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:01.984207 20831 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:01.989771 20848 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:01.927712 20422 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:01.986871 20864 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:01.970214 21012 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:08:02.029098 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 187447us
I20260709 13:08:02.017021 20937 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:02.036118 20882 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.007318 20895 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.044004 16565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecb26c2b33364a6583c0073862883947"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
W20260709 13:08:02.029017 21007 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:08:02.055096 16565 raft_consensus.cc:606] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:02.056324 17188 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:02.005932 20971 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:02.033460 21006 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:08:02.061697 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:02.067346 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:02.058339 16565 raft_consensus.cc:614] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:02.083600 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:02.084093 21009 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:08:02.084265 16559 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:02.085259 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.072278 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:02.086292 16561 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:02.087524 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 74263.1us
I20260709 13:08:02.087423 20842 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.087747 20838 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:02.088727 20942 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.088884 20838 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:02.089237 20942 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:02.089924 20917 consensus_meta.cc:287] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.000s
I20260709 13:08:02.089753 20838 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.090322 20917 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.091279 16560 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:02.094826 20349 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.818s	user 0.005s	sys 0.001s
I20260709 13:08:02.095736 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:02.096197 20913 consensus_meta.cc:287] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.000s
I20260709 13:08:02.096690 20349 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.096588 20913 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.097579 20895 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:02.061748 20831 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:02.098572 20913 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.098753 20831 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:02.099159 20831 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:02.097852 16561 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:02.099973 20831 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.100430 20997 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.101111 20831 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:02.105553 20874 consensus_meta.cc:287] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.001s
I20260709 13:08:02.109432 20883 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.130200 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2223) took 2271 ms. Trace:
I20260709 13:08:02.131721 17180 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:02.109866 21022 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:02.110433 20885 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.663s	user 0.000s	sys 0.006s
I20260709 13:08:02.111621 20917 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.111765 20893 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:02.114367 20998 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.116323 20942 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.088274 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:02.117385 16566 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:02.057228 21008 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:08:02.118462 20985 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.118949 20949 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.146437 20949 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.135396 20883 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.150058 20883 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:02.151320 20705 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.002s
I20260709 13:08:02.151998 16636 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:02.132115 20349 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.120167 20882 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:02.086256 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:02.122648 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55387.1us
I20260709 13:08:02.100443 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.130570 16483 rpcz_store.cc:276] 0709 13:07:59.858806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.166511 (+307705us) service_pool.cc:224] Handling call
0709 13:08:00.166762 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.168712 (+  1950us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:00.193350 (+ 24638us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.191973 (+998623us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b180036c1c0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:08:01.564050 (+372077us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.565170 (+  1120us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.565308 (+   138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:01.567490 (+  2182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.567550 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.123129 (+555579us) raft_consensus.cc:1685] finished
0709 13:08:02.130010 (+  6881us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.130142 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1601,"prepare.queue_time_us":27252,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":5675,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":24828,"spinlock_wait_cycles":2695936,"thread_start_us":371149,"threads_started":1,"wal-append.queue_time_us":1472589}
W20260709 13:08:02.109640 20758 consensus_meta.cc:287] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.545s	user 0.003s	sys 0.004s
I20260709 13:08:02.047691 20937 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.111924 21029 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:08:02.083643 21011 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:08:02.136752 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:02.164170 17187 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:02.141021 16566 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:02.139443 20885 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.119840 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:02.158977 17186 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:02.159811 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 71603.2us
I20260709 13:08:02.165740 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:02.166146 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:02.160272 20880 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:02.169332 17188 raft_consensus.cc:2393] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:02.133509 20874 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.155346 20349 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:02.170635 20907 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.608s	user 0.006s	sys 0.003s
I20260709 13:08:02.182436 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:02.184828 17188 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:08:02.167145 21022 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.184257 16635 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.171756 20998 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.161942 20942 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:02.158314 20758 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.162217 20446 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:02.182255 20349 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.190033 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 708) took 1086 ms. Trace:
I20260709 13:08:02.180164 21030 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:02.200938 20862 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.202309 20874 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.203207 20971 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:02.187378 20907 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.209137 20907 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.162978 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:02.250289 16564 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.251325 16491 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:02.257644 16563 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:08:02.257520 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.258880 16559 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:02.263129 16565 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 13:08:02.168032 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:02.174875 16566 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:02.265420 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.265635 16566 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.266755 20758 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:02.249882 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86763us
I20260709 13:08:02.267725 20758 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.278681 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55186 (request call id 2530) took 1403 ms. Trace:
I20260709 13:08:02.279245 16558 rpcz_store.cc:276] 0709 13:08:00.875140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.880636 (+  5496us) service_pool.cc:224] Handling call
0709 13:08:02.278226 (+1397590us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400116f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:02.278468 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704344960}
I20260709 13:08:02.288751 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48048 (request call id 707) took 1185 ms. Trace:
I20260709 13:08:02.289218 17184 rpcz_store.cc:276] 0709 13:08:01.102904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.103076 (+   172us) service_pool.cc:224] Handling call
0709 13:08:02.288279 (+1185203us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54004a6d54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:02.288482 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789005568}
I20260709 13:08:02.193009 17182 rpcz_store.cc:276] 0709 13:08:01.103167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.103272 (+   105us) service_pool.cc:224] Handling call
0709 13:08:01.121426 (+ 18154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.300992 (+179566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.301021 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.301444 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.655362 (+353918us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:01.655396 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.655459 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.189849 (+534390us) raft_consensus.cc:1685] finished
0709 13:08:02.189868 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.189977 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58647,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":48,"thread_start_us":389124,"threads_started":2,"wal-append.queue_time_us":362530}
I20260709 13:08:02.299307 17181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 612) took 1321 ms. Trace:
I20260709 13:08:02.299845 17181 rpcz_store.cc:276] 0709 13:08:00.977889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.978002 (+   113us) service_pool.cc:224] Handling call
0709 13:08:00.978205 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.978477 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.978492 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.978782 (+   290us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.511262 (+532480us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b18003fa180. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b0d1 00007f0636446a0f
0709 13:08:01.669414 (+158152us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:01.669451 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.669510 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.192566 (+523056us) raft_consensus.cc:1685] finished
0709 13:08:02.192584 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.298994 (+106410us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":20876,"spinlock_wait_cycles":133631232,"thread_start_us":157955,"threads_started":1,"wal-append.queue_time_us":748546}
W20260709 13:08:02.204056 20827 consensus_meta.cc:287] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:08:02.306602 16603 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:02.344498 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.331458 20758 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:02.346423 20758 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.347517 20517 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:02.348016 20517 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:02.349478 20517 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.346436 20921 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.364025 21018 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:02.364749 21018 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.366778 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:02.367723 16487 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:02.368856 16482 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:08:02.370241 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 202177us
I20260709 13:08:02.370421 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:02.372836 16483 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:02.374938 21024 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.375535 21024 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:02.376717 21024 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.380056 21030 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:02.381413 21030 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.371538 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:02.371493 16485 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
W20260709 13:08:02.391892 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 85779.4us
W20260709 13:08:02.341403 21014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.011s
I20260709 13:08:02.412210 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:02.422108 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1483) took 1090 ms. Trace:
I20260709 13:08:02.422293 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2241) took 1345 ms. Trace:
I20260709 13:08:02.422792 16564 rpcz_store.cc:276] 0709 13:08:01.077231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.171011 (+ 93780us) service_pool.cc:224] Handling call
0709 13:08:01.171247 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.251249 (+1080002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.421956 (+170707us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400019854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:02.422207 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479895808}
I20260709 13:08:02.433764 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.434753 16559 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:02.435998 16563 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:02.444957 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 73682.7us
I20260709 13:08:02.445397 16456 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:02.448164 20422 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:02.448827 20422 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:02.449508 17152 leader_election.cc:336] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.654s (SENT)
I20260709 13:08:02.450037 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:02.426282 21014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.006s	sys 0.011s
I20260709 13:08:02.422662 16491 rpcz_store.cc:276] 0709 13:08:01.331444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.331557 (+   113us) service_pool.cc:224] Handling call
0709 13:08:02.412846 (+1081289us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400289454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:02.422019 (+  9173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800385280}
I20260709 13:08:02.435675 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.455389 16562 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:02.456014 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:02.473450 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:02.477451 21018 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:02.480343 16559 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:02.482681 20829 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.483146 20829 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:02.484047 20937 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.484472 20829 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.486107 20829 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.486406 20937 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:02.487334 20827 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.488917 20921 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.489428 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:02.491910 20757 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.492339 20757 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.492687 20757 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.494331 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:02.495584 21002 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.496078 21002 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.496426 21002 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.501909 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:02.503615 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:02.496482 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.474823 16566 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:02.492619 20944 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:02.508251 20944 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:02.509241 16639 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.496320 17182 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.513787 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:02.511428 16566 pending_rounds.cc:85] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 5
I20260709 13:08:02.516736 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.517946 16632 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:02.449923 20422 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.509688 20944 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.466022 20446 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:08:02.523649 16563 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:02.539160 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:02.540505 20864 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.541216 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:02.531280 16566 pending_rounds.cc:107] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:02.544301 16566 raft_consensus.cc:2889] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.547031 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:02.525576 20944 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:02.552501 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 104749us
I20260709 13:08:02.554543 20831 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.554991 20831 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.564100 20874 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.564720 20874 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.567222 20874 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.567917 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:02.569084 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.553274 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:02.573173 20998 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.573588 20998 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.573917 20998 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.573935 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 563) took 1246 ms. Trace:
I20260709 13:08:02.574659 16562 rpcz_store.cc:276] 0709 13:08:01.327425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.482651 (+155226us) service_pool.cc:224] Handling call
0709 13:08:02.573731 (+1091080us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54000d48d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:02.573874 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449392896}
I20260709 13:08:02.577817 16605 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:02.578684 21004 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.579211 21004 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.579977 16485 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.581075 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 592) took 1499 ms. Trace:
I20260709 13:08:02.581426 21004 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:02.583971 20971 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:02.585203 21001 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.585716 21001 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:02.586197 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:02.587514 20939 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.587983 20939 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.588114 20848 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.589112 20848 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.589464 20848 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:02.555359 20985 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.553146 21018 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.590497 20848 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.592204 20349 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.594252 20349 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.539297 20904 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.595315 20904 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.588443 20939 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.597632 20904 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.590435 20985 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.600858 20985 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.585372 20971 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.601642 20971 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:02.602687 20971 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.608839 20827 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:02.607482 20848 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.610498 20827 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:02.610853 20827 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:02.612501 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:02.612922 20827 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.614215 20827 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.615451 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:02.616202 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69563.7us
I20260709 13:08:02.616437 20904 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.581434 16484 rpcz_store.cc:276] 0709 13:08:01.081303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.081439 (+   136us) service_pool.cc:224] Handling call
0709 13:08:01.081720 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.638036 (+556316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.580622 (+942586us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54002995d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:02.580895 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214241664}
I20260709 13:08:02.619621 20937 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.622910 20937 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.624599 21028 consensus_queue.cc:1059] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.620185 20754 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.620788 20895 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.625542 20754 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.626276 20895 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.627671 20754 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.628332 20895 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.628778 21028 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:02.629230 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51590.4us
I20260709 13:08:02.629258 21028 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:02.555341 20831 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.629029 16565 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:02.586123 21001 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.621220 20446 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.624909 20937 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.632009 20904 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:02.664677 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:02.677058 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46316.4us
I20260709 13:08:02.630338 21028 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.679283 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:02.660537 21018 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.680966 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.651400 21024 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:02.691388 16485 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:02.692109 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.692911 16566 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:02.660847 20446 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.696563 20766 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:02.701152 16559 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
W20260709 13:08:02.705955 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.709708 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.697690 20971 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.715462 20931 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.715947 20935 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.717818 20766 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.724241 20985 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.724624 17153 leader_election.cc:336] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 2.038s (SENT)
W20260709 13:08:02.730681 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 158820us
I20260709 13:08:02.732043 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 568) took 1400 ms. Trace:
I20260709 13:08:02.689258 20937 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:02.735945 21024 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.736464 20757 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.737365 16565 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.738555 20939 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.739292 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.740283 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:02.740501 16636 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:02.741134 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.744244 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.746269 16634 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:02.747975 20893 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:08:02.749301 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.750382 21052 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:02.750049 20998 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.789204 20944 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:02.790072 20944 consensus_queue.cc:1243] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:08:02.752521 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.751353 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.754356 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.766481 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:02.764307 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:02.756489 16557 rpcz_store.cc:276] 0709 13:08:01.335444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.561643 (+226199us) service_pool.cc:224] Handling call
0709 13:08:01.711078 (+149435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.746756 (+ 35678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.731617 (+984861us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540007d0d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:02.731883 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341149952}
I20260709 13:08:02.743742 20864 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.765902 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:02.770887 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.771215 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.772488 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:02.773244 20766 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.774371 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:02.794924 16562 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:02.778496 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:02.779472 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:02.784066 20935 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.786392 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:02.786985 20942 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.788224 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.814291 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.823452 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:02.829342 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:02.827873 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 62051.4us
I20260709 13:08:02.826574 16559 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:02.751343 21018 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.833607 16565 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:02.829941 16634 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:02.836321 16638 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.792575 20827 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.838289 21016 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:02.838721 21016 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:02.839247 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2238) took 1762 ms. Trace:
I20260709 13:08:02.839592 16560 rpcz_store.cc:276] 0709 13:08:01.076549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.162606 (+ 86057us) service_pool.cc:224] Handling call
0709 13:08:01.164674 (+  2068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.091620 (+926946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.838812 (+747192us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b540017ff54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:02.839074 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130611584}
I20260709 13:08:02.840267 20985 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.841109 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:02.842224 20985 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:02.843683 20939 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:02.844956 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 148967us
I20260709 13:08:02.845534 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:02.846593 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:02.852490 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 184506us
I20260709 13:08:02.854666 20852 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.765120 21002 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.828199 20829 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.833130 20766 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.832592 20944 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:02.834720 21028 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.869966 16638 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
W20260709 13:08:02.931612 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 72659us
W20260709 13:08:02.954600 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 168284us
I20260709 13:08:02.864884 20944 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:02.959223 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:02.960909 20551 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:02.961510 20551 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:02.963960 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.966816 20831 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.969064 20884 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.969630 20884 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:02.972239 20831 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:02.972676 20937 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.973244 16639 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:02.974346 16485 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:02.975497 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:02.976907 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:02.996050 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 290665us
I20260709 13:08:02.864786 20766 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:03.012012 16483 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.862030 20827 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.016743 20931 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:03.023010 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 143926us
I20260709 13:08:02.953707 20893 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:03.026850 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 72197.7us
I20260709 13:08:03.015419 20766 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.031780 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:03.036787 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:02.870098 20942 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:02.856449 20904 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.038427 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:02.973194 20937 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.041334 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:03.028707 20831 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:03.019781 20884 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.023514 20551 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.042094 17186 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:03.032280 20864 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.040827 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:03.049554 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.050859 16485 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.050715 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.048908 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:03.017587 20829 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.054553 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.035975 20998 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.055608 16491 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:03.054800 21032 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:08:03.056770 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.063352 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.059736 20517 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:03.061780 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.049384 20349 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:03.079054 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.081718 16484 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:03.085794 16491 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:03.091224 16485 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:03.092278 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.068684 20895 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.057471 20831 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:03.104470 16562 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:03.105623 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.106287 16562 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:03.094676 21021 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:03.108769 20831 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:03.113370 21061 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:08:03.094715 20895 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.116168 20895 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.117223 20766 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:03.124995 21058 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:08:03.125792 21001 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.126935 16633 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.130283 21070 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.130849 21070 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.132103 16563 raft_consensus.cc:2393] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:03.132825 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.133643 16484 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:03.070052 20944 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.134814 20944 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.135028 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.135607 20757 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.135679 16484 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:03.083947 20349 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.136360 20349 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.137121 16485 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:03.138573 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:03.154619 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 376230us
I20260709 13:08:03.157147 17186 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:03.134158 21001 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:03.167174 20893 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.168746 17184 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:03.169474 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:03.169744 20829 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.170346 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:03.171185 21016 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.174003 20937 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.134243 20935 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.097276 20446 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.176302 21018 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.159245 16491 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.180334 17182 raft_consensus.cc:2410] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:03.193059 20937 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:03.193732 21016 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.187618 17187 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:03.158471 20757 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.193177 17188 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:03.197001 20827 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.199292 21002 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.201327 16603 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.203054 20942 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.204838 16491 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:03.205294 21028 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:03.191203 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:03.205698 21028 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.206075 21028 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.208382 20942 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:03.208163 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 119426us
I20260709 13:08:03.209074 20766 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.209962 20709 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:03.213716 20895 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.218945 16490 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
W20260709 13:08:03.225317 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 178535us
I20260709 13:08:03.226032 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:03.227655 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 179130us
I20260709 13:08:03.228082 16456 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:03.153254 20517 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:08:03.233239 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:03.235816 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.236193 17181 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.192829 20349 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.238657 20828 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:03.244560 21002 consensus_queue.cc:1059] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:03.245779 21002 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.246137 21002 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.247912 20907 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.247143 21002 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:03.249200 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.251299 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:03.253769 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62014.1us
I20260709 13:08:03.255756 20904 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:03.257599 20904 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:03.259940 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.260951 21073 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:03.247946 21024 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.242584 20895 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.267867 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:03.259616 20904 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.270831 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:08:03.278335 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.280673 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.281376 16633 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:03.278239 20907 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:03.283814 20907 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:03.284644 20907 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.271631 20766 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:08:03.278544 21024 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:08:03.289717 20422 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:03.290086 20422 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:03.295754 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 104644us
I20260709 13:08:03.297755 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:03.296573 17152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.3:45431 timed out after 1.600s (SENT) [suppressed 15 similar messages]
I20260709 13:08:03.300941 20895 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.301782 20349 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:03.302265 16385 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 237) took 17562 ms (client timeout 15000 ms). Trace:
I20260709 13:08:03.292124 21073 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:03.303850 20864 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.304415 20864 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.304512 21073 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.306340 20864 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.308037 21012 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:03.308449 21012 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.309355 21012 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.310649 21012 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.311401 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.311954 20891 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.312846 20891 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.321564 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.314059 20422 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:03.302634 16385 rpcz_store.cc:269] 0709 13:07:45.728313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.728496 (+   183us) service_pool.cc:224] Handling call
0709 13:08:03.290578 (+17562082us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:58.499258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:58.499865 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:58.499902 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:07:58.499919 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:58.511126 (+ 11207us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:58.511182 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:58.511207 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:59.053680 (+542473us) tablet.cc:701] Row locks acquired
0709 13:07:59.057206 (+  3526us) write_op.cc:260] PREPARE: finished
0709 13:07:59.092672 (+ 35466us) write_op.cc:270] Start()
0709 13:07:59.100501 (+  7829us) write_op.cc:276] Timestamp: P: 1783602479092602 usec, L: 0
0709 13:07:59.109014 (+  8513us) op_driver.cc:348] REPLICATION: starting
0709 13:07:59.181039 (+ 72025us) log.cc:844] Serialized 5825 byte log entry
0709 13:07:59.798911 (+617872us) op_driver.cc:464] REPLICATION: finished
0709 13:07:59.899034 (+100123us) write_op.cc:301] APPLY: starting
0709 13:07:59.899126 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:59.899394 (+   268us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:59.899493 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:59.900960 (+  1467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:59.901205 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:07:59.901245 (+    40us) write_op.cc:312] APPLY: finished
0709 13:07:59.901448 (+   203us) log.cc:844] Serialized 107 byte log entry
0709 13:07:59.901615 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:59.901742 (+   127us) write_op.cc:454] Released schema lock
0709 13:07:59.901778 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:59.902081 (+   303us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:59.902106 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":120913,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":99875,"apply.run_cpu_time_us":3020,"apply.run_wall_time_us":3026,"num_ops":15,"prepare.queue_time_us":490602,"prepare.run_cpu_time_us":23430,"prepare.run_wall_time_us":850070,"raft.queue_time_us":193956,"raft.run_cpu_time_us":25129,"raft.run_wall_time_us":105233,"replication_time_us":689745,"thread_start_us":426980,"threads_started":4,"wal-append.queue_time_us":289605,"wal-append.run_cpu_time_us":17100,"wal-append.run_wall_time_us":1414610}]]}
I20260709 13:08:03.324236 16640 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:03.289855 21070 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.324442 20709 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:03.324962 20709 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.326510 16639 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:03.320700 16633 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:03.321033 16637 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:03.320325 16389 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 11, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 11 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.321724 20891 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:03.314213 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48851.1us
I20260709 13:08:03.322047 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.319303 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:03.326951 20709 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:03.331046 16635 raft_consensus.cc:2368] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10.
I20260709 13:08:03.331214 20944 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.331669 21070 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:03.335522 21070 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.335892 21070 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.337194 20517 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:03.337908 20517 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:03.338948 20517 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.340481 20944 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.342865 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.343235 20944 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.344328 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.346107 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.346683 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.347230 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.348230 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.348673 16639 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.349177 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.349864 16636 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:03.349736 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.350085 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.350435 16635 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:03.350677 16640 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:03.351764 20758 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:03.352244 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.353348 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.349651 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:03.357192 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45868.1us
I20260709 13:08:03.359203 16633 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:03.363584 16631 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
W20260709 13:08:03.363839 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.332120 16389 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 11 to 12, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.365209 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:03.367339 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.367300 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.334714 20864 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.371855 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.371953 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.363092 21002 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.374486 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:03.364614 20935 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.375682 17182 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:03.376801 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.378933 16560 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.379004 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:03.380064 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 60848.6us
I20260709 13:08:03.381649 20907 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.382083 20907 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:03.382443 20907 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.378861 20422 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.385547 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.385866 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.386081 16634 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.386442 16637 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:08:03.387246 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.388227 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.388407 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.389943 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.390367 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.390733 16564 raft_consensus.cc:2410] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:08:03.392205 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.392885 16633 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:03.394235 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.394373 16634 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:03.394790 16562 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.388257 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.398654 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.399190 16561 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.399804 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.400519 16563 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:03.403944 20864 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.405937 20864 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.406555 20935 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.408196 20831 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.408492 20935 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.409081 16565 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:08:03.368315 20895 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:08:03.410310 20895 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.410626 20895 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:03.411413 20895 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.412076 20831 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.412681 20895 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.380723 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.418800 17181 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:03.425997 16603 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.427979 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.416244 16389 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 9 to 10, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.432133 16562 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:03.429251 20709 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.438341 20709 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.439258 20709 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:03.443933 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 81094us
I20260709 13:08:03.372592 20944 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:08:03.429890 21028 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.455284 16637 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:03.459859 21028 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.460599 16638 raft_consensus.cc:2393] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 13: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:03.461020 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:03.461565 17181 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:03.461680 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.463380 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.466475 16562 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:03.470793 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 90133.4us
I20260709 13:08:03.486924 16562 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:03.451892 20349 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.487828 21070 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.500033 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.490088 20755 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.503953 20755 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.504328 21070 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.506114 20755 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.507201 17181 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:03.508376 16603 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.509760 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.510314 16490 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.490155 16389 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 9, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.492046 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:03.493291 21080 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 13:08:03.519894 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.522142 16561 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:03.523533 16560 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:03.527940 20757 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.528462 20757 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.533134 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.533748 16484 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:03.538653 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.539418 16634 raft_consensus.cc:2410] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:08:03.530791 20757 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.541923 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.543363 20864 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.531113 21028 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:03.545598 20349 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:03.489197 20831 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:03.550289 16490 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:03.543851 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.557595 16633 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:03.555835 16455 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.556450 16485 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:03.552089 20864 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:03.565897 20864 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.569077 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:03.566874 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 85475.8us
W20260709 13:08:03.571347 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 91252.9us
I20260709 13:08:03.576923 20349 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.579028 20349 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.580367 21070 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:03.568646 20758 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:03.581144 20758 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.581467 20758 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.581650 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.574687 21028 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.582331 16633 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:03.580749 21070 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:03.582818 21028 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.583482 21070 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.582247 17181 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:03.585125 20828 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:03.586099 21002 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:03.586467 21002 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.587319 21002 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:03.588472 21084 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:03.588490 21002 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:03.589386 21056 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:08:03.590340 21081 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:08:03.590672 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.600206 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.601416 20864 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.602226 20904 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.603221 20904 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.603642 16487 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:03.604406 16483 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.605660 20904 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.600267 16488 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.607029 21070 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.608315 16482 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:03.609897 20864 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.612107 21070 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:03.613718 16489 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:08:03.612160 16487 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:03.620066 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.620275 16489 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:03.621337 21083 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:08:03.625588 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.625813 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.626219 16633 raft_consensus.cc:2376] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11. Re-sending same reply.
I20260709 13:08:03.626921 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.627249 16482 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:03.627614 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:03.632682 21080 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:03.570984 20907 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.634634 16632 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:03.635025 16632 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.635216 20907 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.637701 16634 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:03.633642 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.640514 16389 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.641533 20904 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:03.641965 20904 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.642380 20904 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.642882 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.643414 16558 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.638944 16632 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.645045 16632 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.648520 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.641968 16389 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 11, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 11 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.649273 16561 raft_consensus.cc:2410] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:08:03.651257 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.649698 16389 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 9, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.651929 16562 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:03.652936 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.653533 16559 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:03.641007 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.656232 20349 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.656729 20349 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:03.657569 20349 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.665730 16632 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:08:03.666138 16632 pending_rounds.cc:85] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 7
I20260709 13:08:03.669697 16632 pending_rounds.cc:107] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:08:03.669965 16632 raft_consensus.cc:2889] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.668079 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.651826 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.672008 16561 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
W20260709 13:08:03.675523 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.682646 16558 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:03.684986 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.685636 16563 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:03.688553 16484 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:03.692210 16482 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:03.700349 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:03.706359 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 130177us
I20260709 13:08:03.707485 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.710449 16491 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.710609 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.717156 16484 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.705494 16389 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 12, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.722836 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:03.723562 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.723819 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.724153 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.724149 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:03.726074 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.726693 16632 raft_consensus.cc:2376] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11. Re-sending same reply.
I20260709 13:08:03.726995 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:03.691910 21070 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:03.692070 20827 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:03.698809 20907 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.722008 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:03.732627 16634 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:03.733219 16490 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:08:03.734002 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:03.735555 16456 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.731617 20755 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:03.739120 20755 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:03.729118 20942 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:03.718380 20884 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:03.741977 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 74006.4us
I20260709 13:08:03.744048 17188 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:08:03.746408 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.726146 20831 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:03.753858 16558 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:03.738809 21074 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:03.739821 20942 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:03.744827 20757 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:03.749461 20755 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:03.763172 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.767419 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.767992 16389 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 9 to 10, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:03.745285 20904 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.781433 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.783545 16566 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:03.786201 16566 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:03.786808 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.787281 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.764230 21074 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:03.787081 16566 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.788163 16566 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.788417 21074 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.781589 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.792021 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.792164 16561 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.792860 16638 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:03.793316 16638 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.795584 20942 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:03.796824 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.798826 16638 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.799714 16638 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:03.801994 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.802496 16485 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:03.793509 16561 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.804730 16558 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:03.805291 16561 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:08:03.805681 16561 pending_rounds.cc:85] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 6
I20260709 13:08:03.805940 16558 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:03.806632 16638 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:03.805967 16561 pending_rounds.cc:107] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:08:03.847747 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.848023 16561 raft_consensus.cc:2889] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.808320 16562 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:08:03.848453 16566 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:03.792936 16560 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:03.812314 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.813912 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.852710 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.853294 16487 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:03.853452 16632 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:03.853885 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.854465 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:03.814131 16633 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:03.824014 16565 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:03.825553 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.828999 16559 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
W20260709 13:08:03.856380 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 118043us
I20260709 13:08:03.793483 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.748615 20827 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.833664 16389 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 11, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 11 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.858595 16557 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:08:03.836046 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.757182 20831 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.781239 20422 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.838999 16558 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:03.854429 16636 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:03.861334 16565 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:03.861620 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.861825 16639 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:03.867645 16560 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:03.860150 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 136062us
I20260709 13:08:03.864107 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.864699 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.865247 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.865798 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.870635 16566 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:08:03.870870 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.872448 16561 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: [11.8-13.9]
W20260709 13:08:03.873677 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.897897 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:03.871712 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:03.903379 16637 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:03.859663 20907 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.904676 16389 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 9 to 10, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.910853 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:03.917872 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.911628 20935 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.918182 21012 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:03.918732 20935 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.919591 21012 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:03.919976 21012 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:03.920501 16565 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:03.934970 16560 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:03.921372 20935 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:03.924170 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:03.925074 20907 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.902765 20422 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:03.925007 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.929284 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:03.920745 21012 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:03.869419 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:03.862566 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:04.005249 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 142741us
I20260709 13:08:04.006299 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:03.938326 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:03.863922 20766 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:03.944479 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:04.008109 16558 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:03.874249 20891 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:03.962419 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 206459us
I20260709 13:08:03.924973 21024 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:08:04.013998 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:04.014559 17181 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:08:03.966794 16557 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:03.911491 20709 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:03.967173 16389 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 9, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.018607 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:03.995034 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65814.4us
W20260709 13:08:04.007527 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.012075 20944 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.020898 20944 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:04.021283 20944 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.021373 20904 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.023108 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:03.945789 21002 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:03.948184 21021 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:04.024657 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:04.025354 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.949831 21037 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:04.026240 16488 raft_consensus.cc:2376] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15. Re-sending same reply.
I20260709 13:08:03.967319 20757 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:04.018044 20766 consensus_queue.cc:1243] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:04.072062 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:04.070295 17188 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:08:04.028920 21028 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.074152 16489 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.029222 21073 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.029109 20904 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.070549 20709 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:04.071259 16389 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:04.075098 20891 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.079661 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:04.083158 17188 pending_rounds.cc:85] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 9
I20260709 13:08:04.083386 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:04.120810 17188 pending_rounds.cc:107] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:08:04.120940 16487 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.028110 20937 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:04.113147 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.030133 21096 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.023422 20758 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.114923 20942 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:04.118551 16389 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.121280 17188 raft_consensus.cc:2889] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:04.136466 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 267096us
I20260709 13:08:04.030398 21095 raft_consensus.cc:2764] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:04.123440 17181 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:04.137449 21095 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.082010 21012 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.138087 16529 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:04.139398 16488 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:08:04.118706 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 100140us
I20260709 13:08:04.130517 16491 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.095252 21028 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:04.117888 20904 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:04.147330 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:04.151924 16485 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:08:04.139343 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 67329.3us
I20260709 13:08:04.123342 21037 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.152522 21037 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:04.153395 21037 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.154600 21037 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.128544 20709 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:04.166968 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.167573 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.171954 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:04.173625 16488 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:04.175614 16490 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:04.157763 20904 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.181298 16491 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:04.120558 21073 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.165059 16389 catalog_manager.cc:5697] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 6 to 8, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.130177 21099 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:04.189404 20422 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:04.182511 21107 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.190321 21118 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.190443 21107 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.190857 21118 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.184747 21028 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.188767 16389 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 7 to 10, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.186054 20827 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.171203 21074 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:04.188797 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 250521us
I20260709 13:08:04.194706 21118 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.195137 16487 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:04.195437 16565 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.208209 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:04.200512 16389 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.199620 16486 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:04.138301 21096 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.209795 16389 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 9 to 10, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.210943 21096 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:04.141261 21095 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.211514 16389 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 7 to 8, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 8 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.195181 21094 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.234256 16389 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 11 to 13, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 13 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.175256 20895 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:04.212961 21118 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:04.237665 21002 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:04.243120 21073 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.255115 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.235684 20422 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:04.248208 21116 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:04.249163 21095 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:04.238564 20827 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:08:04.236267 21028 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.251945 21021 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:08:04.255393 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:04.269995 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.270622 16487 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:04.255914 16486 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:04.263449 16389 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 12 to 13, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 13 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.215667 21074 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:04.272404 21074 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.236678 21094 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.276209 21095 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:04.280711 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.281327 20827 consensus_queue.cc:1243] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:04.263497 20422 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.240515 21016 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:04.265453 21120 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.265278 21107 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.274197 20828 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:04.204763 20757 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.292471 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:04.295069 16491 raft_consensus.cc:2368] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:08:04.282612 21127 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.275323 20766 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.293123 21120 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.266006 21118 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:04.237983 21115 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:04.278210 21094 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.310837 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.282334 21099 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:04.294399 20828 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:04.313616 20831 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:04.317335 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 179665us
I20260709 13:08:04.307313 21127 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.310736 20766 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:04.307641 21090 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:08:04.320562 21097 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:04.320938 21118 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.288163 20422 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.320154 21120 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:04.332206 21092 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:08:04.333669 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 140055us
I20260709 13:08:04.329504 21127 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.344897 20828 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:04.345592 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:04.346197 20828 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.346598 20758 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.265220 20709 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.326511 21107 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:04.351166 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 213140us
I20260709 13:08:04.334414 21097 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:04.374202 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:04.375053 17181 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:04.376974 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.377612 16491 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:08:04.372738 16604 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:04.380410 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:04.380934 16558 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.398514 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:04.399138 16560 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.392553 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:04.402060 20709 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.406430 21002 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.406819 21002 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:04.354030 21028 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:04.407582 21002 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.408314 21028 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:04.381798 21134 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:04.408666 21136 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.413442 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:04.409196 17188 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:04.415736 17181 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:04.409885 16490 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:04.353600 20831 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:04.412110 16562 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:04.420403 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:04.412284 21097 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.419345 21028 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:04.413502 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:04.414685 21112 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.236s	user 0.000s	sys 0.002s
I20260709 13:08:04.426401 16557 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:04.360627 21107 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:04.420986 16565 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.419230 21002 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.420472 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:04.429241 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 189672us
I20260709 13:08:04.433780 21028 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.434176 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.434952 21028 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.435971 21120 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.436691 21120 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:04.438015 21136 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.439371 16558 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:04.440088 21136 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:04.435703 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.443141 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:04.422945 21097 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.449771 16487 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
W20260709 13:08:04.456038 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.450876 21107 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.451562 20766 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:04.457361 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.458664 16560 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:04.462531 16562 pending_rounds.cc:85] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 6
I20260709 13:08:04.468870 16560 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:04.434176 20831 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:04.482049 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.479090 16604 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:04.485383 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:04.485324 16484 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.486140 21037 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.479449 16562 pending_rounds.cc:107] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:04.486474 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:04.486704 16562 raft_consensus.cc:2889] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:04.387041 20944 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.462436 20828 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.486295 21012 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.462409 21123 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.431448 21016 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:08:04.489414 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:04.524937 16560 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:08:04.488610 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 319095us
I20260709 13:08:04.521565 16565 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:04.522358 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.526021 16490 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 10 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:04.526180 16491 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:04.478868 21136 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:04.527184 17184 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:04.498890 21021 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:04.531407 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 95756.4us
I20260709 13:08:04.532229 16566 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.520887 21107 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.530041 21116 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.552903 21102 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
I20260709 13:08:04.501813 21037 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:04.537055 21131 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:08:04.566967 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.572288 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 52617.1us
I20260709 13:08:04.557675 20517 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.536644 21136 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.534948 21127 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.573634 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:04.561275 21021 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:04.548760 20709 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:04.578785 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:04.579439 16565 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:04.578207 20517 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.625327 20517 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:04.625512 21141 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:04.627938 20828 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:04.628315 21136 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:04.634104 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:08:04.634856 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 56360.3us
I20260709 13:08:04.571573 20944 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:04.636855 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.628932 21102 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:04.567597 21116 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.637768 21118 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:04.582265 21012 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:04.643602 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 94582.8us
I20260709 13:08:04.646921 21118 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.648554 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:04.649910 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.652333 20831 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.653380 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.653980 16486 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:04.655309 21118 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.654153 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.660187 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:04.663355 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:04.666044 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.666515 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.660161 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.669181 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:04.669806 16486 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:04.644207 21094 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.675822 21094 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:04.659584 21123 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.677809 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:04.678009 21139 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:04.678372 17182 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:04.659400 21135 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.656245 21024 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.676011 21116 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:04.693325 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:04.694082 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:04.694666 16631 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:04.689749 20944 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.698736 16638 pending_rounds.cc:85] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 6
I20260709 13:08:04.699029 16638 pending_rounds.cc:107] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:08:04.699234 16638 raft_consensus.cc:2889] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:04.700184 21140 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:08:04.701701 20907 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:04.703050 21105 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 13:08:04.663151 21012 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:04.680752 21135 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.704893 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:04.712301 16635 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.703975 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.708083 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:04.713063 16639 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:08:04.709568 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:04.713225 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:04.713807 16565 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:04.713760 16631 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
W20260709 13:08:04.710950 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 56873.8us
I20260709 13:08:04.716758 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:04.688917 21037 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.717082 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:04.718636 16565 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:04.692807 21028 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:04.656109 21021 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.717331 21135 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.728965 16639 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:04.734930 16639 pending_rounds.cc:85] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 7
I20260709 13:08:04.735170 16639 pending_rounds.cc:107] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:04.735401 16639 raft_consensus.cc:2889] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:04.731153 21133 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.417s	user 0.002s	sys 0.000s
I20260709 13:08:04.719713 21028 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.737737 16635 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:04.737675 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.738909 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:04.723282 20864 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.747778 21123 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:04.749665 21098 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.563s	user 0.000s	sys 0.001s
W20260709 13:08:04.751370 21110 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.558s	user 0.000s	sys 0.001s
I20260709 13:08:04.752370 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2264) took 1009 ms. Trace:
I20260709 13:08:04.752765 16482 rpcz_store.cc:276] 0709 13:08:03.743447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.743582 (+   135us) service_pool.cc:224] Handling call
0709 13:08:03.752930 (+  9348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.758471 (+  5541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.758503 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.780622 (+ 22119us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.084330 (+303708us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:04.084367 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.084430 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.702522 (+618092us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:04.750239 (+ 47717us) raft_consensus.cc:1685] finished
0709 13:08:04.750273 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.752281 (+  2008us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2660,"raft.queue_time_us":73,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8113,"spinlock_wait_cycles":6199168,"thread_start_us":237668,"threads_started":1,"wal-append.queue_time_us":472799}
I20260709 13:08:04.719815 21037 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.756840 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:04.757398 16631 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:04.757969 21037 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:04.758955 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:04.754333 21094 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.760165 21094 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.762146 21094 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:04.772221 20904 consensus_meta.cc:287] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.003s
I20260709 13:08:04.772644 20904 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.774143 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:04.774541 20904 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.774948 21002 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:04.776456 21117 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.532s	user 0.004s	sys 0.003s
I20260709 13:08:04.776891 21002 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:04.777606 21113 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.497s	user 0.000s	sys 0.002s
I20260709 13:08:04.778203 21145 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.778625 21145 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.778934 21145 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.779585 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:04.781395 21132 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 13:08:04.787886 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:04.740923 21028 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.758656 21012 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.788754 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:04.792793 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:04.797837 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.798305 16635 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:04.756067 20864 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:04.734254 20422 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.812477 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:08:04.894723 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 82300.1us
I20260709 13:08:04.895994 16456 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:04.912911 16456 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:04.915000 21142 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:04.911648 20907 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.916020 20907 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.917990 20907 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:04.919502 21116 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:04.919996 21116 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.921869 21116 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:04.792678 20828 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.793792 21118 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:04.924332 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 126578us
I20260709 13:08:04.929306 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:04.933697 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:04.964183 16636 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:04.964124 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2262) took 1235 ms. Trace:
I20260709 13:08:04.964957 16484 rpcz_store.cc:276] 0709 13:08:03.728786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.738127 (+  9341us) service_pool.cc:224] Handling call
0709 13:08:03.745233 (+  7106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.485993 (+740760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.951675 (+465682us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54002990d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:04.964059 (+ 12384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701575424}
I20260709 13:08:04.922339 21116 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.935771 21144 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:08:04.926016 21094 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:04.995203 21094 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.995698 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:04.996922 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 59960.3us
W20260709 13:08:04.995141 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.967041 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:04.933025 20904 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.967535 16530 leader_election.cc:400] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
I20260709 13:08:04.965771 20907 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.031051 17183 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:05.028668 16530 leader_election.cc:403] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:05.032600 17179 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:04.995262 21124 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.994971 21126 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:04.992239 20517 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:04.931881 20349 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:08:04.968892 21016 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:08:05.026978 20904 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.034277 20907 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:04.922398 20864 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:04.988891 20758 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:05.050096 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.034464 20755 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:04.992163 21116 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:04.965546 20828 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.056349 20904 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.040988 21002 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:05.051364 21101 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.052392 20921 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.050338 21124 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:08:05.095942 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 156621us
I20260709 13:08:05.058401 20907 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.062140 20517 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:05.081254 20827 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.121084 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:05.124375 17186 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:05.125993 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 87943.1us
I20260709 13:08:05.091773 20758 raft_consensus.cc:697] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:05.092032 20755 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.099304 21016 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:05.119819 21094 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:05.135113 21150 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:08:05.135502 20755 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:05.096143 21002 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.123654 21118 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:05.163405 21118 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.153987 20831 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:05.123672 20921 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.131461 21016 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:05.162498 21002 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:05.097268 21101 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.135618 21124 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.177143 21145 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.177914 21101 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:05.178615 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:05.173012 17186 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:05.179737 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.126080 20827 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.175693 20422 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:05.187688 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 252743us
I20260709 13:08:05.178786 21016 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.181808 20944 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12.
W20260709 13:08:05.200335 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 107600us
I20260709 13:08:05.183132 20942 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:05.183909 21002 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.191421 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:05.181700 21094 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:05.196643 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:05.194802 21155 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:08:05.157086 20517 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.218498 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.180899 20831 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.191377 21101 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.219709 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:05.220157 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:05.223866 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44229.6us
I20260709 13:08:05.195259 21126 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:05.227125 16454 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:05.212049 21094 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.186894 21028 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.214283 20942 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.215198 20891 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.244892 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:05.245676 16562 raft_consensus.cc:2393] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:05.249261 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.221659 21016 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.201894 20755 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:08:05.253253 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.220080 21002 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.236467 21094 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.244270 20349 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:05.253232 21124 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.279369 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:05.215732 20758 consensus_queue.cc:237] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.280856 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:05.232065 21101 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.255533 21116 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:05.285444 17184 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:05.285820 17184 pending_rounds.cc:85] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 8
I20260709 13:08:05.286016 17184 pending_rounds.cc:107] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:05.286226 17184 raft_consensus.cc:2889] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.254532 21166 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:08:05.305061 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 78008.1us
I20260709 13:08:05.306891 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:05.302312 21135 consensus_meta.cc:287] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:08:05.309787 21175 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:05.310529 21158 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:08:05.307257 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:05.283810 21124 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.303709 20828 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:05.321815 16484 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:05.324159 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:05.328472 16491 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:05.328626 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:05.330653 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:05.331758 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50980.3us
I20260709 13:08:05.308349 20349 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:05.332935 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:05.332494 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:05.331008 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:05.316310 21175 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.335757 16490 raft_consensus.cc:2376] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13. Re-sending same reply.
I20260709 13:08:05.336972 16489 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:05.337591 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:05.338641 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:05.339551 16488 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:08:05.334695 21156 log.cc:927] Time spent T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:08:05.347699 21002 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:05.348474 21104 log.cc:927] Time spent T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.160s	user 0.003s	sys 0.011s
I20260709 13:08:05.348630 20864 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.349252 20864 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:05.349841 21160 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:05.349728 20864 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.351770 20864 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.352262 20864 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:05.328351 20755 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:05.352806 20864 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.319500 20944 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:05.353467 20864 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.316915 21186 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:05.327345 21188 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.363593 17181 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:05.331354 20827 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:05.359716 20349 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.340407 21175 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.382001 21028 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:05.322198 21135 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.367255 21188 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:05.389873 21178 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:05.353727 20944 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.307700 21126 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.390112 21168 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:05.389570 21106 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.209s	user 0.000s	sys 0.016s
I20260709 13:08:05.390040 20921 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:05.425684 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 87106.2us
I20260709 13:08:05.390976 21145 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:05.432072 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.434899 21142 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:05.436219 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.413489 21188 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.450894 16561 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:05.436844 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.440546 21135 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.443212 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.445837 20349 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.447052 20907 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.447402 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2269) took 1590 ms. Trace:
I20260709 13:08:05.447664 21101 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.429905 17180 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:05.463146 16559 rpcz_store.cc:276] 0709 13:08:03.856535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.856689 (+   154us) service_pool.cc:224] Handling call
0709 13:08:03.856974 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.857314 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.857342 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.857769 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.028057 (+170288us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:04.080243 (+ 52186us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.240903 (+160660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.240981 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.381983 (+1141002us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:05.447122 (+ 65139us) raft_consensus.cc:1685] finished
0709 13:08:05.447219 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.447347 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53401,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":111766,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":12759,"spinlock_wait_cycles":55826176,"thread_start_us":330044,"threads_started":2,"wal-append.queue_time_us":272802}
I20260709 13:08:05.367070 21186 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.428551 21168 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:05.499298 16563 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:05.506803 20907 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.507439 21145 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.507944 21145 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.511338 20891 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.516675 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:05.525820 21179 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:05.524367 21168 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.457158 21142 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.549984 21101 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:05.550494 21101 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.552438 21101 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:05.555042 21127 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:05.539470 21154 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.444s	user 0.000s	sys 0.002s
I20260709 13:08:05.541661 21186 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.426390 20904 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.546185 21124 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.448839 20942 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.563139 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:05.563808 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.569654 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.585878 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.586905 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:05.589144 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.590606 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.536943 21179 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:05.592408 16634 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:05.594980 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:05.595355 16487 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:05.608865 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.608559 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:05.610814 16635 raft_consensus.cc:2368] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:05.816742 16634 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:05.610889 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.741600 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.808066 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2283) took 1168 ms. Trace:
I20260709 13:08:05.617736 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:05.658743 17185 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:08:05.656913 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:05.747869 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.616983 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.616684 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.657646 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:05.836875 17184 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:05.838001 16639 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:05.747052 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.842669 16638 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:05.782763 17179 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:05.634852 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:05.840094 16637 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
W20260709 13:08:05.843405 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 281971us
I20260709 13:08:05.795246 17182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 903) took 1004 ms. Trace:
I20260709 13:08:05.583952 20921 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:05.588900 21002 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.851971 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:05.855366 16560 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:05.839354 17185 pending_rounds.cc:85] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 11
W20260709 13:08:05.747208 21196 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:05.837548 16557 rpcz_store.cc:276] 0709 13:08:04.640120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.640491 (+   371us) service_pool.cc:224] Handling call
0709 13:08:04.644975 (+  4484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.645322 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.645350 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.680660 (+ 35310us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.805844 (+125184us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:04.805884 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.805947 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.538823 (+732876us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:05.670340 (+131517us) raft_consensus.cc:1685] finished
0709 13:08:05.670363 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.807989 (+137626us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10525,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":3061632,"thread_start_us":104186,"threads_started":1,"wal-append.queue_time_us":343719}
I20260709 13:08:05.595568 21179 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.609687 21028 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.855818 17185 pending_rounds.cc:107] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:05.860495 17185 raft_consensus.cc:2889] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.827843 21177 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.785609 20757 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:05.727734 21101 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.663331 21175 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.849591 17182 rpcz_store.cc:276] 0709 13:08:04.790348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.799232 (+  8884us) service_pool.cc:224] Handling call
0709 13:08:04.804381 (+  5149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.894674 (+ 90293us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:05.182048 (+287374us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.322574 (+140526us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.327278 (+  4704us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.327478 (+   200us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:05.327512 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.327578 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.795024 (+467446us) raft_consensus.cc:1685] finished
0709 13:08:05.795045 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.795174 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63729,"prepare.queue_time_us":267202,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":352,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":123782,"thread_start_us":323229,"threads_started":2,"wal-append.queue_time_us":339055}
I20260709 13:08:05.646409 21145 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:05.858438 21167 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.785874 20709 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.813889 21127 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:05.669915 20904 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.827366 20828 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.783062 20422 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.861024 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:05.861423 16637 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:05.667376 20942 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.848621 21135 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.862766 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:05.921754 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.922204 16560 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.922340 16631 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:05.917968 20907 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:05.855854 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:05.924767 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 68991.8us
I20260709 13:08:05.637589 21188 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.657719 21094 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.867738 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:05.920816 16562 raft_consensus.cc:2368] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10.
I20260709 13:08:05.861968 21028 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.857043 21002 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.882015 21126 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:05.861716 20921 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.952515 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.863545 20757 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:05.953107 16558 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:05.920600 21182 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:05.959034 16560 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:05.958961 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:05.961192 16631 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:05.961017 21182 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.881323 21142 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.964788 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2536) took 1251 ms. Trace:
I20260709 13:08:05.965293 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:05.921657 20422 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.966048 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:05.966321 21184 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.509s	user 0.002s	sys 0.000s
I20260709 13:08:05.966464 17188 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:05.966874 16565 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:05.930984 20517 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.967753 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.973019 16636 rpcz_store.cc:276] 0709 13:08:04.710758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.710881 (+   123us) service_pool.cc:224] Handling call
0709 13:08:05.962152 (+1251271us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54003f0f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:05.962275 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503183744}
I20260709 13:08:05.975109 16490 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 9: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:05.925853 21192 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.975831 16631 raft_consensus.cc:2410] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:05.965931 21094 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:05.865299 21177 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.908306 21101 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.920109 21127 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.978098 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.980134 16557 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:05.918520 20709 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.004360 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:06.005427 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.005971 16636 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:06.006093 20709 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.006614 21188 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:05.951719 20942 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:05.924417 20828 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.924111 20907 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:05.995977 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:05.925959 21135 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.967398 20757 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.917847 21167 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:05.960565 21126 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.146260 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:06.139624 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:06.116289 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:06.108080 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:06.090370 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.006841 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.075685 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:06.145895 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 281668us
I20260709 13:08:06.150285 16489 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:06.076035 21201 log.cc:927] Time spent T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:08:06.037757 16560 raft_consensus.cc:2410] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:06.007727 16639 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
W20260709 13:08:06.067536 21203 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:06.152799 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:06.152626 16482 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:06.154438 20907 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.154788 20757 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.147143 16488 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:06.155947 21094 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.995281 21118 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.159694 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:06.175115 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:06.144858 21168 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.029s	sys 0.035s
I20260709 13:08:06.162161 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.163095 16637 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:06.176959 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.177547 16632 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:06.169220 16638 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:06.177733 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.075672 20422 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.173080 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.174014 16636 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:06.076679 21194 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:06.076822 21177 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.168642 16639 pending_rounds.cc:85] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 6
I20260709 13:08:06.189574 16639 pending_rounds.cc:107] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:08:06.076682 21101 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.181941 16560 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:06.182677 21200 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:08:06.190030 16639 raft_consensus.cc:2889] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.183765 16558 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:06.172200 21037 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:06.182302 21168 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.029s	sys 0.035s
I20260709 13:08:06.190757 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:05.994093 21192 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.191768 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:06.176541 20755 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:08:06.179054 21204 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.199533 16560 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:06.183255 21096 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.190376 21124 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.211910 21096 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.212718 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:06.216066 16489 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:06.178364 21094 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.217397 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.190941 20907 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.221117 21175 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.221675 21002 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.222100 21127 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.222535 21182 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.224345 21179 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.204339 20895 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:06.210793 21142 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.211024 20921 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.210377 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.229717 16631 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:06.230988 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:06.179551 21118 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.209839 21208 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.210705 21097 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.234705 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:06.191964 21194 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.228180 21124 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.228633 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.241380 16632 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:06.227113 21177 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:06.241678 16560 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:06.246953 16640 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
W20260709 13:08:06.250039 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 87925.7us
I20260709 13:08:06.257207 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:06.231983 21188 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.237113 20422 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:06.260560 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.238749 20709 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:06.238600 21012 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:06.266057 21012 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.233093 21204 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.272219 21126 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.246641 21002 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:06.272853 21002 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.273270 21204 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.273996 21118 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.251128 21208 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.276054 20709 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.277946 20709 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.230672 20907 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.258705 21188 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.263847 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.261641 17152 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:06.263233 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:06.264617 20422 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.230152 21168 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.256398 21124 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.290613 16631 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:06.325958 16560 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:06.312811 16632 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:06.282163 16558 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
W20260709 13:08:06.327695 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 143249us
I20260709 13:08:06.328527 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:06.329800 16557 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.330060 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:06.330570 16560 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:06.331753 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:06.281487 21214 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.298584 21192 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.296468 21096 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.320708 21028 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.295924 20828 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.281880 21135 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.314975 21188 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.290769 21204 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.291965 21208 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.263414 21177 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.297659 21194 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.332370 21128 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.402510 21204 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:06.404549 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72860us
I20260709 13:08:06.404953 16560 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:06.394158 21070 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.404727 21177 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.332592 21168 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.409046 16558 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:08:06.409862 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 148276us
I20260709 13:08:06.403360 21214 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.405979 21128 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:06.410965 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.416682 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.417423 21214 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.407930 21070 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:06.425974 16633 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:06.429726 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.433221 17152 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:06.434216 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.434778 16633 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:06.435570 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.436327 20422 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.436604 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.422478 21128 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.423853 20757 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.428084 21070 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.436236 21222 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:06.436542 17182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:08:06.504288 17182 raft_consensus.cc:606] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:06.504645 17182 raft_consensus.cc:614] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:06.428730 20895 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:06.447692 20757 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.491205 16633 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:06.501096 21214 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.504099 21222 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.520876 16565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 586) took 1077 ms. Trace:
I20260709 13:08:06.521250 16565 rpcz_store.cc:276] 0709 13:08:05.443956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.444234 (+   278us) service_pool.cc:224] Handling call
0709 13:08:05.444527 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.977421 (+532894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.520571 (+543150us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b540007d0d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:06.520807 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200805120}
I20260709 13:08:06.523496 16565 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:06.524940 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 583) took 1094 ms. Trace:
I20260709 13:08:06.525316 16562 rpcz_store.cc:276] 0709 13:08:05.430987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.431107 (+   120us) service_pool.cc:224] Handling call
0709 13:08:06.524739 (+1093632us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540002d854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:06.524869 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079250816}
W20260709 13:08:06.531812 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.536294 20831 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.539098 16640 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:06.556700 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.557448 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 591) took 1029 ms. Trace:
I20260709 13:08:06.557730 16559 rpcz_store.cc:276] 0709 13:08:05.527617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.548206 (+ 20589us) service_pool.cc:224] Handling call
0709 13:08:06.556568 (+1008362us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b5800174c98. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:08:06.557384 (+   816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14728576}
I20260709 13:08:06.514698 20757 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.632766 16565 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:06.632766 16562 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:06.514986 20895 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.640640 16455 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:06.640136 21131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.018s	sys 0.010s
I20260709 13:08:06.518199 21214 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.690644 16557 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:06.680428 16562 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:06.653090 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 219923us
I20260709 13:08:06.699062 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.700726 16530 leader_election.cc:400] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:06.701045 16530 leader_election.cc:403] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.702162 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.711064 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.713027 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:06.680299 21131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.018s	sys 0.010s
I20260709 13:08:06.718813 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.719575 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.721897 16633 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:06.695655 20895 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:06.714546 21218 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:08:06.725594 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:06.726253 21168 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.520080 21222 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.733757 16633 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.714414 21188 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:06.733326 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:06.730293 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.731812 21194 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.732287 21217 raft_consensus.cc:2764] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:06.732714 21097 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.734895 16636 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.700148 21096 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:06.644685 20754 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:08:06.742771 21194 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:06.752988 21227 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:06.700031 21214 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:06.738248 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.753625 20754 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:06.754343 21194 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.717453 21192 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.755257 21192 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.755616 21192 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.757153 21094 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.721331 21186 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:06.762336 16564 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.730882 21126 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:06.764098 21096 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.764521 21096 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.651029 20904 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:08:06.768451 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:06.769387 21217 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.770004 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.719161 21118 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:06.716874 21172 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:06.734838 20755 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:08:06.882938 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 112995us
W20260709 13:08:06.773156 21219 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.333s	user 0.000s	sys 0.000s
I20260709 13:08:06.748631 21175 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.896312 21175 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:06.896754 21175 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.748143 21204 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.903522 21135 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.886225 16633 raft_consensus.cc:2410] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:06.905067 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:06.905722 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 206747us
I20260709 13:08:06.906234 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:06.906389 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:06.907477 17179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 730) took 1752 ms. Trace:
I20260709 13:08:06.907647 21225 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.908310 21225 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.908717 21225 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:06.909680 21012 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:06.909554 21225 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:06.891638 21221 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 13:08:06.912693 21217 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:06.913127 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.913746 16637 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:06.899559 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.914589 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:06.886336 21193 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.936s	user 0.004s	sys 0.012s
I20260709 13:08:06.887967 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.753618 21214 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.887202 20755 consensus_queue.cc:1243] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:08:06.891039 21232 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:08:06.891574 20944 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.929703 20944 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.930120 20944 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.915848 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2289) took 1711 ms. Trace:
I20260709 13:08:06.931960 16563 rpcz_store.cc:276] 0709 13:08:05.204211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.204603 (+   392us) service_pool.cc:224] Handling call
0709 13:08:05.204878 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.504624 (+299746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.915610 (+1410986us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400082ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:06.915774 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676718848}
I20260709 13:08:06.933039 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.934108 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.934620 16563 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:06.935333 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.940163 20944 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.941021 21226 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.941504 21226 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.940575 16377 maintenance_manager.cc:643] P 424acc41090849a586f609f5c6254e5b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.346s	user 0.165s	sys 0.038s Metrics: {"bytes_written":29960,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":401498,"dirs.run_cpu_time_us":461,"dirs.run_wall_time_us":37892,"drs_written":1,"lbm_read_time_us":10539,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":108501,"lbm_writes_1-10_ms":4,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":284492,"threads_started":1,"update_count":21}
I20260709 13:08:06.942536 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:06.943198 16563 raft_consensus.cc:2393] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:06.943403 21226 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.943836 21128 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.945466 16378 maintenance_manager.cc:419] P 424acc41090849a586f609f5c6254e5b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10095 bytes on disk
I20260709 13:08:06.945695 16563 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:06.946069 21128 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:06.929312 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.946969 17185 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:06.941761 16636 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:06.948410 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.948916 17185 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:06.949683 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.951131 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2619) took 1376 ms. Trace:
I20260709 13:08:06.951472 16560 rpcz_store.cc:276] 0709 13:08:05.574927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.414179 (+839252us) service_pool.cc:224] Handling call
0709 13:08:06.414489 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:06.424119 (+  9630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.424147 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:06.440669 (+ 16522us) log.cc:844] Serialized 52 byte log entry
0709 13:08:06.878059 (+437390us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:06.878098 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.878160 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.950944 (+ 72784us) raft_consensus.cc:1685] finished
0709 13:08:06.950961 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.951083 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9703,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4335,"thread_start_us":329316,"threads_started":1,"wal-append.queue_time_us":468440}
I20260709 13:08:06.952153 20422 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:06.907382 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:06.887626 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.950807 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.954777 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 911) took 1297 ms. Trace:
I20260709 13:08:06.955145 17188 rpcz_store.cc:276] 0709 13:08:05.657325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.657436 (+   111us) service_pool.cc:224] Handling call
0709 13:08:06.954605 (+1297169us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540005dcd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:06.954724 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287633664}
I20260709 13:08:06.955559 21217 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.955305 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:06.956311 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.956616 17185 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.959151 20895 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.905474 17183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 723) took 1863 ms. Trace:
I20260709 13:08:06.918678 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:06.968565 16561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 590) took 1523 ms (client timeout 1801 ms). Trace:
W20260709 13:08:06.968936 16561 rpcz_store.cc:269] 0709 13:08:05.445037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.492831 (+ 47794us) service_pool.cc:224] Handling call
0709 13:08:06.918555 (+1425724us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b5800174c98. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633366b71 00007f0633366a22 00007f063c27fc09 00007f063b3d9ee0 00007f063b4a30ab 00007f063b4a3131 00007f063b4510a0 00007f063b450984 00007f06349cb6d4 00007f06349cb662
0709 13:08:06.968508 (+ 49953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15539584}
I20260709 13:08:06.920919 16564 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:06.921136 16605 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.922684 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.970041 17184 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:06.970826 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.922816 16529 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.923905 16456 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.927512 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:06.927772 16631 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:08:06.929227 21228 log.cc:927] Time spent T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:08:06.952924 21124 consensus_meta.cc:287] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.001s
I20260709 13:08:06.953612 21070 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:06.913909 17179 rpcz_store.cc:276] 0709 13:08:05.154647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.348148 (+193501us) service_pool.cc:224] Handling call
0709 13:08:05.747481 (+399333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.844429 (+ 96948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.907289 (+1062860us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54004a6d50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:06.907426 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917715328}
W20260709 13:08:06.960156 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 72607.9us
W20260709 13:08:06.960090 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f842280ae2ac4c68b0b7f6c093e27357 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:06.965371 17153 leader_election.cc:400] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 9. Current term is 10.
I20260709 13:08:06.965781 17188 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:08:06.976585 21012 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.976987 20422 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.977751 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 53950.8us
I20260709 13:08:06.926152 21097 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.978431 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 57382.6us
I20260709 13:08:06.985661 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.986626 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:06.987890 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.981406 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.971064 21126 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.981633 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:06.916193 21172 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.983809 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:06.996798 17188 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:06.997007 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:06.983930 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.988725 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:07.000869 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:07.002153 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.003031 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.003587 16564 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:06.922421 21175 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:06.971287 20517 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.978204 21204 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.967159 21226 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:06.970271 17183 rpcz_store.cc:276] 0709 13:08:05.041997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.042116 (+   119us) service_pool.cc:224] Handling call
0709 13:08:05.058603 (+ 16487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:05.199916 (+141313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.199945 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:05.223083 (+ 23138us) log.cc:844] Serialized 52 byte log entry
0709 13:08:05.326089 (+103006us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:06.500505 (+1174416us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.664318 (+163813us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.901456 (+237138us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b1800417520. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e522 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:08:06.903197 (+  1741us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b1800417520. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f0636483060 00007f0636495716 00007f06364a6287 00007f06364a6208
0709 13:08:06.903341 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.905205 (+  1864us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400621454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:06.905246 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.905290 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:06.905300 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.905425 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1191911,"prepare.queue_time_us":1177780,"prepare.run_cpu_time_us":1881,"prepare.run_wall_time_us":9836,"raft.queue_time_us":495082,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":15364,"spinlock_wait_cycles":351820544,"thread_start_us":184000,"threads_started":2,"wal-append.queue_time_us":333087,"wal-append.run_cpu_time_us":1731,"wal-append.run_wall_time_us":1065276}
I20260709 13:08:06.983470 21208 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.070181 17186 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:06.982961 20944 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.019284 17185 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:06.930241 21222 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:07.020761 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 290661us
I20260709 13:08:06.970728 21094 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:06.988657 21024 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.997874 17179 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
W20260709 13:08:07.041538 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 57673.1us
I20260709 13:08:07.043727 21002 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:07.045121 20709 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:07.045589 21217 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:07.047323 21235 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:06.984933 21096 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.052284 21167 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:07.056865 20895 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.057241 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2548) took 1194 ms. Trace:
I20260709 13:08:06.984745 20422 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.121428 16639 rpcz_store.cc:276] 0709 13:08:05.862579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.862806 (+   227us) service_pool.cc:224] Handling call
0709 13:08:05.878190 (+ 15384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.190518 (+312328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.056990 (+866472us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003d0754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:07.057157 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297185664}
I20260709 13:08:07.122637 16565 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:07.122736 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:07.123332 16639 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.123440 20422 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:07.019948 21194 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:07.124406 21194 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.126209 21194 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:07.121659 17180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.001s	sys 0.013s
W20260709 13:08:07.128086 17180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.001s	sys 0.013s
I20260709 13:08:07.128638 17180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 913) took 1470 ms. Trace:
I20260709 13:08:07.129740 16633 pending_rounds.cc:85] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 7
I20260709 13:08:07.130030 16633 pending_rounds.cc:107] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:07.130239 16633 raft_consensus.cc:2889] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:06.982401 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 58256.4us
W20260709 13:08:07.066495 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 69559.6us
I20260709 13:08:07.131656 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:06.991966 21028 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.990229 21131 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.068892 16377 maintenance_manager.cc:643] P 424acc41090849a586f609f5c6254e5b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.104s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":375,"lbm_reads_lt_1ms":4}
I20260709 13:08:06.984210 21124 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.147001 17188 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:07.113087 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:06.996683 21220 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.047621 21215 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.037140 21186 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.984750 21012 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:07.115864 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 236523us
I20260709 13:08:07.120371 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:07.036713 21172 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:07.132340 16558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.011s
W20260709 13:08:07.195173 16558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.003s	sys 0.011s
I20260709 13:08:07.195952 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2620) took 1620 ms. Trace:
I20260709 13:08:07.197115 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:07.132577 17181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.001s	sys 0.013s
W20260709 13:08:07.197716 17181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.001s	sys 0.013s
I20260709 13:08:07.198340 17181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 912) took 1540 ms. Trace:
W20260709 13:08:07.133046 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 226718us
I20260709 13:08:07.134188 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.140498 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.069871 21208 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.211453 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:07.114591 21024 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.212158 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 71734.6us
I20260709 13:08:07.149922 21002 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.128963 17180 rpcz_store.cc:276] 0709 13:08:05.657890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.746703 (+ 88813us) service_pool.cc:224] Handling call
0709 13:08:05.747038 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.747254 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:06.501233 (+753979us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.928781 (+427548us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:07.128323 (+199542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.128368 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.128424 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.128490 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.128590 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":937329,"prepare.queue_time_us":754624,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":139718,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":37624,"spinlock_wait_cycles":13401856,"thread_start_us":626750,"threads_started":2,"wal-append.queue_time_us":139332}
I20260709 13:08:07.072468 21021 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.151823 21192 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.110146 21226 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.157992 21070 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:07.159332 21175 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.160760 21222 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.162151 20907 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:06.992347 21097 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.162583 21188 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.279673 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.164075 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2288) took 1960 ms. Trace:
W20260709 13:08:07.192665 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 79649.2us
I20260709 13:08:07.281213 16456 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.132018 16639 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:07.282368 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.200249 16635 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:07.198673 17181 rpcz_store.cc:276] 0709 13:08:05.657610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.657788 (+   178us) service_pool.cc:224] Handling call
0709 13:08:05.658044 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.658273 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:06.500769 (+842496us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.198022 (+697253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.198074 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:07.198122 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.198184 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.198289 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1025096,"prepare.queue_time_us":843410,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":186330,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5523,"thread_start_us":696661,"threads_started":2,"wal-append.queue_time_us":18617}
I20260709 13:08:07.285070 17181 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:07.196287 16558 rpcz_store.cc:276] 0709 13:08:05.575138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.415096 (+839958us) service_pool.cc:224] Handling call
0709 13:08:06.431365 (+ 16269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.431538 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:06.444657 (+ 13119us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.195589 (+750932us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.195645 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.195695 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.195764 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.195896 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12936,"prepare.run_cpu_time_us":2170,"prepare.run_wall_time_us":8364,"thread_start_us":750600,"threads_started":1,"wal-append.queue_time_us":739222}
I20260709 13:08:07.206528 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:07.185703 20757 consensus_meta.cc:287] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.002s
I20260709 13:08:07.162465 21124 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.293534 16456 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.291682 17187 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:07.146575 21028 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.280400 16566 rpcz_store.cc:276] 0709 13:08:05.203564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.203946 (+   382us) service_pool.cc:224] Handling call
0709 13:08:05.221757 (+ 17811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.249398 (+ 27641us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:05.281072 (+ 31674us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.596827 (+315755us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.649621 (+ 52794us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.649777 (+   156us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:05.649810 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.649873 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.727607 (+1077734us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:07.163815 (+436208us) raft_consensus.cc:1685] finished
0709 13:08:07.163902 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.164016 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20865,"prepare.queue_time_us":919073,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2020,"raft.queue_time_us":91642,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":30771,"spinlock_wait_cycles":4839168,"thread_start_us":290695,"threads_started":1,"wal-append.queue_time_us":565512}
W20260709 13:08:07.221953 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.224391 21142 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.225382 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:07.272765 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:07.301632 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2299) took 1106 ms. Trace:
I20260709 13:08:07.304133 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:07.304291 17184 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:07.304171 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:07.305593 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 194013us
I20260709 13:08:07.226534 21240 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.228591 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.191351 21215 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:07.211086 20755 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:07.286000 17185 raft_consensus.cc:2410] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:07.221562 21208 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.211174 20895 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.221855 21024 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.212908 16529 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:07.299531 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.210940 21135 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:07.221692 21002 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:07.324396 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 111578us
I20260709 13:08:07.324523 16488 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.301424 21070 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.301829 21142 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.333528 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.334120 16487 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:07.335312 16484 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:07.311160 21215 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:07.315603 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 321104us
I20260709 13:08:07.291164 20828 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.317025 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:07.373193 20828 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.373644 20828 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.374086 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.318629 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.320468 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.315003 21124 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:08:07.375946 16486 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:07.292591 20754 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.321399 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2303) took 1124 ms. Trace:
I20260709 13:08:07.377102 16557 rpcz_store.cc:276] 0709 13:08:06.196572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.715830 (+519258us) service_pool.cc:224] Handling call
0709 13:08:06.716068 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.716234 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:06.993506 (+277272us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.321100 (+327594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.321145 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:07.321190 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.321248 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.321352 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7769,"prepare.queue_time_us":172466,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":3732,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4671,"thread_start_us":552428,"threads_started":2}
I20260709 13:08:07.377125 20754 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.302457 21214 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.381166 20754 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:07.302407 16562 rpcz_store.cc:276] 0709 13:08:06.195524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.714971 (+519447us) service_pool.cc:224] Handling call
0709 13:08:06.715217 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.715392 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:07.002650 (+287258us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.300966 (+298316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.301062 (+    96us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:07.301120 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.301477 (+   357us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.301581 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26849,"prepare.run_cpu_time_us":5546,"prepare.run_wall_time_us":39987,"raft.queue_time_us":113,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":576376,"threads_started":2}
I20260709 13:08:07.381417 21214 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:07.325035 16529 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.324865 21002 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:07.382330 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57375.3us
I20260709 13:08:07.383005 16529 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.384001 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:07.384747 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.301579 21028 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.302989 21179 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:07.327418 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 163295us
I20260709 13:08:07.289044 21238 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.303753 20921 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.338263 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:07.316619 21240 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.340029 21145 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:07.329504 21135 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.333187 21142 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.327527 20895 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.331179 21224 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:07.289750 21021 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:07.330598 21217 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.327139 21167 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.349349 21097 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.350732 21192 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.405705 21118 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.351549 21096 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.358392 21172 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.359493 21012 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:07.415843 20921 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.293761 21188 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.366807 21024 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.337666 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:07.471578 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 133992us
I20260709 13:08:07.385246 17182 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:07.386122 16529 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:07.472739 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 86681.4us
I20260709 13:08:07.396195 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:07.399744 16488 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.400662 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.401141 21194 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.340586 21226 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.407652 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:07.409511 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 212977us
I20260709 13:08:07.393107 21126 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.419566 17180 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:07.399237 21175 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.295917 20757 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.414171 21224 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:08:07.462636 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 251232us
I20260709 13:08:07.419696 21217 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:07.409719 21145 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.481616 21192 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:07.485740 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:07.424923 21118 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:07.491816 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:07.409003 21238 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.513643 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:07.516211 21135 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.517506 21131 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:07.523058 21167 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:07.480373 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:08:07.544708 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 64405.1us
I20260709 13:08:07.526309 17181 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
W20260709 13:08:07.535982 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 241560us
I20260709 13:08:07.541498 16490 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:08:07.542699 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 253337us
I20260709 13:08:07.510667 21217 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.488989 21253 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:07.527806 21118 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.562579 16491 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:07.563514 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.565165 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.561489 16562 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:07.478974 20921 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.507400 21179 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:07.605515 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:07.609890 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.612537 16566 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:07.604897 16529 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:08:07.615355 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 59275.4us
I20260709 13:08:07.538457 21192 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:07.557531 20755 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:07.538290 21186 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:07.561069 21167 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.543741 21021 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:08:07.623723 16638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:07.570101 21135 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.624333 16638 raft_consensus.cc:606] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:07.628079 16638 raft_consensus.cc:614] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:07.629119 16487 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:07.611197 21253 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:07.617483 21168 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.567410 21096 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:08:07.664726 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 156782us
I20260709 13:08:07.578598 21194 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:08:07.629558 21172 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.666607 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:07.577939 21126 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:08:07.627841 21135 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.673609 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 165099us
I20260709 13:08:07.623965 20754 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:08:07.679437 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.723059 21186 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.728715 20921 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:07.729583 16488 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:07.678764 21172 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.685736 21135 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:07.734428 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51400.8us
I20260709 13:08:07.606738 21224 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:07.743654 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 128004us
I20260709 13:08:07.721823 21126 consensus_queue.cc:1243] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:07.750085 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.740270 21188 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.747838 20895 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:07.766211 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 144113us
I20260709 13:08:07.723251 21168 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:07.766330 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.766793 21168 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:08:07.738919 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 118987us
I20260709 13:08:07.767931 17152 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:07.768802 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.768539 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.769143 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.769438 16559 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:07.769830 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:07.770471 16564 raft_consensus.cc:2368] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15.
I20260709 13:08:07.770781 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.770097 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.767922 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.772066 16560 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:07.772606 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.773052 16560 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.771148 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.771310 16565 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:07.770481 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.773168 16557 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:07.771224 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:07.772393 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.777032 16559 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:07.775009 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:07.775856 16564 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:07.777992 16638 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:07.778214 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.783119 16605 leader_election.cc:400] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15.
I20260709 13:08:07.785538 16605 leader_election.cc:403] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.784454 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.762254 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:07.768035 21168 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.784453 16488 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:07.792616 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.794557 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.796353 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.738147 21172 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.803694 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:07.804836 16635 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:07.806449 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:07.807109 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44941.3us
I20260709 13:08:07.808267 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:07.799786 21254 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
W20260709 13:08:07.812464 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 82852.1us
I20260709 13:08:07.818388 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.822078 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.825974 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:07.803990 21258 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 13:08:07.799978 21240 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:07.747053 21264 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:08:07.857897 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:07.832383 21246 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:08:07.723520 20755 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.832772 21170 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:07.833384 21260 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:08:07.734099 21192 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.834468 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.834983 21145 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:07.835817 16562 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.884088 16562 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:07.837037 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.884730 16488 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:07.806535 20757 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:07.800505 21253 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.839706 21131 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.840389 21262 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.897660 21262 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:07.898463 21262 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.899420 21262 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.835563 21288 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.900063 21288 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.900406 21288 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:07.901643 21002 consensus_meta.cc:287] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.001s
I20260709 13:08:07.902081 21002 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.841827 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.904722 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.905371 16632 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:07.832185 21285 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.845463 21028 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.851131 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:07.907878 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56829.5us
I20260709 13:08:07.744766 20831 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:08:07.803639 21094 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:07.831753 21270 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:08:07.764254 20921 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:08:07.888967 16562 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.881064 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:07.913240 16636 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.827565 20754 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:07.887691 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.891659 21284 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:08:07.892490 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.861917 21238 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:07.883749 21256 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:08:07.906071 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:07.926924 16484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.003s
I20260709 13:08:07.860831 21186 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:07.911912 21208 consensus_meta.cc:287] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.000s
I20260709 13:08:07.878263 21128 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.936612 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:07.944501 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:07.946344 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:07.947224 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.921321 21215 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.002s
I20260709 13:08:07.948470 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:07.941146 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 158986us
I20260709 13:08:07.942438 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.950587 16491 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:07.910985 21285 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.952847 16631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:07.954216 16631 raft_consensus.cc:606] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:07.920328 21214 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.957628 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.957870 16631 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:07.958712 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.959718 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:07.946170 21238 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.955324 20754 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:07.989799 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:07.968743 21293 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:08:07.970813 20828 consensus_meta.cc:287] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.597s	user 0.005s	sys 0.001s
I20260709 13:08:07.955916 21285 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.939815 21250 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:07.976503 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:07.941347 20944 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:07.986915 16636 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:07.952184 21128 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.952952 21002 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:07.944175 21186 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.953120 21208 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:07.991256 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.041926 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:08.061242 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 71505.2us
W20260709 13:08:08.092175 16484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.017s	sys 0.004s
I20260709 13:08:08.084170 17181 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:08.076215 21271 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:08:08.112625 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:08.064989 21265 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.400s	user 0.001s	sys 0.003s
I20260709 13:08:08.114097 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.114396 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.061510 20422 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:08.062363 21294 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:07.955544 21215 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:07.989193 21263 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.118016 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 306658us
I20260709 13:08:08.061884 21028 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:08.133942 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:08.134531 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:08.083544 20709 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:08.139654 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.148171 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.141638 17181 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:08.142488 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.144076 16605 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:08.153177 16603 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:08.184541 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.186488 16486 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.113970 21002 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:08.191371 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.197551 16487 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.132257 20422 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.149192 21281 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.192592 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:08.154436 21204 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.108754 20944 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.188946 21028 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:08.235379 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.236377 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:08.241329 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.013788 21238 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:08.230403 21167 consensus_meta.cc:287] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.010s
I20260709 13:08:08.114760 20828 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.191018 21145 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:08.250986 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47802.8us
I20260709 13:08:08.250363 16487 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:08.283813 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.251165 21280 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.235044 21281 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.272051 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.113236 21250 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.210894 20422 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:08.234658 21271 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:08.086061 21293 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:08.277082 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 81649.7us
I20260709 13:08:08.154266 21267 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
W20260709 13:08:08.280686 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44402.5us
I20260709 13:08:08.236254 21310 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.142266 21296 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:08:08.289559 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.317490 16487 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.154801 20709 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.291396 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.152959 20754 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.293990 16491 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:08.146173 21263 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.306298 16635 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:08.309496 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:08.314637 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.326900 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.290199 21226 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.351722 21226 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.352203 21226 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.144450 21294 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.353906 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:08.355783 21294 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.356509 21301 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.357023 21124 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:08.357450 21300 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.358139 21126 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.357946 21300 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.282518 21167 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.358618 21126 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.359045 17188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48048 (request call id 734) took 1155 ms. Trace:
I20260709 13:08:08.360293 21167 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.359433 17188 rpcz_store.cc:276] 0709 13:08:07.203712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.205843 (+  2131us) service_pool.cc:224] Handling call
0709 13:08:07.273160 (+ 67317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.273551 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.273579 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.277679 (+  4100us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.717368 (+439689us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:07.722944 (+  5576us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.723163 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.723240 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.333273 (+610033us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b18001999c0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:08:08.358778 (+ 25505us) raft_consensus.cc:1685] finished
0709 13:08:08.358872 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.358988 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14500,"prepare.queue_time_us":5847,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3460,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":20426,"spinlock_wait_cycles":8877440,"thread_start_us":363456,"threads_started":1,"wal-append.queue_time_us":518768}
I20260709 13:08:08.361235 20755 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:08.288051 21145 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.329643 16484 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:08.368297 16487 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:08.329226 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.369580 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.371325 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2292) took 1074 ms. Trace:
I20260709 13:08:08.288132 21028 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:08.330929 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:08.333091 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.334115 21012 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:08.335005 21263 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:08.336387 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2303) took 1007 ms. Trace:
I20260709 13:08:08.336694 21214 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:08.337700 21279 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.534s	user 0.000s	sys 0.001s
W20260709 13:08:08.337960 21289 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
W20260709 13:08:08.338451 21291 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:08:08.339320 21299 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:08:08.340031 21283 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:08:08.340615 21208 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.341923 20944 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.342623 21128 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.288779 21280 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.344148 21215 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:08.346174 21186 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:08.291965 21281 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:08.348405 21118 consensus_meta.cc:287] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.000s
I20260709 13:08:08.348815 21224 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:08.349452 21217 consensus_meta.cc:287] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.770s	user 0.005s	sys 0.003s
I20260709 13:08:08.349736 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:08.351119 20828 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.328296 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:08.339439 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:08.352263 21292 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:08:08.437202 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:08.657810 16562 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.452360 16491 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:08.371733 16490 rpcz_store.cc:276] 0709 13:08:07.297388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.303939 (+  6551us) service_pool.cc:224] Handling call
0709 13:08:08.371093 (+1067154us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54002e36d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:08.371269 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513946880}
I20260709 13:08:08.712425 17187 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
W20260709 13:08:08.561213 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.379218 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.714758 21128 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.715196 21128 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:08.711764 21280 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.718750 16640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1572) took 1841 ms. Trace:
W20260709 13:08:08.718888 21262 consensus_meta.cc:287] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.819s	user 0.009s	sys 0.000s
I20260709 13:08:08.719120 16640 rpcz_store.cc:276] 0709 13:08:06.877794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.924664 (+ 46870us) service_pool.cc:224] Handling call
0709 13:08:06.924953 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.936571 (+ 11618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.936598 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.937012 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.289079 (+352067us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:07.289113 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.289170 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.615856 (+1326686us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b24003e36a8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332249c4 00007f0633222acb 00007f06333dddc9 00007f06333dda55 00007f06333dcfb0 00007f0636053488 00007f0636053be8 00007f063602b398 00007f063602676a 00007f0636025bb6
0709 13:08:08.718479 (+102623us) raft_consensus.cc:1685] finished
0709 13:08:08.718514 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.718699 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11258,"raft.queue_time_us":26220,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":12122496,"thread_start_us":351750,"threads_started":1,"wal-append.queue_time_us":596802}
W20260709 13:08:08.720630 21285 consensus_meta.cc:287] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.000s
W20260709 13:08:08.562711 21135 consensus_meta.cc:287] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.818s	user 0.008s	sys 0.001s
W20260709 13:08:08.666692 21288 consensus_meta.cc:287] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.766s	user 0.003s	sys 0.005s
I20260709 13:08:08.712781 20709 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:08.721642 21288 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.721534 21128 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.668092 21028 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:08.693610 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 363089us
I20260709 13:08:08.726832 16640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:08.727867 16640 raft_consensus.cc:606] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:08.304642 20907 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:08.503217 21142 consensus_meta.cc:287] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 1.086s	user 0.003s	sys 0.005s
I20260709 13:08:08.372651 21145 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:08.665048 21172 consensus_meta.cc:287] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.843s	user 0.005s	sys 0.003s
W20260709 13:08:08.568907 21275 log.cc:927] Time spent T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:08:08.518532 21024 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:08.460572 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.692591 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2318) took 1164 ms. Trace:
I20260709 13:08:08.712775 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:08.674084 16530 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.668s (SENT) [suppressed 24 similar messages]
W20260709 13:08:08.714476 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 386208us
I20260709 13:08:08.459847 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:08.730212 16454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.005s	sys 0.016s
I20260709 13:08:08.692426 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.610829 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:08.460237 17185 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:08.729411 16636 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:08.618405 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:08.694063 16638 raft_consensus.cc:2368] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15.
I20260709 13:08:08.716185 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.715297 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.372869 20757 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.362s
I20260709 13:08:08.486804 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:08.735256 16389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 227) took 14356 ms (client timeout 15000 ms). Trace:
W20260709 13:08:08.514034 21131 consensus_meta.cc:287] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.618s	user 0.001s	sys 0.005s
I20260709 13:08:08.673120 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:08.668260 21286 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:08.357034 21301 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:08.898712 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 704656us
I20260709 13:08:08.693801 16486 rpcz_store.cc:276] 0709 13:08:07.329315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.376513 (+ 47198us) service_pool.cc:224] Handling call
0709 13:08:07.376771 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.189957 (+813186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.336174 (+146217us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54002d6754. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:08.336332 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796251392}
I20260709 13:08:08.635043 21287 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.769691 16562 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:08:08.903514 16562 pending_rounds.cc:85] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 8
I20260709 13:08:08.903822 16562 pending_rounds.cc:107] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:08.904148 16562 raft_consensus.cc:2889] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.904189 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:08.904851 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49162 (request call id 604) took 1232 ms. Trace:
I20260709 13:08:08.905257 16562 rpcz_store.cc:276] 0709 13:08:07.672499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.672621 (+   122us) service_pool.cc:224] Handling call
0709 13:08:07.672893 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.835715 (+162822us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54003ce220. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636402dc0 00007f063648d1c0 00007f063648e231 00007f063648ad8f 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c
0709 13:08:08.657365 (+821650us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5800533fd0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f06363e70aa 00007f0636469447 00007f0636481fe7 00007f06364837de 00007f063648db49 00007f063648e416 00007f063648ad8f 00007f063648a83e 00007f063b44f419 00007f06349c6bd4
0709 13:08:08.904634 (+247269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.904794 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206309120}
I20260709 13:08:08.902693 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2589) took 1081 ms. Trace:
I20260709 13:08:08.901180 16487 raft_consensus.cc:2410] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:08.908241 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 623) took 1046 ms. Trace:
I20260709 13:08:08.902179 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.831902 16632 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:08.912386 17179 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:08.913501 16489 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:08.915004 17188 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.917495 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:08.713533 21300 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.711884 20831 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.906562 16638 rpcz_store.cc:276] 0709 13:08:07.821754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.349472 (+527718us) service_pool.cc:224] Handling call
0709 13:08:08.902635 (+553163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.909920 16487 rpcz_store.cc:276] 0709 13:08:07.861734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.379994 (+518260us) service_pool.cc:224] Handling call
0709 13:08:08.908188 (+528194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.667177 21307 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:08.912919 16485 rpcz_store.cc:276] 0709 13:08:07.528547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.339197 (+810650us) service_pool.cc:224] Handling call
0709 13:08:08.692531 (+353334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.329602 21310 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.924687 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.712198 21012 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:08.925949 16529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.010s	sys 0.031s
I20260709 13:08:08.926366 16635 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.926906 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.546494 21308 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.951671 16529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.010s	sys 0.031s
W20260709 13:08:08.952064 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.953527 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:08.954067 16564 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:08:08.923061 21131 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15.
I20260709 13:08:08.957731 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:08.959388 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:08.963152 16565 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.935539 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.634683 21126 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:08.882849 21215 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.883049 21021 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.721019 21285 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.846401 21214 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.898033 20944 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.973987 16485 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:08.940065 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.748234 21142 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.933270 20831 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.981057 16563 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.918516 21268 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.514416 20422 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.949592 16637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1577) took 1554 ms. Trace:
I20260709 13:08:08.948969 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2307) took 1529 ms. Trace:
I20260709 13:08:08.902256 16488 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:08.956315 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:08.927506 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:08.959592 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2289) took 1663 ms. Trace:
I20260709 13:08:08.960211 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:08.985661 16564 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.960727 16561 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:08.713727 21293 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.715655 21118 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.984848 16483 rpcz_store.cc:276] 0709 13:08:07.296630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.303831 (+  7201us) service_pool.cc:224] Handling call
0709 13:08:07.322993 (+ 19162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.526780 (+203787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.526808 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.534156 (+  7348us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.717690 (+183534us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.717723 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.718707 (+   984us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.959417 (+1240710us) raft_consensus.cc:1685] finished
0709 13:08:08.959436 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.959542 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1885,"raft.queue_time_us":33868,"raft.run_cpu_time_us":39,"raft.run_wall_time_us":39,"thread_start_us":314754,"threads_started":2,"wal-append.queue_time_us":540513}
I20260709 13:08:08.943320 21024 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:08.966535 16490 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:08.925573 21272 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.990031 21024 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:08.903240 21287 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:08.962018 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:08.748327 20907 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.990448 21024 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:08.992050 20907 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:08.915695 16389 rpcz_store.cc:269] 0709 13:07:54.378996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.383920 (+  4924us) service_pool.cc:224] Handling call
0709 13:08:08.735197 (+14351277us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:04.533275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:04.533909 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:04.533954 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:04.533971 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:04.539378 (+  5407us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:04.539465 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:04.539491 (+    26us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:08:04.673352 (+133861us) tablet.cc:701] Row locks acquired
0709 13:08:04.673388 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:08:04.673590 (+   202us) write_op.cc:270] Start()
0709 13:08:04.673714 (+   124us) write_op.cc:276] Timestamp: P: 1783602484673515 usec, L: 0
0709 13:08:04.673753 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:08:04.674447 (+   694us) log.cc:844] Serialized 8138 byte log entry
0709 13:08:05.374232 (+699785us) op_driver.cc:464] REPLICATION: finished
0709 13:08:05.930670 (+556438us) write_op.cc:301] APPLY: starting
0709 13:08:05.930776 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:06.160762 (+229986us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:06.160866 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:06.274312 (+113446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:06.274693 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=42
0709 13:08:06.274739 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:06.275174 (+   435us) log.cc:844] Serialized 145 byte log entry
0709 13:08:06.403475 (+128301us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.408841 (+  5366us) write_op.cc:454] Released schema lock
0709 13:08:06.411018 (+  2177us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:06.411449 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.411476 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3978,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":549900,"apply.run_cpu_time_us":25951,"apply.run_wall_time_us":480775,"num_ops":21,"prepare.queue_time_us":227599,"prepare.run_cpu_time_us":12176,"prepare.run_wall_time_us":201869,"raft.queue_time_us":585733,"raft.run_cpu_time_us":27843,"raft.run_wall_time_us":474593,"replication_time_us":700333,"thread_start_us":1171510,"threads_started":5,"wal-append.queue_time_us":270218,"wal-append.run_cpu_time_us":30458,"wal-append.run_wall_time_us":2759650}]]}
I20260709 13:08:08.975283 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.992926 21310 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:08.936486 20895 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:08:08.993314 16487 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
W20260709 13:08:08.926178 21194 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:08.735685 21135 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.978310 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2313) took 1491 ms. Trace:
I20260709 13:08:08.975718 21126 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:08.728700 21217 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.957127 21307 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.948832 21002 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:08.965979 21308 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:08.574388 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:08.918774 21172 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:08.981603 20944 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.986195 21312 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.904214 21286 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.922502 21295 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:08.993471 21167 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.950733 21238 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.984120 16489 rpcz_store.cc:276] 0709 13:08:07.419481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.924440 (+1504959us) service_pool.cc:224] Handling call
0709 13:08:08.948907 (+ 24467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:08.964999 16484 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:09.039255 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 624) took 1177 ms. Trace:
I20260709 13:08:08.992452 21208 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:09.024564 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.997797 16560 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:09.007433 17186 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:08.989951 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.025574 16485 rpcz_store.cc:276] 0709 13:08:07.486885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.946363 (+1459478us) service_pool.cc:224] Handling call
0709 13:08:08.970576 (+ 24213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.978100 (+  7524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.978262 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.009307 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1532) took 1057 ms. Trace:
I20260709 13:08:09.025184 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.040427 16487 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:09.039582 16484 rpcz_store.cc:276] 0709 13:08:07.862004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.935336 (+1073332us) service_pool.cc:224] Handling call
0709 13:08:09.039193 (+103857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.029722 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:08.976135 21215 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:08.991225 21024 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.032124 20831 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:08.998817 21142 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:08.985530 21131 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:08.975430 21021 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.033779 16566 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:08.984009 16637 rpcz_store.cc:276] 0709 13:08:07.395259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.396561 (+  1302us) service_pool.cc:224] Handling call
0709 13:08:07.396870 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.411614 (+ 14744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.411646 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.423286 (+ 11640us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.618725 (+195439us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:07.618768 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.618846 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.336947 (+718101us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:08.939038 (+602091us) raft_consensus.cc:1685] finished
0709 13:08:08.939058 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.949534 (+ 10476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3408,"raft.queue_time_us":9648,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10195,"spinlock_wait_cycles":7938944,"thread_start_us":130725,"threads_started":1,"wal-append.queue_time_us":255186}
I20260709 13:08:08.986784 16565 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:09.035151 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:09.007875 21274 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.204s	user 0.005s	sys 0.000s
I20260709 13:08:09.036536 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.061372 16562 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:09.024327 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2319) took 1465 ms. Trace:
I20260709 13:08:09.061991 16490 rpcz_store.cc:276] 0709 13:08:07.559080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.966036 (+1406956us) service_pool.cc:224] Handling call
0709 13:08:08.966274 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.024095 (+ 57821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.024277 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.042860 16564 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:09.042654 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.041797 16488 rpcz_store.cc:276] 0709 13:08:07.951456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.378760 (+427304us) service_pool.cc:224] Handling call
0709 13:08:09.009243 (+630483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.049811 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.052145 17184 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:09.052490 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.052803 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.064991 16484 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:09.052425 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.054061 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.054445 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.055222 16561 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:09.005282 20422 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:09.063529 16485 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:09.070247 17152 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:09.033823 21285 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.078116 21135 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.079734 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.035681 21214 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:09.083204 21323 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.049538 21208 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:09.102721 21208 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:09.085812 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:09.082309 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 132003us
I20260709 13:08:09.069252 21002 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:08.983530 21280 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:09.036149 16373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 465892us
I20260709 13:08:09.040393 21126 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.108846 21145 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.109520 21280 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:09.109902 21126 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.105152 16488 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:09.090689 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:09.110463 21002 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.110752 21145 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.110924 21002 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:09.111246 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.111896 16488 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:09.111709 21002 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.112216 21128 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.085420 21118 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.092696 16490 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.090658 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2288) took 1794 ms. Trace:
I20260709 13:08:09.100642 21286 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.100903 21214 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.088943 21224 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:09.122371 21224 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:09.123256 21224 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.112854 21002 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:09.127766 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.112741 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.129473 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.130477 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.131443 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.094412 21217 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.114612 16482 rpcz_store.cc:276] 0709 13:08:07.296351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.303746 (+  7395us) service_pool.cc:224] Handling call
0709 13:08:07.319263 (+ 15517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.319713 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.319742 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.403808 (+ 84066us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:08:07.404176 (+   368us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.564482 (+160306us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:07.564518 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.564576 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.971496 (+1406920us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:09.090456 (+118960us) raft_consensus.cc:1685] finished
0709 13:08:09.090474 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.090603 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37397,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":48,"spinlock_wait_cycles":10114176,"thread_start_us":159959,"threads_started":1,"wal-append.queue_time_us":277070}
I20260709 13:08:09.134274 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.134950 16482 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:09.140746 21214 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:09.135663 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.145077 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.147931 16482 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:09.148749 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.149770 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.150841 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:09.082753 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 408661us
I20260709 13:08:09.113284 21280 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.157907 21280 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.099596 20828 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:08:09.099011 21262 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.161199 20895 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.161698 20895 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.163573 20895 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.165791 21208 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:09.184759 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65885us
I20260709 13:08:09.185516 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:09.202618 16490 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:09.088634 20944 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.204456 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.053536 21167 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.096951 20709 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:09.160449 21288 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:09.167716 21208 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:09.207140 16455 leader_election.cc:400] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15.
I20260709 13:08:09.093299 21308 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.205271 21266 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:09.216363 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 59537.4us
I20260709 13:08:09.211362 17179 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:09.096403 21021 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:09.095112 21215 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.212504 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.050748 21312 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.169529 21280 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.214941 16455 leader_election.cc:403] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:08:09.214787 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 126288us
I20260709 13:08:09.236485 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:09.226052 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 145920us
I20260709 13:08:09.238837 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:09.235486 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.241786 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.242436 17185 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:09.212776 20709 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:09.245143 17188 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:09.291132 21319 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.291664 21319 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.292591 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.293440 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:09.293665 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.294533 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.294694 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:09.297571 21262 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.299762 21319 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.249586 21285 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.291189 20709 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.301175 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:09.301343 20709 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.302201 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.302731 16562 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:09.250120 16631 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:09.251107 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.305388 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.305977 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:09.306322 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.306388 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.307161 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.253425 21250 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.255007 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.308575 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:09.309104 17186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48050 (request call id 924) took 1643 ms (client timeout 1773 ms). Trace:
W20260709 13:08:09.309466 17186 rpcz_store.cc:269] 0709 13:08:07.666173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.666357 (+   184us) service_pool.cc:224] Handling call
0709 13:08:09.308970 (+1642613us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400610dd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:09.309056 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3069830016}
I20260709 13:08:09.310209 21285 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15.
I20260709 13:08:09.311175 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:09.309456 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.316948 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.318007 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.256069 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.324541 16485 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:09.325639 16485 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:09.326201 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1523) took 1524 ms. Trace:
I20260709 13:08:09.326505 16485 rpcz_store.cc:276] 0709 13:08:07.801810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.325149 (+1523339us) service_pool.cc:224] Handling call
0709 13:08:09.325429 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.325997 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.326151 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.257524 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:09.327543 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.258972 16634 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:09.329037 21168 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.329377 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:09.330168 16485 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:09.261576 16633 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:08:09.330839 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1524) took 1522 ms. Trace:
I20260709 13:08:09.331291 16485 rpcz_store.cc:276] 0709 13:08:07.808534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.327152 (+1518618us) service_pool.cc:224] Handling call
0709 13:08:09.327409 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.330609 (+  3200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.330790 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.261936 21172 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.262984 16557 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.264554 21312 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.265094 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:09.265938 21024 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.266348 21012 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.348987 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:09.267489 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.268476 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.350154 17185 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:09.268795 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.350625 17187 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:09.273121 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.235524 21266 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:09.270965 16386 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 5 to 9, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 9 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:09.353446 16386 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.278622 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.354960 17182 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
W20260709 13:08:09.284965 21226 consensus_meta.cc:287] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.000s
I20260709 13:08:09.363315 16482 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:09.168208 21287 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.285679 21308 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:09.285941 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:09.286255 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:09.287886 21281 consensus_meta.cc:287] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
W20260709 13:08:09.288264 16491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 627) took 1425 ms (client timeout 1708 ms). Trace:
I20260709 13:08:09.289443 16488 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.289350 21167 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:09.290336 21128 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:09.249168 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1582) took 1394 ms. Trace:
I20260709 13:08:09.338107 21319 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:09.260596 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.332263 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.380255 16637 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:09.380514 17186 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:09.323519 21301 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.381364 16637 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:09.307497 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.383641 16489 raft_consensus.cc:2376] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13. Re-sending same reply.
I20260709 13:08:09.303735 16562 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:08:09.340026 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 100182us
I20260709 13:08:09.319752 16487 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:09.385301 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1519) took 1715 ms. Trace:
I20260709 13:08:09.356325 16640 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.393708 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.361114 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:09.354259 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.362905 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.364894 16386 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.395234 16487 rpcz_store.cc:276] 0709 13:08:07.669427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.319188 (+1649761us) service_pool.cc:224] Handling call
0709 13:08:09.319546 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.385080 (+ 65534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.385255 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.367044 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1535) took 1352 ms. Trace:
I20260709 13:08:09.396814 16482 rpcz_store.cc:276] 0709 13:08:08.014384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.362800 (+1348416us) service_pool.cc:224] Handling call
0709 13:08:09.363088 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.366799 (+  3711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.366992 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.371457 16561 raft_consensus.cc:2368] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15.
I20260709 13:08:09.399565 16565 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:09.258104 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.363312 21262 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:09.371381 16491 rpcz_store.cc:269] 0709 13:08:07.862667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.085363 (+222696us) service_pool.cc:224] Handling call
0709 13:08:09.288125 (+1202762us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002e40d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:09.288214 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377361792}
I20260709 13:08:09.372967 16604 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.373409 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.399959 16561 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:09.372510 16632 rpcz_store.cc:276] 0709 13:08:07.854860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.946120 (+ 91260us) service_pool.cc:224] Handling call
0709 13:08:09.248991 (+1302871us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54000b2f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:09.249118 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034871040}
I20260709 13:08:09.402235 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.403115 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.337651 16633 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:09.404491 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:09.403707 16632 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:09.400631 16565 raft_consensus.cc:1240] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.345358 16485 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:09.381423 16455 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:09.352814 21021 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.387836 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48050 (request call id 925) took 1721 ms. Trace:
I20260709 13:08:09.412098 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.346743 21326 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:08:09.388662 16566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 605) took 1622 ms (client timeout 1738 ms). Trace:
I20260709 13:08:09.416262 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:09.389273 16489 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:09.417163 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1536) took 1353 ms. Trace:
I20260709 13:08:09.417488 16489 rpcz_store.cc:276] 0709 13:08:08.063824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.384274 (+1320450us) service_pool.cc:224] Handling call
0709 13:08:09.384534 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.416947 (+ 32413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.417112 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.418715 16489 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:09.392165 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.419883 16637 raft_consensus.cc:2410] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:09.395653 16386 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 11 to 12, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 12 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.407239 16485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 625) took 1545 ms. Trace:
I20260709 13:08:09.369586 21012 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.423362 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.424841 16386 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 13, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 13 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.426443 16386 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 14, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 14 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:09.416103 16566 rpcz_store.cc:269] 0709 13:08:07.765870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.766069 (+   199us) service_pool.cc:224] Handling call
0709 13:08:09.388468 (+1622399us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000d48d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:09.388606 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2912630144}
I20260709 13:08:09.347602 21304 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:09.345547 21285 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:09.412336 17184 rpcz_store.cc:276] 0709 13:08:07.666817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.667040 (+   223us) service_pool.cc:224] Handling call
0709 13:08:07.667353 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.070116 (+1402763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.387578 (+317462us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54005082d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:09.387756 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184150272}
I20260709 13:08:09.414646 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.415442 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.421490 16485 rpcz_store.cc:276] 0709 13:08:07.862241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.332069 (+1469828us) service_pool.cc:224] Handling call
0709 13:08:09.332349 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.407019 (+ 74670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.407189 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:09.379562 21287 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.453964 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.455049 16633 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:09.459631 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.461915 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.462148 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.408841 21307 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.463887 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.437042 16491 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:09.408474 16561 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:09.443001 16487 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:09.444109 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.468780 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:09.432226 20755 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:09.467005 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:09.370133 21226 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.464974 16636 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:09.431613 21280 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.378360 21281 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.463260 17182 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:09.401324 21319 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.467715 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.469555 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.379776 21308 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.434177 16386 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 12, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:09.491142 16566 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:08:09.470376 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.459061 16488 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:09.512984 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:09.473130 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1539) took 1408 ms. Trace:
I20260709 13:08:09.513805 16487 rpcz_store.cc:276] 0709 13:08:08.064656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.396702 (+1332046us) service_pool.cc:224] Handling call
0709 13:08:09.438733 (+ 42031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.472868 (+ 34135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.473077 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:09.515256 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47617.5us
I20260709 13:08:09.516062 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:09.488440 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 66602.2us
I20260709 13:08:09.471095 16491 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.518747 16386 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 11 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 12 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:09.512064 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48268.7us
I20260709 13:08:09.522850 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:09.524036 16604 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.453054 21262 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:09.424145 21021 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:09.515074 16632 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:09.520386 16386 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.461242 21250 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:09.538199 16386 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 11 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 13 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.515650 20755 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.548521 16386 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:09.569428 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:09.567399 20755 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.576067 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2594) took 1745 ms. Trace:
I20260709 13:08:09.576768 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:09.470177 21135 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:08:09.578630 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.539345 21142 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:09.579732 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.572209 17184 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.570204 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.535914 21323 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.539490 21250 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:09.570443 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:09.576438 16631 rpcz_store.cc:276] 0709 13:08:07.830643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.967223 (+136580us) service_pool.cc:224] Handling call
0709 13:08:09.249907 (+1282684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.304255 (+ 54348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.575889 (+271634us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000b2f50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:09.576015 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949257984}
I20260709 13:08:09.574618 16386 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.488150 21167 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:09.609149 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.611194 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:09.574745 20517 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.536958 21326 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:08:09.471573 21266 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:09.367856 21179 consensus_queue.cc:1175] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "16b5b367990f4b5c862484bdec0b9226" responder_term: 16 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: [15.12-15.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:09.628651 16635 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:09.625152 16386 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:09.540077 21330 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:09.648852 21285 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.779870 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:08:09.780049 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 256051us
W20260709 13:08:09.778893 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 208535us
I20260709 13:08:09.539819 20831 raft_consensus.cc:2764] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:09.844123 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.849833 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.787097 16456 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:09.779357 17186 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:09.824923 16386 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 12, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:09.851712 16386 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 7 to 9, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 9 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:09.809821 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:09.728364 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.852317 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:09.634859 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 117576us
W20260709 13:08:09.799633 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.848678 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.865473 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.857671 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:09.692415 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:09.880074 16487 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
W20260709 13:08:09.649102 21336 log.cc:927] Time spent T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:08:09.878930 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 91902.8us
I20260709 13:08:09.882057 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:09.882922 16456 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:09.878794 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 99023.8us
I20260709 13:08:09.583845 21142 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:09.884873 16456 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:09.629945 21250 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:09.848711 21331 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:08:09.917588 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.876781 16484 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:09.886762 16485 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:09.931406 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.885576 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.608881 21280 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:09.726686 21323 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:09.630270 21214 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:09.732131 21267 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:09.889195 21308 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:09.712293 21096 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:09.933493 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.059016 21333 log.cc:927] Time spent T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.371s	user 0.000s	sys 0.004s
W20260709 13:08:10.070386 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 194253us
I20260709 13:08:10.038367 20895 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:09.608690 21288 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:10.022296 21342 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:08:09.885568 21167 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.054171 21204 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:10.055886 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 205815us
I20260709 13:08:10.054139 21179 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:10.063992 21323 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:10.045426 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 160599us
I20260709 13:08:10.163986 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:10.057988 21168 consensus_meta.cc:287] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.001s
W20260709 13:08:10.058189 21012 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.000s
I20260709 13:08:09.931565 21326 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.930331 21264 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:10.002521 21283 log.cc:927] Time spent T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:08:09.844918 20517 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:09.885243 21295 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.855667 21135 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 13:08:09.881561 21290 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.876739 16488 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:09.648121 21316 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:10.071008 17183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.029s	sys 0.036s
W20260709 13:08:10.180990 17183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.030s	sys 0.036s
W20260709 13:08:10.071254 16565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.031s	sys 0.035s
W20260709 13:08:10.181612 16565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.031s	sys 0.035s
W20260709 13:08:10.041750 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 157965us
I20260709 13:08:10.182628 20921 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:10.082993 16563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.028s	sys 0.058s
I20260709 13:08:10.183924 20921 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:10.084604 16634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.007s	sys 0.067s
W20260709 13:08:10.184659 16634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.007s	sys 0.067s
W20260709 13:08:10.088415 17184 consensus_meta.cc:287] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.002s
I20260709 13:08:10.062211 21214 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:10.062427 20828 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:10.184772 20921 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.185041 17184 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:10.185213 20921 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.185971 20828 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.184381 16484 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:08:10.186264 20921 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:10.183975 16563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.028s	sys 0.058s
I20260709 13:08:10.187709 20921 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.187876 20828 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:10.185624 21214 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.189402 21214 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.166311 21288 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:10.190737 21288 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:10.191092 21288 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:10.064252 21267 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.068029 21096 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.193076 21096 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.193969 21096 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:10.080937 21286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.018s
W20260709 13:08:10.195981 21286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.018s
I20260709 13:08:09.650728 21262 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.076552 21319 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:10.082494 21320 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.062871 21280 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.088964 21021 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:10.163168 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:10.168280 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.169117 21126 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.201953 16456 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:10.170498 21347 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:10.171319 16639 raft_consensus.cc:2410] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:10.079739 21142 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.171257 21179 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:10.173393 21285 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:10.180567 21340 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:08:10.079008 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.186909 16484 pending_rounds.cc:85] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:08:10.066283 21281 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:10.191876 21288 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.195461 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.093640 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2325) took 1140 ms. Trace:
I20260709 13:08:10.196853 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.197976 16485 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:10.169656 21326 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.203971 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.169274 21226 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:10.205086 16456 leader_election.cc:400] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15.
I20260709 13:08:10.186497 20517 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:10.208102 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:10.207710 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.185140 21323 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:10.213599 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 379575us
I20260709 13:08:10.218216 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:10.205732 21315 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.207654 21295 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.210556 21204 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:10.230238 20709 consensus_meta.cc:287] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.928s	user 0.007s	sys 0.003s
W20260709 13:08:10.239519 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 170164us
W20260709 13:08:10.238158 16482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.004s
I20260709 13:08:10.210273 21264 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:10.207468 21126 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.206239 21320 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.342646 21288 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.371376 21320 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:10.213354 21179 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.343740 16559 rpcz_store.cc:276] 0709 13:08:08.953470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.954706 (+  1236us) service_pool.cc:224] Handling call
0709 13:08:08.954996 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.050015 (+ 95019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.050044 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.056077 (+  6033us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.340537 (+284460us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:09.340574 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.515364 (+174790us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b540040f954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:09.515421 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.083902 (+568481us) raft_consensus.cc:1685] finished
0709 13:08:10.083921 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.093567 (+  9646us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2699,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":2825,"spinlock_wait_cycles":217688960,"thread_start_us":245049,"threads_started":1,"wal-append.queue_time_us":423208}
I20260709 13:08:10.373210 21179 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:10.373746 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:10.298295 21354 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:08:10.374781 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:10.375274 16559 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.344391 16489 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:10.376660 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:10.377169 16489 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.378589 21126 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:10.251128 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2323) took 1298 ms. Trace:
I20260709 13:08:10.379945 16558 rpcz_store.cc:276] 0709 13:08:08.952965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.971575 (+ 18610us) service_pool.cc:224] Handling call
0709 13:08:08.984811 (+ 13236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.034056 (+ 49245us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:09.213467 (+179411us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.372219 (+158752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.372263 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.372322 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.884360 (+512038us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b1800037360. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419
0709 13:08:10.250882 (+366522us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b5400115154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:10.250953 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.251073 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27165,"prepare.queue_time_us":241667,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":27631,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":18101,"spinlock_wait_cycles":143159552,"thread_start_us":309979,"threads_started":2,"wal-append.queue_time_us":326104}
I20260709 13:08:10.381783 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.382288 16558 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:10.344738 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2650) took 1057 ms. Trace:
W20260709 13:08:10.346072 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 142167us
I20260709 13:08:10.347286 16491 raft_consensus.cc:2376] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16. Re-sending same reply.
I20260709 13:08:10.351641 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.238162 21224 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:10.245652 21307 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.256543 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.258661 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:10.277362 21024 consensus_meta.cc:287] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.930s	user 0.002s	sys 0.007s
I20260709 13:08:10.280483 21142 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:10.281653 21287 consensus_meta.cc:287] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.000s
I20260709 13:08:10.409842 16638 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:10.252683 21355 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.296500 21280 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:10.225972 21267 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.282351 21316 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.318418 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:10.335706 16639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2605) took 1078 ms. Trace:
W20260709 13:08:10.341728 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 262766us
I20260709 13:08:10.342417 21310 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.343606 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.354126 16605 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:10.355406 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:10.419679 17184 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:10.417631 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 365536us
I20260709 13:08:10.356032 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:10.384287 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 502322us
I20260709 13:08:10.426852 16604 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:10.358244 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:10.358842 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.428292 17181 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:10.359402 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.428766 17179 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
I20260709 13:08:10.429620 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.341905 16484 pending_rounds.cc:107] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 6.6
W20260709 13:08:10.298424 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 57828.4us
I20260709 13:08:10.430344 16484 raft_consensus.cc:2889] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:10.346724 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 143486us
I20260709 13:08:10.360610 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.351958 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:10.345490 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.359987 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.352227 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:10.368248 16482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.008s	sys 0.004s
I20260709 13:08:10.390821 16489 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:10.385938 16564 rpcz_store.cc:276] 0709 13:08:09.287291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.295477 (+  8186us) service_pool.cc:224] Handling call
0709 13:08:09.295736 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.304321 (+  8585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.304387 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.020680 (+716293us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b2c00010828. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:08:10.038533 (+ 17853us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.219514 (+180981us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:10.219550 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.219613 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.344443 (+124830us) raft_consensus.cc:1685] finished
0709 13:08:10.344462 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.344678 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7670,"raft.queue_time_us":7819,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":89749760,"thread_start_us":139181,"threads_started":1,"wal-append.queue_time_us":278449}
I20260709 13:08:10.353281 21204 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.347028 20517 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.392398 16558 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.369704 21264 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:10.392917 21070 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:10.345494 21326 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.347855 21238 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:10.401628 16562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.002s	sys 0.047s
W20260709 13:08:10.448038 16562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.002s	sys 0.047s
W20260709 13:08:10.314036 21341 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:08:10.408802 16565 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:08:10.410293 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.451725 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.452236 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1553) took 1028 ms. Trace:
W20260709 13:08:10.414021 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.452616 16484 rpcz_store.cc:276] 0709 13:08:09.423512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.931983 (+508471us) service_pool.cc:224] Handling call
0709 13:08:09.932608 (+   625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.442387 (+509779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.452020 (+  9633us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400332cd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:10.452181 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578311424}
I20260709 13:08:10.454604 16632 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:10.415901 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2608) took 1157 ms. Trace:
I20260709 13:08:10.455137 16638 rpcz_store.cc:276] 0709 13:08:09.258025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.306949 (+ 48924us) service_pool.cc:224] Handling call
0709 13:08:10.415641 (+1108692us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003f1454. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:10.415742 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534596480}
I20260709 13:08:10.442121 21267 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.416117 16559 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:10.434435 16639 rpcz_store.cc:276] 0709 13:08:09.257223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.257321 (+    98us) service_pool.cc:224] Handling call
0709 13:08:10.335502 (+1078181us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54003d2a54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:10.335650 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934195584}
I20260709 13:08:10.438504 17180 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:10.419035 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.461062 21310 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.462076 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.462858 21126 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.297554 21330 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:10.435668 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 81622.2us
I20260709 13:08:10.463290 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.440377 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.442269 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.463874 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:10.352763 21250 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.443704 16483 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.445739 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.446895 16634 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:10.464984 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:10.443594 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2330) took 1471 ms. Trace:
I20260709 13:08:10.406486 21307 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.443881 21280 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.355538 21167 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.404985 21224 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.447912 21238 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.475546 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.476660 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:10.456067 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.478416 16529 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:10.478609 17184 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:10.442941 21264 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.465523 16490 rpcz_store.cc:276] 0709 13:08:08.971980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.204205 (+232225us) service_pool.cc:224] Handling call
0709 13:08:10.443426 (+1239221us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400178c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:10.443545 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2800219904}
W20260709 13:08:10.349376 20755 consensus_meta.cc:287] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.766s	user 0.006s	sys 0.001s
I20260709 13:08:10.466255 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.470355 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.450666 21316 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.450186 21323 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:08:10.441715 21204 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.482395 16529 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:10.416647 21355 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.486816 17180 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.450850 21285 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:10.520301 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2344) took 1493 ms. Trace:
W20260709 13:08:10.458958 21295 consensus_queue.cc:1175] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "16b5b367990f4b5c862484bdec0b9226" responder_term: 12 status { last_received { term: 12 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 12 } }
W20260709 13:08:10.498027 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.485350 21226 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:10.516615 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 70929.3us
I20260709 13:08:10.485177 21320 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.447800 21354 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:10.516032 21192 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.469794 21126 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:10.517383 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 74715.3us
I20260709 13:08:10.473135 21280 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:10.525691 21301 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:10.516850 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.522652 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 629) took 2631 ms. Trace:
I20260709 13:08:10.520645 16482 rpcz_store.cc:276] 0709 13:08:09.027316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.397574 (+370258us) service_pool.cc:224] Handling call
0709 13:08:09.397836 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.398025 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:09.688796 (+290771us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.520002 (+831206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.520049 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:10.520093 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.520150 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.520251 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14801,"prepare.queue_time_us":149814,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1903,"raft.queue_time_us":23049,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9828,"thread_start_us":1105389,"threads_started":3,"wal-append.queue_time_us":664306}
I20260709 13:08:10.453969 21266 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:08:10.528721 16639 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 13:08:10.532042 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 55462.5us
I20260709 13:08:10.486737 21316 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.534387 16634 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.551396 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:10.551313 21192 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:10.472756 21214 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:10.542023 16632 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:10.543883 17185 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:08:10.517407 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 72897.1us
I20260709 13:08:10.548844 16483 rpcz_store.cc:276] 0709 13:08:07.891592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.353386 (+1461794us) service_pool.cc:224] Handling call
0709 13:08:10.443540 (+1090154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.464753 (+ 21213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.522441 (+ 57688us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400178c50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:10.522583 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506509568}
I20260709 13:08:10.527231 21226 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.527379 21362 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.540560 21358 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.554323 21316 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.529855 21320 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:10.487799 20755 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.561959 16634 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.554150 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:10.554319 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 90547.3us
I20260709 13:08:10.547879 21280 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.572126 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:10.573194 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.574218 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:10.575706 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.559412 21012 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.578933 20895 consensus_queue.cc:1059] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:10.579288 21012 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.579761 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.580479 21118 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.581087 21118 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:10.581305 21012 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:10.582628 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.583297 21172 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.583673 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.584028 21363 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:10.565924 21330 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.584554 21363 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:10.585372 21363 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.585990 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.587249 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:10.587873 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.559233 21179 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:10.554414 21301 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:10.573817 16604 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.553449 21192 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:10.556017 21359 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.589520 16605 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.590603 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:10.571110 21358 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.594046 21126 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.600028 16486 raft_consensus.cc:2368] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:10.570642 21226 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.602427 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:10.603277 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.605067 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.570163 21320 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.607460 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.587770 21281 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.555886 20517 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:10.592075 21024 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.588001 21021 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:10.575767 21214 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:10.587891 21262 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:10.546420 21264 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:10.617317 21356 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:10.631657 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.632045 21307 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:10.641166 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.548889 21238 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.630411 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.607621 21179 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:10.648672 21308 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:08:10.659317 21179 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.630467 21118 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:10.643949 21028 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.587962 21168 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.649144 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2649) took 1362 ms. Trace:
W20260709 13:08:10.650738 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 53388.6us
W20260709 13:08:10.653268 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 50066.7us
I20260709 13:08:10.616969 21362 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.629617 21172 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.616250 21358 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.573015 21170 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:10.663569 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:10.680241 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:10.647116 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75139.1us
I20260709 13:08:10.665174 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.683528 16559 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:10.667227 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.667906 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.684971 16558 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:10.669941 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:10.604316 21192 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.672749 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.688557 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.671258 21264 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.616044 20895 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:10.677170 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:10.650734 21359 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.671361 21250 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:10.670962 20517 consensus_queue.cc:1243] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:10.670610 21285 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.690304 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.674929 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:10.692965 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:10.731590 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.732235 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:10.732643 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.694861 16484 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:10.695876 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:10.733587 16482 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.695912 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.733984 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.670898 20828 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.672010 21308 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.673475 16560 rpcz_store.cc:276] 0709 13:08:09.287081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.295296 (+  8215us) service_pool.cc:224] Handling call
0709 13:08:09.295570 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.302910 (+  7340us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:09.303467 (+   557us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.585475 (+282008us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.747070 (+161595us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18003cfe80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e522 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:08:10.069873 (+322803us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b18003cfe80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f0636483060 00007f0636495716 00007f06364a6287 00007f06364a6208
0709 13:08:10.070015 (+   142us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.080953 (+ 10938us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.081093 (+   140us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:10.081127 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.081186 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.313484 (+232298us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:10.648920 (+335436us) raft_consensus.cc:1685] finished
0709 13:08:10.648949 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.649085 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164326,"prepare.queue_time_us":3179,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":495628,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":54597,"spinlock_wait_cycles":19443072,"thread_start_us":276382,"threads_started":1,"wal-append.queue_time_us":761484}
I20260709 13:08:10.678308 21267 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:10.679479 21238 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.699806 21214 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.700323 21168 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.701123 20755 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:10.678994 21224 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:10.672783 21262 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:10.776271 21262 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.702090 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:10.779399 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.704389 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.705988 16635 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.708047 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2663) took 1408 ms. Trace:
I20260709 13:08:10.780165 16488 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:10.708289 21326 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.696982 21287 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:10.712646 20895 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:10.793306 20895 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.785970 21320 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.794081 20895 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.795037 21320 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:10.795208 20895 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.713068 16639 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.714520 21070 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:10.796909 21070 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.797439 21126 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.797698 21070 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.799028 21070 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:10.720325 21371 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:10.643965 21286 consensus_queue.cc:1059] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:10.800271 21286 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:10.800586 21286 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:10.801281 21286 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.802292 21286 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:10.720994 21378 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:10.801901 21287 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.805197 21287 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:08:10.806977 16561 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:10.807337 16561 pending_rounds.cc:85] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 10
I20260709 13:08:10.807546 16561 pending_rounds.cc:107] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:10.723500 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:10.807744 16561 raft_consensus.cc:2889] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:10.678514 21172 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:10.729396 21315 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.808187 21172 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.808892 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2672) took 1129 ms. Trace:
I20260709 13:08:10.809252 16561 rpcz_store.cc:276] 0709 13:08:09.679144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.754394 (+ 75250us) service_pool.cc:224] Handling call
0709 13:08:09.754720 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.808188 (+1053468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.808704 (+   516us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540007e4d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:10.808843 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419234688}
I20260709 13:08:10.810350 16490 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.738451 17188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:08:10.812047 17188 raft_consensus.cc:606] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:10.812368 17188 raft_consensus.cc:614] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:10.676632 21281 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:08:10.734522 16484 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:10.676468 21217 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:10.678992 21307 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:08:10.815229 21307 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:10.815614 21307 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:10.815981 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:10.816345 21307 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.817518 21307 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.815135 21217 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.818164 21217 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:10.818907 21217 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.723469 21118 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.819950 21217 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.722146 21021 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.820564 21021 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.822515 21021 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:10.761677 21226 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.764523 21316 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.823773 16632 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:10.767061 21280 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.825803 21226 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:10.826305 21280 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:10.768926 21375 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:10.826936 21375 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.827661 21375 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.828819 21375 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.682542 21301 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.832222 16637 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:10.772298 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 97609.6us
I20260709 13:08:10.833549 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:10.833987 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 46712.2us
I20260709 13:08:10.773181 21267 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.773627 21374 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:10.774199 20831 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:10.740846 21355 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:10.720974 21024 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:10.745122 16486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1561) took 1270 ms (client timeout 1510 ms). Trace:
I20260709 13:08:10.780373 16562 rpcz_store.cc:276] 0709 13:08:09.299614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.425315 (+125701us) service_pool.cc:224] Handling call
0709 13:08:09.458938 (+ 33623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:09.527511 (+ 68573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.527543 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:09.564849 (+ 37306us) log.cc:844] Serialized 52 byte log entry
0709 13:08:10.448395 (+883546us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:10.448431 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.448492 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.707849 (+259357us) raft_consensus.cc:1685] finished
0709 13:08:10.707870 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.707996 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40117,"raft.queue_time_us":80236,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":20562,"thread_start_us":880989,"threads_started":1,"wal-append.queue_time_us":898214}
I20260709 13:08:10.786437 16482 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:10.756457 21308 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.788103 16485 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:10.863826 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:10.865682 16485 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.865917 16632 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.789309 21028 raft_consensus.cc:993] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:10.817664 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:10.837723 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 121794us
W20260709 13:08:10.843747 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 120331us
I20260709 13:08:10.845379 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:10.849996 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.861649 16486 rpcz_store.cc:269] 0709 13:08:09.474328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.565235 (+ 90907us) service_pool.cc:224] Handling call
0709 13:08:10.742859 (+1177624us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400177854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:10.745065 (+  2206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342925056}
I20260709 13:08:10.838198 21267 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.741015 21359 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:08:10.837755 21315 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:10.866523 16485 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.868793 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:10.842989 21374 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:10.850239 21362 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.848388 21170 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:08:10.848724 20831 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:10.888332 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:10.888358 21168 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.878960 16485 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.881829 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:10.885221 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:10.887658 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.890601 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:10.891119 16560 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.891080 16558 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:10.865398 21355 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:10.872742 21363 raft_consensus.cc:1081] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:10.906822 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:10.909633 16560 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:10.875559 21267 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.913883 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:10.867453 21192 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.850662 21376 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:08:10.914453 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:10.888867 20831 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.923288 16632 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:10.901515 21028 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.905380 21366 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.930668 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 209021us
I20260709 13:08:10.931983 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.935014 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:10.915899 21142 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:10.937188 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.944247 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:10.944872 16484 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:10.939477 20921 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:08:10.916535 21320 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:11.116402 21316 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:11.091321 21392 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:08:11.009811 21172 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:11.088375 21396 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:08:11.091751 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 186192us
I20260709 13:08:10.988698 21142 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.233146 21315 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:11.233649 21315 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:11.233141 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:11.234977 17181 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:11.237234 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:11.180074 16559 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:10.987601 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:10.940709 21366 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.972232 21374 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:11.031308 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 152184us
I20260709 13:08:10.936553 21204 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.210352 21070 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.974015 16455 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:11.119015 21358 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:10.925103 21319 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:08:11.105302 21295 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:08:11.104883 21394 log.cc:927] Time spent T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:08:11.113229 21267 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:10.982923 21281 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:11.022897 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.046969 16562 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:10.936314 16558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:11.264955 16558 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.939355 21168 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:10.916327 21355 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.070950 21192 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:10.988343 21288 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:10.986335 21390 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:10.924055 20828 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:10.971424 21096 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:11.076462 16566 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:10.972882 16485 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.927816 21028 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.126472 16563 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:08:11.077864 17152 leader_election.cc:336] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.537s (SENT)
I20260709 13:08:11.218045 21320 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:11.003640 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.046113 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.973618 16484 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
W20260709 13:08:10.981817 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 46884.5us
I20260709 13:08:11.282320 16604 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:11.283398 16604 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:11.284406 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:11.076167 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.225981 21226 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:11.206373 21217 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:11.227244 17187 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.229983 21172 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:11.244490 16559 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:11.249846 21363 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:11.274971 21374 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.292147 16559 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:11.244812 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.292285 21355 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.279765 21028 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:11.249416 16530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.030s	sys 0.039s
W20260709 13:08:11.293799 16530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.030s	sys 0.039s
W20260709 13:08:11.294078 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 561867us
I20260709 13:08:11.294654 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:08:11.295111 21238 consensus_meta.cc:287] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.002s
I20260709 13:08:11.295679 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:08:11.250793 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 276857us
I20260709 13:08:11.256713 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.273345 20755 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:11.162048 16487 raft_consensus.cc:2410] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:08:11.258585 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:11.299742 21217 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.316162 17181 raft_consensus.cc:2393] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:11.248876 21142 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:11.265327 16558 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.317423 21217 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:11.321071 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.266554 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.277617 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:10.987053 21387 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:11.300812 21267 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.322678 21267 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:11.285396 16564 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.323129 21267 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.324083 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.324676 16485 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:11.325027 21267 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.325407 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.271951 21168 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.321903 16565 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:11.304097 21288 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.267810 20921 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:08:11.327739 21319 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.304129 21172 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.328817 21172 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:11.329191 21172 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.288888 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:11.304627 21250 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:11.330988 21250 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.296384 16561 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.257776 16557 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:11.332698 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.333280 16557 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:11.326102 16489 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:11.334039 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.334223 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:11.334596 16557 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.326051 16482 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:11.296568 21192 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.337319 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:11.297062 21287 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:11.297843 21204 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:11.274452 20828 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.299170 21366 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:11.234519 21315 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.261562 21070 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.305747 21358 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:11.295943 21281 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.260763 20517 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:08:11.278396 21096 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.315477 21316 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:11.323129 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:11.301275 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:11.337567 16634 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.338454 16631 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:11.364094 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 62895.5us
I20260709 13:08:11.365187 16530 leader_election.cc:400] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:11.365494 16530 leader_election.cc:403] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:11.340662 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 56317.7us
I20260709 13:08:11.341199 20828 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:11.334625 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 256779us
I20260709 13:08:11.331339 21250 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:11.378420 16564 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:11.383342 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:11.394008 16631 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:11.394987 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:11.395599 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.396471 16564 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:11.388700 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:11.311664 21320 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.340023 21359 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:11.315065 20755 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:11.381980 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:11.399116 17186 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.402428 16557 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:11.403304 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.384503 16558 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:11.406457 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 70473.1us
I20260709 13:08:11.347113 21288 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:11.408087 16561 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:11.408296 16557 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.410641 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:11.308733 21226 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.451977 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.392740 21192 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.454521 17181 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:11.398130 21366 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.363214 21316 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:11.461671 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.413156 16487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50636 (request call id 637) took 1216 ms (client timeout 1537 ms). Trace:
I20260709 13:08:11.454108 16561 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:11.479734 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:11.479010 16487 rpcz_store.cc:269] 0709 13:08:10.196772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.196889 (+   117us) service_pool.cc:224] Handling call
0709 13:08:11.410586 (+1213697us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54000e7c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:11.413100 (+  2514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872783232}
I20260709 13:08:11.481009 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.481721 16561 raft_consensus.cc:2393] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:11.300421 21028 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.398725 21250 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.558545 16558 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:11.558833 17186 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:11.468190 16557 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:11.408241 20831 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.450158 21319 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.405797 21315 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.455171 21288 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.406793 21286 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.565969 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.629254 16564 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.566447 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.630523 16561 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:11.576376 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.399775 21179 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:08:11.580104 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.647315 16557 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:11.648221 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.648936 16557 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 13: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:11.649255 16558 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:11.458014 21214 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.581940 16634 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:11.453310 21397 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:11.409837 21358 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.405181 21359 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:11.398480 21142 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.194s
I20260709 13:08:11.600978 21226 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.664721 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.602177 21096 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:11.583734 21287 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.567368 21264 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:11.608688 21172 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.611384 21070 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.659087 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:11.682221 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.663348 16557 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:11.565181 21366 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.618969 21288 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:11.739447 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 80449.2us
I20260709 13:08:11.685218 16563 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:11.662592 16564 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:11.759078 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:11.759557 16566 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:11.660131 21375 consensus_meta.cc:287] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.831s	user 0.010s	sys 0.001s
I20260709 13:08:11.766717 16559 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:11.767287 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.666625 21358 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:11.738933 21266 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:11.772594 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.773151 16563 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:11.741600 21381 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:11.773660 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:11.652539 21286 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.771005 21295 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:11.811174 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:11.820847 16563 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:11.822882 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:11.823107 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.824730 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:11.766637 21290 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:08:11.760994 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 294888us
W20260709 13:08:11.827039 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 376550us
W20260709 13:08:11.827562 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 65592us
I20260709 13:08:11.776149 21266 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:11.834998 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.836723 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:11.837296 16482 raft_consensus.cc:2376] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10. Re-sending same reply.
I20260709 13:08:11.839675 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:11.839942 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:11.840603 16491 raft_consensus.cc:2368] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:11.841104 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.841380 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.841882 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.842950 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.666275 20828 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.844254 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.843459 16485 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:11.811568 21323 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.814169 20517 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.892503 20517 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:11.892928 21290 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:11.847818 21358 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.849519 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:11.894559 16564 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:11.850117 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.895046 16487 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:11.836104 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:11.668618 20755 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.852592 21374 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:11.854660 21295 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:11.855827 21326 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.847774 21266 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.851603 16484 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:11.830770 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:11.832901 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:11.861111 21391 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:11.832206 16604 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:11.854848 16483 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:11.872298 21285 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.876680 21286 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.882696 16491 raft_consensus.cc:2393] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:11.883356 16563 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.757472 21287 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.889508 21330 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:11.943351 16634 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:11.667308 21359 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.944772 21359 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.891572 21323 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.947108 21323 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:11.843394 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.947861 21179 consensus_queue.cc:1175] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "035eaa2f12374a81a4df7868a5453d3c" responder_term: 12 status { last_received { term: 10 index: 7 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:08:11.948635 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0870322879999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:08:11.949018 16530 connection.cc:256] RPC call timeout handler was delayed by -1.0627322880000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:08:11.949569 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:11.950572 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:11.951388 21172 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.852061 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:11.953435 21286 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.897017 16632 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.954330 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:11.954952 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:11.956168 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:11.956823 16632 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:11.956609 21250 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.957535 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:11.898887 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:11.900628 21028 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:11.958624 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:11.898824 16635 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:11.963004 21404 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.753s	user 0.000s	sys 0.008s
I20260709 13:08:11.899904 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:11.927911 21168 consensus_meta.cc:287] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.005s
I20260709 13:08:11.966420 21168 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:11.902742 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 432913us
I20260709 13:08:11.930286 16639 raft_consensus.cc:2368] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
W20260709 13:08:11.967689 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 136797us
I20260709 13:08:11.902086 21374 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.928583 21391 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:11.972441 21374 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.909155 21326 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:11.934293 21295 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:11.957645 16631 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.680951 21316 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.951577 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:11.965299 16632 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:11.992311 16632 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:11.893436 20517 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:11.968036 21415 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:11.974501 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:11.953308 21142 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.993960 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:11.997014 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:11.968567 21168 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:11.997843 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.000605 16640 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.977767 21323 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:12.000234 21172 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:12.005698 21326 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.006420 21417 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.998674 16632 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:11.997697 21415 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:12.007464 21415 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.007905 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.009532 21096 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.009861 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:12.011772 20828 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:12.012495 21366 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:12.007040 21281 consensus_meta.cc:287] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.001s
I20260709 13:08:12.013934 21281 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.004997 21192 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.007937 16488 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:11.993155 21376 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:11.932971 21285 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.018607 21288 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.006886 21417 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.020382 21285 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:12.002914 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.018834 16557 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.024248 16565 raft_consensus.cc:1240] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:12.047827 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44971us
I20260709 13:08:12.048558 16530 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.022603 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:12.052675 21397 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.020849 21417 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.021585 21290 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.021762 21363 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.056898 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:12.059422 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.063151 21397 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.064352 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.065032 21397 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.067451 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:12.067886 21414 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:12.068470 21414 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.069671 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.059486 17186 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:12.051411 21172 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.051590 21192 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:12.078747 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 245900us
I20260709 13:08:12.075593 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:12.079341 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:12.081260 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:12.090420 16488 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.081492 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:12.058949 21290 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.083268 16530 leader_election.cc:400] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:12.051963 21096 consensus_queue.cc:1059] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:12.083968 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:12.007010 21295 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.076766 21397 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.050287 21323 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:12.082578 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 250428us
I20260709 13:08:12.108526 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:12.109237 16483 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:12.111241 16485 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:12.112737 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:12.113268 16485 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:12.093530 16530 leader_election.cc:403] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.093159 16557 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:12.092630 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:12.075600 21375 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:08:12.082621 21192 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.121053 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.124528 16487 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:08:12.126121 16487 pending_rounds.cc:85] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 6
I20260709 13:08:12.126317 16487 pending_rounds.cc:107] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:08:12.126657 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:12.094739 21290 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.129845 21172 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13.
I20260709 13:08:12.126518 16487 raft_consensus.cc:2889] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.084081 21374 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.110832 21418 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.094487 21417 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:12.115492 21288 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:12.139034 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 131223us
I20260709 13:08:12.140888 16488 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:12.141520 16485 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: [11.5-13.6]
I20260709 13:08:12.131913 21286 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.132210 21172 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:12.137319 21411 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:12.144773 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:12.146337 16487 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.111167 21397 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.148722 16483 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:12.136667 21418 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.157073 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.157665 16640 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:12.157681 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.158790 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:12.159361 16565 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.155936 20831 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:12.153354 21285 consensus_queue.cc:1059] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:08:12.164956 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:12.165518 16560 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.165946 21423 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:12.162688 21288 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:08:12.170174 21397 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.151903 21418 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.173411 21374 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.175972 21330 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.176170 16635 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:12.176582 21330 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.177815 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:12.178284 21323 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.178635 21330 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:12.179116 21330 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.173342 16565 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:12.181126 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.183475 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.184721 21323 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:12.185364 21323 consensus_queue.cc:1243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:12.185792 21323 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:12.186092 21323 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:12.186173 21414 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:12.186941 21323 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.185811 21192 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.193780 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:12.144879 21424 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:12.194687 21424 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:12.194931 21192 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.195210 21415 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.196019 21192 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.197232 21266 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.197939 21192 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.198470 16491 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:12.199591 21266 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:12.200152 21315 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.200652 21315 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.201042 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:12.201730 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.202189 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:12.194357 16490 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.202641 21315 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:12.202919 16560 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:12.184219 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:12.204846 21414 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:12.205274 21414 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:12.206032 21414 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.194200 21167 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:12.208216 21167 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:12.208964 21167 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.209367 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.210039 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:12.210196 21167 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.210481 20831 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.210640 20921 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.209039 21424 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.211166 20921 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.213136 20921 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:12.216651 21391 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.218127 21391 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.218400 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:12.219053 16635 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:12.202714 16564 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.221096 21418 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.221809 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:12.222808 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:12.179500 21330 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.223398 16565 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:12.224618 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:12.226998 16635 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.225214 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:12.228441 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.197395 21415 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.234308 16490 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:12.226289 16604 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:12.250126 16557 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:12.234737 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:12.200433 21323 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.200313 21142 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.223049 21418 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:12.194347 21290 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.219707 21267 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:12.256960 16635 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:12.256341 16632 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.250720 16564 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:12.262161 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:12.252879 16565 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:12.273588 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:12.274497 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:12.261587 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:12.251969 16557 raft_consensus.cc:1240] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.275007 16490 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.276187 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:12.239327 16487 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:12.277717 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:12.278271 16487 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:12.278777 16558 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:12.280428 16632 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:12.251341 20921 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.251209 21315 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.285475 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:12.291098 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 56435.2us
I20260709 13:08:12.251976 21416 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:12.308595 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.304247 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:12.310433 21179 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.310920 21179 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.310725 21028 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:12.311296 21179 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.311718 21281 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.312145 21281 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:12.312999 21281 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.314574 21281 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:12.317905 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.320957 21413 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.280221 21418 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.293308 20921 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.295763 21359 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.321483 21413 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.337610 21330 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:12.304215 21415 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.260044 21267 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.310436 16490 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:12.305266 21315 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.308780 20831 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:12.383106 21267 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.383602 21315 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.295452 21363 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:08:12.384833 21359 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:12.329247 21418 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:12.416877 21418 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:12.517478 21419 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.366s	user 0.000s	sys 0.004s
I20260709 13:08:12.643826 21290 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:12.699663 20831 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.703395 20831 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.706295 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:12.756289 21414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.012s
W20260709 13:08:12.756912 21414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.012s
I20260709 13:08:12.771864 21414 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.772734 21414 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.775336 21414 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:12.803666 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.360419 21179 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:12.807220 21179 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:12.827313 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.840324 21414 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.841090 21414 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:12.849902 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.857021 20831 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:12.857836 20831 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.861038 20831 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.861961 21414 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:12.863657 16639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35424 (request call id 2642) took 1527 ms (client timeout 1811 ms). Trace:
W20260709 13:08:12.866824 16639 rpcz_store.cc:269] 0709 13:08:11.336513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.337123 (+   610us) service_pool.cc:224] Handling call
0709 13:08:12.863217 (+1526094us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54003264d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:12.863448 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360326016}
I20260709 13:08:12.865969 16485 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.869935 16485 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:12.872737 21224 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.873440 21224 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.875602 21224 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.881028 21224 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.881765 21224 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.884053 21224 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.895409 20831 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:12.907980 20831 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:12.910640 20831 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:12.901268 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:12.918303 16560 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:12.903021 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:12.927026 16566 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
W20260709 13:08:12.895457 16530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.008s	sys 0.019s
I20260709 13:08:12.368466 21330 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.906343 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:12.913630 17186 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:12.338994 20921 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.903050 21021 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:12.915280 21359 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:12.984650 20755 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.015s	sys 0.003s
I20260709 13:08:12.990727 21238 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:13.004587 21288 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.010020 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1601) took 1111 ms. Trace:
I20260709 13:08:13.017940 21168 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.039736 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50636 (request call id 651) took 1033 ms. Trace:
I20260709 13:08:13.042677 21179 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.044028 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1567) took 1141 ms. Trace:
I20260709 13:08:13.045943 21250 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
W20260709 13:08:13.049258 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.077195 21287 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.077409 21315 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:13.071326 21323 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.007s
I20260709 13:08:13.185654 21021 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.078997 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:13.196254 17188 raft_consensus.cc:2410] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:13.079152 21326 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.197146 16558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2382) took 1014 ms. Trace:
I20260709 13:08:13.197785 21315 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.197600 16558 rpcz_store.cc:276] 0709 13:08:12.182869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.206224 (+ 23355us) service_pool.cc:224] Handling call
0709 13:08:12.278566 (+ 72342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.279125 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.196167 (+917042us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b54001c8250. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:13.196945 (+   778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165691264}
I20260709 13:08:13.198468 21168 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.081501 17180 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:13.082640 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.200855 17187 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:13.201028 21168 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.083961 17185 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.201659 21168 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.202355 21168 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.085338 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.203480 21288 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.204455 17179 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:13.205925 21288 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.194607 21179 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.207165 21330 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.208961 21179 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.209345 21330 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.100926 16636 raft_consensus.cc:1240] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:13.109504 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.112722 16561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2692) took 1742 ms. Trace:
I20260709 13:08:13.118175 21316 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.363112 21413 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:13.143307 21407 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 1.329s	user 0.003s	sys 0.000s
I20260709 13:08:13.145509 21290 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.149628 21262 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.151983 21362 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.154908 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.156098 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.157079 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.158242 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.159485 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.164636 21358 consensus_queue.cc:1059] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:13.171178 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:13.161094 21167 consensus_meta.cc:287] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.935s	user 0.008s	sys 0.008s
W20260709 13:08:13.189973 16530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.013s	sys 0.019s
I20260709 13:08:13.188901 16491 rpcz_store.cc:276] 0709 13:08:12.006246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.006358 (+   112us) service_pool.cc:224] Handling call
0709 13:08:12.006606 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.198858 (+192252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.039216 (+840358us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400050ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:13.039567 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440872320}
I20260709 13:08:13.188043 16631 rpcz_store.cc:276] 0709 13:08:11.898005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.898114 (+   109us) service_pool.cc:224] Handling call
0709 13:08:11.898396 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.977621 (+ 79225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.009464 (+1031843us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b54002c8154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:13.009806 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135857920}
W20260709 13:08:13.191706 20755 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.016s	sys 0.004s
I20260709 13:08:13.080266 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.191320 16486 rpcz_store.cc:276] 0709 13:08:11.834655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.834755 (+   100us) service_pool.cc:224] Handling call
0709 13:08:12.975537 (+1140782us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54002774d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:12.975773 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132698368}
I20260709 13:08:13.086437 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.187304 21238 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:13.223135 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2393) took 1003 ms. Trace:
I20260709 13:08:13.216128 16561 rpcz_store.cc:276] 0709 13:08:11.369715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.633694 (+263979us) service_pool.cc:224] Handling call
0709 13:08:11.633964 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.814693 (+180729us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:11.856839 (+ 42146us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.209262 (+352423us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b18002bd260. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:08:12.843357 (+634095us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b18002bd260. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:08:12.859316 (+ 15959us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.860119 (+   803us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.860262 (+   143us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:12.861112 (+   850us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.861477 (+   365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.112239 (+250762us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540007e4d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:13.112290 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.112338 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:13.112351 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.112543 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":239900,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":1614,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":7928,"spinlock_wait_cycles":586824064,"thread_start_us":15023,"threads_started":1,"wal-append.queue_time_us":1000108}
I20260709 13:08:13.237950 17185 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:13.243247 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 72342.1us
W20260709 13:08:13.244601 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 1.11793e+06us
I20260709 13:08:13.245231 21358 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:13.245057 21262 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.250391 16487 rpcz_store.cc:276] 0709 13:08:12.219534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.278865 (+ 59331us) service_pool.cc:224] Handling call
0709 13:08:13.223042 (+944177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:13.253424 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.254225 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 1604) took 1355 ms. Trace:
I20260709 13:08:13.252637 21358 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.255646 21358 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.257597 21168 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.254640 16636 rpcz_store.cc:276] 0709 13:08:11.898803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.898909 (+   106us) service_pool.cc:224] Handling call
0709 13:08:11.899143 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.222539 (+1323396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.253943 (+ 31404us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540043b554. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:13.254152 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2757759872}
I20260709 13:08:13.261484 16638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2632) took 2278 ms. Trace:
I20260709 13:08:13.264895 17181 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:13.265758 16635 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:13.244839 21290 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.268438 21290 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.270255 16562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2680) took 2016 ms. Trace:
I20260709 13:08:13.271145 21168 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:13.271399 21413 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.272022 21413 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.269863 21021 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.273247 21167 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.273667 21167 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.274076 21167 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.261847 16638 rpcz_store.cc:276] 0709 13:08:10.982620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.985800 (+  3180us) service_pool.cc:224] Handling call
0709 13:08:10.986153 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.986486 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.986513 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.986998 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.411604 (+424606us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:11.411641 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.411706 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.142437 (+1730731us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:13.250317 (+107880us) raft_consensus.cc:1685] finished
0709 13:08:13.250336 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.261292 (+ 10956us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1259,"raft.queue_time_us":971,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":12405,"spinlock_wait_cycles":3234048,"thread_start_us":424272,"threads_started":1,"wal-append.queue_time_us":757695}
I20260709 13:08:13.274799 21168 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.276050 21413 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.274375 21323 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.277144 21168 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.269829 21238 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.280390 21358 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.281129 21238 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.282531 21358 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:13.274462 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 188292us
I20260709 13:08:13.283402 21262 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.254825 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.283703 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.284605 21323 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.285274 16530 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.285447 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.286254 20831 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.286736 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.270624 16562 rpcz_store.cc:276] 0709 13:08:11.254087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.288612 (+ 34525us) service_pool.cc:224] Handling call
0709 13:08:11.306463 (+ 17851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.306832 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:11.449857 (+143025us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.080817 (+630960us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.091008 (+ 10191us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.091143 (+   135us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.091173 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.091233 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.516205 (+424972us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:13.264095 (+747890us) raft_consensus.cc:1685] finished
0709 13:08:13.269942 (+  5847us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.270103 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":373012,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":899,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":2007,"spinlock_wait_cycles":3921792,"thread_start_us":570714,"threads_started":2,"wal-append.queue_time_us":551957}
W20260709 13:08:13.297696 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.299304 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 131) took 10686 ms. Trace:
I20260709 13:08:13.277211 21330 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.274104 21021 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.290227 21362 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.304737 16388 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 12 to 13, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:13.306123 21330 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.307166 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2386) took 1190 ms. Trace:
I20260709 13:08:13.307988 21426 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.308506 21418 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.302798 21168 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.310181 16482 rpcz_store.cc:276] 0709 13:08:12.116803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.118692 (+  1889us) service_pool.cc:224] Handling call
0709 13:08:12.118933 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.119123 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:12.341079 (+221956us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.306538 (+965459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.306630 (+    92us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:13.306704 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.306793 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.307010 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":509265,"prepare.queue_time_us":278770,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":511697,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":677161,"threads_started":2,"wal-append.queue_time_us":455979}
I20260709 13:08:13.331562 21362 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:13.331887 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.334302 21400 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.334978 21400 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.338271 21168 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.338532 20921 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.339960 21224 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.340453 21224 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.342329 16455 leader_election.cc:400] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
I20260709 13:08:13.342576 21224 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.344518 20831 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.332036 21426 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.348143 21426 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.349267 21426 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.349802 21426 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.352205 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.352485 20517 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.353087 16562 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:08:13.354005 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.355268 21375 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.355662 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:13.355211 16561 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:13.356261 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 70963.9us
I20260709 13:08:13.356590 16455 leader_election.cc:403] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.360455 16489 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:13.342859 21264 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.342523 21323 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.360244 21426 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.368221 21267 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.368548 16637 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:13.368794 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.375114 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2394) took 1150 ms. Trace:
I20260709 13:08:13.369086 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.364034 21168 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:13.370501 21330 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.370070 16388 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:13.371774 20921 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.380190 21281 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.352094 20895 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.380650 21281 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.381085 20895 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.383597 20895 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.376926 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.345777 21295 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.375458 16489 rpcz_store.cc:276] 0709 13:08:12.224385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.705632 (+481247us) service_pool.cc:224] Handling call
0709 13:08:13.374944 (+669312us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54000e7c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:13.375062 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497725312}
W20260709 13:08:13.380067 16637 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 1606) took 1476 ms (client timeout 1563 ms). Trace:
I20260709 13:08:13.384013 16558 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:13.388875 16562 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.345718 21167 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:13.385819 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.353020 20517 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.355818 21375 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:13.388430 16637 rpcz_store.cc:269] 0709 13:08:11.904139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.954110 (+ 49971us) service_pool.cc:224] Handling call
0709 13:08:13.379878 (+1425768us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002099d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:13.380018 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3153093888}
I20260709 13:08:13.393805 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:13.395776 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:13.397150 20831 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.345893 21418 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:13.401661 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 59683.5us
I20260709 13:08:13.402199 16561 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.404825 21418 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:13.405416 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8fa0 after lost signal to thread 15387
W20260709 13:08:13.406569 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee760 after lost signal to thread 16423
I20260709 13:08:13.400012 21264 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.378556 21168 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.385200 21362 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:13.426844 21168 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.418166 20921 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
I20260709 13:08:13.299654 16386 rpcz_store.cc:276] 0709 13:08:02.612516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.612775 (+   259us) service_pool.cc:224] Handling call
0709 13:08:13.299032 (+10686257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:10.319670 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:10.320207 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:10.320242 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:10.320260 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:10.321358 (+  1098us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:10.321410 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:10.321434 (+    24us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:08:10.322881 (+  1447us) tablet.cc:701] Row locks acquired
0709 13:08:10.322901 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:10.323081 (+   180us) write_op.cc:270] Start()
0709 13:08:10.323223 (+   142us) write_op.cc:276] Timestamp: P: 1783602490323020 usec, L: 0
0709 13:08:10.323260 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:08:10.356665 (+ 33405us) log.cc:844] Serialized 5824 byte log entry
0709 13:08:10.925752 (+569087us) op_driver.cc:464] REPLICATION: finished
0709 13:08:11.049422 (+123670us) write_op.cc:301] APPLY: starting
0709 13:08:11.057463 (+  8041us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:11.157317 (+ 99854us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b1800272920. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240
0709 13:08:11.595052 (+437735us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:11.595081 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.049867 (+454786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.089758 (+ 39891us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:08:12.092516 (+  2758us) write_op.cc:312] APPLY: finished
0709 13:08:12.137649 (+ 45133us) log.cc:844] Serialized 139 byte log entry
0709 13:08:12.403252 (+265603us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.753462 (+350210us) write_op.cc:454] Released schema lock
0709 13:08:12.753554 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.754262 (+   708us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.754298 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34093,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":108268,"apply.run_cpu_time_us":57985,"apply.run_wall_time_us":1705979,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60610,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":14317,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":15,"prepare.queue_time_us":257348,"prepare.run_cpu_time_us":6571,"prepare.run_wall_time_us":150260,"raft.queue_time_us":276726,"raft.run_cpu_time_us":4501,"raft.run_wall_time_us":157040,"replication_time_us":585261,"spinlock_wait_cycles":4006400,"thread_start_us":764523,"threads_started":5,"wal-append.queue_time_us":537315,"wal-append.run_cpu_time_us":8490,"wal-append.run_wall_time_us":1283538}]]}
I20260709 13:08:13.419070 21450 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.412403 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.413053 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:13.430519 17185 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:13.411046 21267 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.433934 21267 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:13.407752 16420 debug-util.cc:398] Leaking SignalData structure 0x7b080038c800 after lost signal to thread 16515
I20260709 13:08:13.411389 21375 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.412570 17181 raft_consensus.cc:1240] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:13.435379 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7f80 after lost signal to thread 16590
W20260709 13:08:13.435652 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3800 after lost signal to thread 16591
I20260709 13:08:13.411935 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.430611 17188 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.429483 21450 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.430694 21316 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.410245 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.440809 21316 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.408241 16638 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:13.443202 21330 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:13.443310 21316 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.400878 21400 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.444428 21458 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.444406 21330 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.445505 21458 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.427058 21362 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:13.446187 21330 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.446892 21362 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.409548 20517 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.448618 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.449234 16558 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:13.384524 16388 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
W20260709 13:08:13.456537 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08002f26c0 after lost signal to thread 16664
W20260709 13:08:13.457784 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8700 after lost signal to thread 16665
W20260709 13:08:13.458243 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 93466.7us
I20260709 13:08:13.448704 17184 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:13.446099 21295 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:13.462497 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08003df000 after lost signal to thread 17212
W20260709 13:08:13.462735 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08003618e0 after lost signal to thread 17213
I20260709 13:08:13.464955 20831 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:13.468789 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 182202us
I20260709 13:08:13.469841 16561 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:13.459257 16388 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 11 to 12, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 12 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.476411 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:13.479348 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:13.485242 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2020 after lost signal to thread 21390
W20260709 13:08:13.485569 16420 debug-util.cc:398] Leaking SignalData structure 0x7b0800274cc0 after lost signal to thread 21392
I20260709 13:08:13.480592 21281 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.500265 16562 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:13.504998 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.506299 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.508105 21167 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.511969 21167 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.502643 21224 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.512688 21224 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.513051 21224 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.496874 21264 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.519214 16561 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:13.500258 21458 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.527554 16558 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:13.500000 21362 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.534222 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.534914 16558 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:13.535270 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.536151 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:13.536758 16566 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.537436 21281 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:13.538439 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.539196 16638 raft_consensus.cc:2393] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:13.501307 21323 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:13.544193 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.544790 16560 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:13.548193 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.548354 21295 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.548993 16559 raft_consensus.cc:2410] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:13.550107 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:13.550305 16566 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:13.550683 16487 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.552213 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:13.552865 16486 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.555377 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.556077 16632 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 9.
I20260709 13:08:13.556950 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.557583 16491 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:13.558959 16633 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:13.559141 16635 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:13.559612 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:13.560192 16631 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.548988 16388 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 9 to 12, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:13.564603 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.565508 16640 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:08:13.567471 21457 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:13.568405 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.567484 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.568691 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2388) took 1447 ms. Trace:
I20260709 13:08:13.568747 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.569232 16490 rpcz_store.cc:276] 0709 13:08:12.121635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.834129 (+712494us) service_pool.cc:224] Handling call
0709 13:08:12.834657 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.307614 (+472957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.307640 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.308169 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.328449 (+ 20280us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:13.328506 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.328712 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.568412 (+239700us) raft_consensus.cc:1685] finished
0709 13:08:13.568430 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.568556 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":494532,"raft.queue_time_us":473830,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5204,"thread_start_us":19021,"threads_started":1,"wal-append.queue_time_us":92084}
I20260709 13:08:13.571667 16564 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:08:13.572644 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.573323 16565 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:13.573990 16631 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:13.574213 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.576645 16639 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:13.574440 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:13.512519 21167 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:13.576110 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 79465.8us
I20260709 13:08:13.576504 16561 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:13.568308 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.579427 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:13.578353 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.580648 16490 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:13.581100 21456 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.581684 21456 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.582154 20517 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:13.583051 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:13.582830 20517 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.583804 16490 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:13.530038 21458 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.584371 21458 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.585604 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.585801 21362 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.586400 21458 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.587334 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.587769 16491 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:08:13.588438 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.588989 16637 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:13.589579 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.590123 16488 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:08:13.591325 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.593112 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.594982 21168 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.530186 21450 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.595811 21281 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.596239 16484 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:13.597343 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 105905us
I20260709 13:08:13.597791 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.598146 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.599222 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.599586 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:13.600358 21450 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.600487 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.587947 16482 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:13.601086 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.601312 16566 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 7.
W20260709 13:08:13.602013 21453 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:13.601768 16557 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:13.603302 21281 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:13.603560 21323 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.605605 20517 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.606292 16490 raft_consensus.cc:2410] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:13.608498 16488 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:13.610407 16605 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.624269 17153 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.624745 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.625581 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.625980 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.601125 21450 consensus_queue.cc:1059] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:08:13.645516 21450 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:13.645839 21450 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:13.646656 21450 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:13.647310 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 168140us
I20260709 13:08:13.617820 21456 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.618587 21462 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:13.600678 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:13.648231 16565 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:13.620178 21267 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:13.648519 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.626739 21316 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:13.649576 21316 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.650005 21316 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:13.627518 21359 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:13.651105 21359 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.651682 21323 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:13.652256 21323 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:13.652141 21359 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.580591 21167 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:13.628309 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 125719us
I20260709 13:08:13.619539 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.653735 16456 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.636119 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.654491 16490 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:13.636772 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.636880 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.637439 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.619293 21224 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.637019 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.638269 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.649302 16483 raft_consensus.cc:2410] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:13.656075 16635 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:13.639300 16633 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:13.655746 16636 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:13.639489 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.657061 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.657459 16632 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:13.657634 16483 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:13.658360 16638 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:13.656312 21456 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.659974 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.628805 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.626327 21021 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.661156 21021 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.626518 20831 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.661580 21224 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.661947 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.662338 21458 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.662628 21167 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:13.663254 21167 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.649003 21267 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.653378 21323 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.663479 21366 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:13.664361 21167 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.662917 21458 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.666240 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.666999 20517 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.667409 21458 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.668202 21366 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:13.668622 21267 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.668895 21366 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.667071 21462 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:13.669638 21462 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.669953 21366 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.671577 21462 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.643462 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.663261 20755 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:13.661545 21021 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.672516 20755 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:13.673074 16564 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.673400 20755 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.674132 21168 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.675099 16487 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:13.649065 21450 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.655241 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:13.679531 17188 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:13.679903 21462 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.680454 21462 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:13.681286 21462 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.681789 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.682343 16483 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:13.683457 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:13.681181 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.684007 16483 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.683221 16564 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:13.684758 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.668248 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.688773 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:13.689735 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.690232 16491 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:13.690161 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:13.690860 17179 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.692871 21288 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.566154 16388 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:13.693344 21288 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:13.693755 21288 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.694587 21281 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.694991 21281 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.695406 21281 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.697535 17179 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:13.697711 21478 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.652951 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.637486 16486 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:13.705085 21466 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:13.697934 21267 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:13.705585 17181 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:13.706072 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.705488 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.713476 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.714074 17188 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:13.712160 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.717176 17184 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:13.717528 16487 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:13.720929 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.722227 16455 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.722910 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.724107 17185 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:13.724779 16483 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:13.727415 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:13.729892 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45235.5us
I20260709 13:08:13.723515 21262 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:13.733089 21262 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.737056 21262 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.733055 17179 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
W20260709 13:08:13.739311 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.723644 21287 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:13.744385 21466 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.744397 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.745234 17181 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
W20260709 13:08:13.745594 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 92759.8us
I20260709 13:08:13.740348 21477 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.724900 21264 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.753115 16455 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.728686 20921 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.751770 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.766278 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.766646 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.752679 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.766338 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.768146 16637 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:13.769446 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.769872 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.770783 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.771587 16638 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 13: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:13.742396 21238 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.787528 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.788071 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.767071 20921 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.789677 20921 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.792273 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.793220 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.795164 21250 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.795562 21250 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.751828 21478 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.765129 21264 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.802162 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.765908 21262 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.764079 21287 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.803282 16631 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:13.803591 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:13.805413 16483 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.806187 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.803737 21400 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.787083 21238 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.804675 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:13.808246 17185 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:13.813931 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:13.792383 21315 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.797075 21366 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.796236 21250 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.805611 21264 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.818980 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.819079 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:13.813441 21417 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.853945 16635 raft_consensus.cc:2368] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:13.804652 21262 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.769038 21295 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:13.853627 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:13.856496 17181 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.802656 21358 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.853284 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:13.852299 16633 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:13.792313 21359 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:13.860153 16454 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:13.860584 21391 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.862296 21459 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
W20260709 13:08:13.863591 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.864815 16636 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:13.865960 17181 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:13.817476 21323 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.818411 21238 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.819878 21315 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.800648 21167 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:08:13.871304 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 65543us
I20260709 13:08:13.854180 21417 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.792276 21477 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.853407 21456 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.881410 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.881672 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.883173 16483 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
W20260709 13:08:13.851176 16529 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.4:44223 timed out after 1.837s (SENT) [suppressed 19 similar messages]
I20260709 13:08:13.877799 21315 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.852645 21400 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:13.857048 21262 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.885803 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.829425 21478 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.879169 21413 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:13.879813 21417 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.883597 21267 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.879060 20755 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.890827 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.868363 21358 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.893748 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:13.880947 21458 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.904425 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.897675 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:13.906078 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:13.886528 21362 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.908149 17184 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:13.876781 21391 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.909487 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:13.911085 21358 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.915946 21290 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.919166 21290 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:13.919948 21167 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:13.894721 21359 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.920925 21359 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.921275 21359 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.923023 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:13.923825 21179 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:13.914945 20755 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.925348 21179 raft_consensus.cc:2764] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:13.926044 20755 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.928189 21358 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.928570 21358 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.929124 21358 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.928628 21482 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.928216 21391 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.932065 21482 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.933265 21477 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.888453 21287 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.934101 21482 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.934934 21400 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.938367 21224 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:13.938768 21224 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:13.939514 21224 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.940640 21224 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.942759 21281 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.943856 16632 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:13.915874 21458 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.945914 21458 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:13.945694 20921 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.947999 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:13.948709 21466 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:13.949167 21466 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:13.894152 21413 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:13.944052 17179 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.950202 21413 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.951359 20921 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.914165 21316 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.952311 21021 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:13.953940 21478 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:13.951287 21413 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:13.956162 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 163051us
I20260709 13:08:13.961287 21281 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:13.950006 21466 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:13.978519 20517 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.983502 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.045913 16636 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:13.986358 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.027709 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.032524 17179 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:14.046411 16633 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
W20260709 13:08:14.031365 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 328999us
I20260709 13:08:14.028393 16454 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:14.029426 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:14.064189 16639 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:14.062299 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:14.066179 16640 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 17: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:14.067749 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:14.069741 17188 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:14.068037 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:14.071883 16455 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.071007 17187 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:14.078485 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:14.079241 17183 raft_consensus.cc:2410] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:14.050472 21267 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.079120 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:14.082799 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.083487 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.084290 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.086851 16605 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:14.089931 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:14.081322 21375 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:14.092880 21480 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:08:14.093436 21485 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:14.088830 21458 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.089092 21179 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.094379 21179 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:14.094707 21179 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:14.096029 21475 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:08:14.093451 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 65147.3us
I20260709 13:08:14.101660 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:14.102823 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.103991 16605 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.083549 21267 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:14.087144 21295 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.108187 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.110105 21021 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.106899 21290 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.111178 21417 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.111502 21238 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.112366 21426 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.074851 21358 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.130643 21290 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:14.093706 21482 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:14.133050 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.144071 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.134181 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.134416 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.135239 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.094033 21485 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.080926 21288 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.148308 16557 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:14.134235 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.091017 21462 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:14.144938 16558 raft_consensus.cc:2376] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13. Re-sending same reply.
I20260709 13:08:14.103705 21375 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.130553 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:14.141507 16454 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.117879 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:14.105597 21281 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.107867 21478 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:14.146522 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.115173 21267 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.154477 16638 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:14.154508 21366 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.155287 21450 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.152127 21375 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.151432 21482 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.144519 21326 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:14.157343 21326 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.157671 21326 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.158272 21316 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.114106 21391 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.159101 21290 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.159660 21391 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.160095 21391 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.116336 21295 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.086459 21250 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.153970 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:14.162914 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.154085 21477 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.136680 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.150607 17182 raft_consensus.cc:2376] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14. Re-sending same reply.
I20260709 13:08:14.171404 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.173305 17181 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:14.151310 21281 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.176360 21281 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.137400 20895 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:14.182684 16631 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:14.149879 21287 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.188591 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.178828 16564 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:14.116170 20921 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:08:14.116016 21458 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.181428 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.198424 16482 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.172756 21426 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.181978 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.143641 21264 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.201438 16486 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:14.174984 21295 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.197304 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.157789 21482 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.196009 16491 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.155297 21288 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.204557 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.205392 16566 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:14.216826 16561 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 8.
I20260709 13:08:14.206614 21450 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.207214 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.222096 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.199081 21426 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:14.207780 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.174676 21477 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.226981 16560 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:14.209360 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.233896 16558 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:14.218104 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.222848 16561 raft_consensus.cc:2410] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:14.181906 21315 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.222807 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.224466 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.235078 16565 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:14.235203 16564 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:14.236438 16564 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:14.237592 16564 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:14.238101 16565 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:14.225099 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.152077 21462 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.227851 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.229777 21458 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.232054 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.207495 21264 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.189558 21262 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.245167 16490 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:14.261219 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.188616 21167 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:14.245999 16639 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:14.268661 16639 pending_rounds.cc:85] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 8
I20260709 13:08:14.246518 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.269587 16484 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.247417 21315 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.239174 21477 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.248731 21238 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.245958 21267 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.281840 21267 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.252133 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.282925 21463 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:14.283500 16633 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.252635 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.285437 16558 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:14.286230 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.286702 16558 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.285449 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.288401 21485 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.288852 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.289355 16562 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.290963 21250 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.291783 21262 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.252063 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.292850 16637 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:14.292672 21281 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.253648 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.294003 16561 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:14.294220 21287 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:14.294756 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.295464 16561 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:14.262460 16491 raft_consensus.cc:2368] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:14.263157 16557 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:14.296872 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.297029 17183 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:14.297375 16557 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.232761 21179 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.299315 21179 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.299516 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.299764 16634 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:14.301172 21377 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:14.301198 21459 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:08:14.303551 21459 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.303910 21459 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.304497 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.305022 16637 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.304648 21459 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.305766 21459 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.306444 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.307260 16482 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:14.233217 21426 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.218910 21456 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:14.277479 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.324721 16486 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:14.232825 21359 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.268939 16639 pending_rounds.cc:107] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:14.278903 21417 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.279098 21358 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.279444 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.302899 16640 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:08:14.308137 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44662us
I20260709 13:08:14.294673 21287 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.309051 21462 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.308565 21413 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:14.314715 16637 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
W20260709 13:08:14.405098 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.251691 21375 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.316908 16631 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:14.263944 16566 raft_consensus.cc:2410] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:14.320556 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.308660 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.320863 16633 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:14.322896 16562 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
W20260709 13:08:14.266196 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 89586.8us
I20260709 13:08:14.307179 16561 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:14.302503 20517 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:14.327489 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.414896 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.415505 16566 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.415773 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.315594 16558 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:14.416356 16562 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:14.379933 16639 raft_consensus.cc:2889] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.380143 16557 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:14.417325 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:14.381444 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.379979 16636 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.315630 21295 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.382218 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:14.294715 21281 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.400293 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.400928 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.401007 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.408574 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.409401 16560 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.401685 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.422726 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.424499 16485 raft_consensus.cc:2368] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:14.418563 16455 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.426731 16483 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.429212 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.429967 16561 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.433203 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.434715 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.435294 16561 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.436043 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.436530 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.438345 16565 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:14.440238 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.442194 16484 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:14.437074 16482 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.444746 16485 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.414844 20517 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.423291 21413 consensus_queue.cc:1243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:14.450006 16455 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.408015 21418 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:14.426750 21466 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:14.433063 21238 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.456935 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.455940 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.426463 20895 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.442196 21462 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:14.462782 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.463495 21290 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:14.466162 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.467998 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:14.492774 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 75525.5us
W20260709 13:08:14.469276 21497 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:14.470948 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:14.471141 21498 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:14.472262 20895 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.472558 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.480748 20517 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.482573 21295 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.445111 21359 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.498512 16563 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.484567 16489 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.499274 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.499222 16562 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:14.484508 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.506613 16491 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.513121 16565 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.513703 16482 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:14.459237 20755 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.504551 21498 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:14.509449 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:14.511205 17179 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:14.516110 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.506798 16566 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:14.520387 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.526033 16562 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.444592 21391 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.458650 21281 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.526192 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.532687 16485 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.504554 21315 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.508956 20895 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.504807 21238 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.483428 21362 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:08:14.512161 21290 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:14.515635 21462 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:14.549456 16485 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:14.541626 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.550901 16562 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.523782 21485 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.543977 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.548451 16561 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:14.551877 21375 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.501384 21323 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:14.536437 21456 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.536464 20755 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.556943 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.560338 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.566067 16562 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.534205 21267 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.484529 21466 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.571774 16530 leader_election.cc:400] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:14.574610 16530 leader_election.cc:403] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.547968 20517 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:14.580412 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 78909.9us
I20260709 13:08:14.574115 16487 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:14.575285 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.576105 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.578153 16491 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:14.583148 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.583705 16637 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.582612 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.586300 16558 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.589867 16490 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: [10.7-13.8]
I20260709 13:08:14.580839 16605 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.594421 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:14.595448 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:14.556272 21485 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.572110 21458 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.542959 21315 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.611205 16637 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:14.591768 21323 consensus_queue.cc:1243] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:14.579316 21450 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:14.615806 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.617851 16561 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:14.616554 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:14.602595 21456 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:14.564203 21281 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.619894 16562 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:14.622906 16558 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:14.603164 21485 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.607872 21515 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.612391 21413 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.609193 21267 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.612288 21262 raft_consensus.cc:2764] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:14.616019 21021 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.626751 21456 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.645713 21514 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:08:14.618834 21179 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:08:14.649884 20895 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.625818 21238 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.651914 16489 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:14.627461 21167 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:08:14.652552 21326 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.634048 21330 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:14.663225 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:14.673146 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 64618.8us
I20260709 13:08:14.661860 21456 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:14.706509 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 90010.1us
I20260709 13:08:14.706848 16558 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:14.707567 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:14.709425 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 134218us
I20260709 13:08:14.712742 16486 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.713008 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.655256 21477 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.719062 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.705734 21375 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.721257 16558 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:14.721628 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.720135 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.724145 16636 raft_consensus.cc:2393] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:14.724308 16558 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:14.708420 21330 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:14.726441 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.722122 21267 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.664978 21462 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.784708 16490 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:14.726619 21375 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.786720 21287 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.787104 16565 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:14.787698 16634 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:14.788353 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:14.727133 21418 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:14.727820 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.728972 21281 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.757335 16564 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:14.787921 21375 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.793018 21287 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:14.720099 21358 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.654747 21290 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.726514 16558 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:14.773260 16559 raft_consensus.cc:2368] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
W20260709 13:08:14.774945 21518 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:14.776233 21330 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.777019 20895 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.730367 21295 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:14.664635 20755 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.722851 21391 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.780613 21315 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:14.782119 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 63119.7us
I20260709 13:08:14.782335 21326 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.782747 21515 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.783926 16560 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:14.797297 16563 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:14.759579 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.805161 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.820968 21482 raft_consensus.cc:2764] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 13:08:14.818900 21459 consensus_meta.cc:287] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.001s
W20260709 13:08:14.822068 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.840462 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.841379 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.841964 16633 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:14.824730 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 300728us
I20260709 13:08:14.842553 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.843657 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.844609 16565 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:14.803988 21426 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.829522 21466 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:14.852367 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.820816 21463 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:14.856334 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:14.858281 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:14.859604 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 100131us
I20260709 13:08:14.860707 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.864712 16456 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:14.865226 21400 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.867244 21326 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:14.851876 21458 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.852434 21238 raft_consensus.cc:2764] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:14.871173 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.871683 16560 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.873253 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.873818 16558 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:14.874651 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:14.875313 16558 raft_consensus.cc:2410] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:14.876458 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.876983 16565 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.878507 16530 leader_election.cc:400] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:14.878860 16530 leader_election.cc:403] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.849745 21358 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:14.879223 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.869966 21418 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:14.882804 21529 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:08:14.884915 21426 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:14.885772 21528 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.871105 21326 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.892396 16633 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:14.889952 16565 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:14.921424 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:14.896281 16483 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:14.924815 16560 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
W20260709 13:08:14.925868 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47494.6us
I20260709 13:08:14.869637 21400 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.926631 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:14.927757 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 86196.6us
I20260709 13:08:14.882731 21485 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:14.970701 21519 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:08:14.963459 21521 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.918124 21528 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:14.978312 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:14.967928 21536 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:14.979734 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:14.982702 21456 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:14.983753 21326 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:14.986095 21417 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:14.928196 21418 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:14.990202 16636 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.004745 17185 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:08:15.000145 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 73610.7us
I20260709 13:08:15.010450 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:14.991163 21413 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.996495 16563 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:14.997323 21485 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.018324 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.019275 16558 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 16: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:15.020377 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:15.020978 17182 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.975952 21463 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:14.998286 21521 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.002516 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:15.018596 21538 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.024559 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:15.027081 17179 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.027426 17183 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:15.022974 16456 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:15.018187 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.025720 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:15.029222 17185 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.999682 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.031955 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.003511 21417 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:15.033061 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:15.002820 21462 raft_consensus.cc:2764] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:15.037436 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:15.031409 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.039000 16489 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:15.038951 16488 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.042078 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:15.034083 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.034205 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.045902 21450 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.035974 16456 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:15.018879 21528 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.048839 16456 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:15.049153 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.048897 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.051561 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:15.008163 21498 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.048327 21517 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:15.053902 16455 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.110898 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:15.116644 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 67867.7us
I20260709 13:08:15.088940 16637 raft_consensus.cc:1217] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[10.7-13.8]   Dedup: 10.7->[13.8-13.8]
I20260709 13:08:15.117686 17183 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.120180 16456 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:15.120427 16637 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: [10.7-13.8]
I20260709 13:08:15.119001 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.046335 16530 leader_election.cc:400] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
W20260709 13:08:15.121855 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 75648.7us
I20260709 13:08:15.035437 21267 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:15.039180 21485 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:15.124333 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 70496.3us
I20260709 13:08:15.127243 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:15.048408 21539 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.043238 21458 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:15.126420 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:15.043700 21515 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:15.142441 17179 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:15.216558 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:15.140304 21417 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.148083 21485 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.052405 21288 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:08:15.137846 21466 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:08:15.150496 16604 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:15.221050 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 70649.2us
I20260709 13:08:15.222128 16604 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:15.119669 21295 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:15.036413 21463 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.151710 21458 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.043962 21179 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:08:15.079720 21359 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:15.142946 21450 consensus_queue.cc:1059] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:08:15.152592 16631 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.125329 16637 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:15.153986 16566 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:15.123277 21538 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.212939 21267 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:15.213883 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:15.214079 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.039112 21264 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:08:15.214637 16488 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:15.215297 17183 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:15.216202 17185 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:15.217571 16454 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:15.140506 21459 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.140157 21498 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:15.224494 21541 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.136s	user 0.002s	sys 0.006s
I20260709 13:08:15.087759 21400 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.226619 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:15.227053 21516 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.227447 21316 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.254081 21316 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.227813 21466 consensus_queue.cc:1243] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:08:15.228142 21546 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:15.137814 21462 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:08:15.228617 21521 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.228866 21021 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:15.255716 21021 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:15.256624 21021 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.045063 21413 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:08:15.109726 21418 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.217960 21515 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.241115 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:15.231954 21417 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.241183 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:15.229760 21456 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:15.242592 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.295506 16488 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:15.243362 21463 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.226171 21295 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:15.244726 21267 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.246261 21513 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.158s
I20260709 13:08:15.260767 17182 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:15.262144 21377 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:15.264662 21539 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:15.239513 21167 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.279302 16636 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:08:15.313735 16636 pending_rounds.cc:85] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 12
I20260709 13:08:15.313977 16636 pending_rounds.cc:107] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:08:15.314193 16636 raft_consensus.cc:2889] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.281469 21224 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.282485 16485 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:15.227377 21523 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.157s
W20260709 13:08:15.286556 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.234153 21528 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.223115 21485 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:15.298579 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57454.4us
I20260709 13:08:15.300060 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 628) took 1160 ms. Trace:
W20260709 13:08:15.300585 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 173425us
I20260709 13:08:15.302919 16631 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
W20260709 13:08:15.324128 17152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.265355 21450 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:15.329473 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 190034us
I20260709 13:08:15.352465 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.330096 16488 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:15.294617 21515 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.347937 16559 rpcz_store.cc:276] 0709 13:08:14.134386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.137519 (+  3133us) service_pool.cc:224] Handling call
0709 13:08:15.293728 (+1156209us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400412154. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:15.294551 (+   823us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401440512}
I20260709 13:08:15.354737 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.325544 21315 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:15.358116 16487 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:08:15.362690 16631 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:15.364593 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:15.325994 21224 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:08:15.378880 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 152324us
I20260709 13:08:15.351446 21517 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:15.347294 21377 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:15.352041 21450 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:15.354945 21359 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:15.376448 21540 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.375856 21458 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.327700 21167 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.351742 21528 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.380801 16604 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:15.409488 16637 raft_consensus.cc:2410] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:08:15.383740 21413 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:15.397053 21463 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:15.408280 21553 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:15.431957 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 77304.6us
I20260709 13:08:15.385190 21295 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.411247 21549 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.409991 21523 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:15.467497 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:15.467913 21552 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:15.476967 21377 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.464990 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:15.430545 21463 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.430059 21517 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.431213 16635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:15.490715 16635 raft_consensus.cc:606] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:15.491063 16635 raft_consensus.cc:614] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:15.479888 21485 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:15.483455 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.464596 21450 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.464448 21359 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:15.485716 21557 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:15.502959 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:15.503425 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:15.503851 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:15.504612 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 122207us
I20260709 13:08:15.505285 16633 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:15.506320 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:15.506614 16640 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.507349 16639 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
W20260709 13:08:15.526137 21485 consensus_queue.cc:1175] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f842280ae2ac4c68b0b7f6c093e27357" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 7 } }
I20260709 13:08:15.532195 21315 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:15.506119 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:15.490046 21553 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:15.534438 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:15.409166 21224 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.497570 21391 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:15.550623 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.551559 16487 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:15.556136 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.563001 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:15.568537 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:15.582508 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.584702 17182 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:15.534215 21549 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:08:15.603626 17179 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.598587 21556 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:15.607172 21556 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:15.607402 16487 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.608124 21556 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:15.609723 16591 heartbeater.cc:646] Failed to heartbeat to 127.15.6.62:43625 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.6.62:43625 timed out after 15.000s (SENT)
I20260709 13:08:15.623764 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:15.624435 17179 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:15.636690 17179 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:15.597277 21564 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:15.653389 17182 raft_consensus.cc:1217] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Deduplicated request from leader. Original: 13.11->[15.12-17.13]   Dedup: 17.13->[]
I20260709 13:08:15.671473 17182 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:08:15.672511 17153 leader_election.cc:400] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:15.672875 17153 leader_election.cc:403] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.674434 16487 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:15.675612 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:15.676335 17179 raft_consensus.cc:2393] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:15.677281 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:15.680488 16603 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:15.681069 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 123496us
W20260709 13:08:15.681726 21533 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:15.696893 16637 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.674661 21540 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.688412 21021 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.709095 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:15.681838 21462 consensus_queue.cc:1059] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:08:15.722380 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.708436 21021 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.681087 21564 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.743021 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:15.744444 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:15.713378 21549 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:15.737473 21021 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.747866 17153 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.749886 16487 raft_consensus.cc:606] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:15.682118 21553 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.751936 21565 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.752307 21560 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:15.682996 21315 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.750375 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:15.792596 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.812466 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:15.756999 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 2431) took 1338 ms. Trace:
I20260709 13:08:15.795249 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 2706) took 1485 ms. Trace:
I20260709 13:08:15.790201 21578 raft_consensus.cc:3055] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.808619 21562 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:15.814785 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:08:15.812493 21585 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:15.813772 16483 rpcz_store.cc:276] 0709 13:08:14.419069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.465939 (+ 46870us) service_pool.cc:224] Handling call
0709 13:08:15.754263 (+1288324us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54000e7254. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:15.756943 (+  2680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801374976}
I20260709 13:08:15.814462 16634 rpcz_store.cc:276] 0709 13:08:14.309584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.309719 (+   135us) service_pool.cc:224] Handling call
0709 13:08:14.309983 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.788073 (+478090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.754460 (+966387us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540043ab54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:15.795185 (+ 40725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098298240}
I20260709 13:08:15.804033 21466 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.812609 21462 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.811772 21579 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.826602 21564 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:15.827456 21571 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:08:15.815997 21578 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:15.832561 21578 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:15.833112 21573 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:15.833796 21578 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.836608 21577 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.837342 21577 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.815855 21463 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.822031 21562 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:15.844033 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 99307.7us
I20260709 13:08:15.845357 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.817540 21560 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.855321 16557 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:15.858012 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.862106 16557 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:15.869403 16557 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:15.870077 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.856127 21560 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.876575 21515 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.870991 16557 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.898147 16484 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:15.898885 16530 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:15.900907 16557 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.901551 21555 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.843974 21579 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.909509 21555 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.911375 21579 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:15.859994 21562 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.902251 21515 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:15.903508 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.911696 21555 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:15.915491 21555 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.911921 21478 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.859454 21590 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.915591 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:15.913215 21575 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.086s	user 0.002s	sys 0.005s
I20260709 13:08:15.882285 21556 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:15.909198 21569 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.106s	user 0.004s	sys 0.003s
W20260709 13:08:15.909482 21566 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.144s	user 0.000s	sys 0.008s
I20260709 13:08:15.921648 21555 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.932991 20921 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.939817 20921 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.933418 21578 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.940500 21556 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:15.919668 21517 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:15.922587 21477 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:15.940734 16564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2436) took 1136 ms. Trace:
W20260709 13:08:15.942123 21582 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:08:15.941934 21478 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:15.942692 21478 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.943924 20921 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.941270 21517 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.945871 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:15.946645 21565 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:15.940093 16530 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:15.941991 16564 rpcz_store.cc:276] 0709 13:08:14.804446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.817350 (+ 12904us) service_pool.cc:224] Handling call
0709 13:08:14.825565 (+  8215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.834740 (+  9175us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:14.849850 (+ 15110us) log.cc:844] Serialized 14 byte log entry
0709 13:08:15.293609 (+443759us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b1800370660. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f063602520b 00007f063602ad23 00007f063602b23a 00007f0636495a2a
0709 13:08:15.565537 (+271928us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.566048 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.566179 (+   131us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:15.566210 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.566270 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.940485 (+374215us) raft_consensus.cc:1685] finished
0709 13:08:15.940573 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.940688 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6737,"prepare.queue_time_us":15618,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":10687,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7333,"spinlock_wait_cycles":4490112,"thread_start_us":264763,"threads_started":1,"wal-append.queue_time_us":730715}
I20260709 13:08:15.949491 21478 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:15.949955 21478 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.950230 21021 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:15.951014 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.952703 21477 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:15.953255 21477 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.954569 16488 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:15.954953 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:15.955765 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.950773 16564 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:15.953039 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:15.956872 16486 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:15.957614 16564 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:15.961769 20517 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.962236 20517 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:15.964550 16557 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:15.964926 16557 pending_rounds.cc:85] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 7
I20260709 13:08:15.965169 16557 pending_rounds.cc:107] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:15.965451 16557 raft_consensus.cc:2889] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.966392 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:15.967018 16557 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:15.958490 16564 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.968761 20517 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.969982 16558 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:15.972894 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:15.973390 16558 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:15.974287 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:15.975250 21579 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:15.975672 21579 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.976050 21579 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.971804 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:15.977255 16557 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:15.977746 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:15.978310 17183 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.983708 16490 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:15.984846 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:15.989341 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:15.989862 17183 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:15.991739 21021 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:15.992767 21477 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:15.997802 21560 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:15.999008 16562 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:16.001063 21555 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:16.003322 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:16.003999 17183 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.946874 21517 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:16.012485 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.013916 16557 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:16.018921 16637 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:16.021873 17183 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:16.021998 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:16.022528 16557 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.020972 21560 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:16.006549 21578 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.029055 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.028749 21578 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.031059 21578 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.017619 21477 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.031873 21477 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.036203 16563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55194 (request call id 2440) took 1230 ms. Trace:
I20260709 13:08:16.037343 16560 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:16.041327 16557 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:16.036597 16563 rpcz_store.cc:276] 0709 13:08:14.805577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.840246 (+ 34669us) service_pool.cc:224] Handling call
0709 13:08:16.036001 (+1195755us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540002bf54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:16.036146 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357157120}
I20260709 13:08:16.054231 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:16.055059 16563 raft_consensus.cc:2410] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:16.056147 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.056828 16637 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 10.
W20260709 13:08:16.066452 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.094714 21530 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 1.172s	user 0.001s	sys 0.003s
I20260709 13:08:16.098608 16482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 2432) took 1679 ms. Trace:
I20260709 13:08:16.099452 21477 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.102312 21579 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.090991 21553 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.098958 16482 rpcz_store.cc:276] 0709 13:08:14.419299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.520698 (+101399us) service_pool.cc:224] Handling call
0709 13:08:14.520994 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.617519 (+ 96525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.617550 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.627991 (+ 10441us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.837754 (+209763us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:14.837785 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.837843 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.094223 (+1256380us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:16.098321 (+  4098us) raft_consensus.cc:1685] finished
0709 13:08:16.098341 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.098541 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18872,"raft.queue_time_us":29216,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":9960,"spinlock_wait_cycles":4850432,"thread_start_us":270245,"threads_started":2,"wal-append.queue_time_us":231134}
I20260709 13:08:16.114866 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:16.115334 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:16.115258 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:16.116667 17187 raft_consensus.cc:2368] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:16.103749 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 2753) took 1229 ms. Trace:
I20260709 13:08:16.117765 16637 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:16.118777 21477 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:16.119163 21477 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:16.119501 21477 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.117435 16560 rpcz_store.cc:276] 0709 13:08:14.874666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.925822 (+ 51156us) service_pool.cc:224] Handling call
0709 13:08:16.037104 (+1111282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.037715 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.103557 (+ 65842us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540002bf50. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648a8ad 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:16.103691 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554987776}
I20260709 13:08:16.121127 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:16.121801 17184 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:16.122543 21262 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:16.122694 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.124500 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.124701 16529 leader_election.cc:400] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
W20260709 13:08:16.125041 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.125056 16529 leader_election.cc:403] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.124820 16639 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:16.123834 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:16.128075 21517 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:16.128278 21578 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.105017 21579 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:16.111704 21498 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:16.129778 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:16.130085 21513 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:16.130272 21517 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.129734 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:16.135834 21358 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:08:16.141845 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:16.140872 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:16.142678 21375 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:08:16.146777 21562 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:16.142794 21288 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:08:16.147166 21562 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.148343 21562 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.149031 21288 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.149569 21288 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:16.142804 21517 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.142891 20895 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:16.156266 17185 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:16.159962 16561 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:16.156452 20895 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.160539 20895 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.147264 21485 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.161005 21485 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.161340 21485 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.142267 21498 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.164053 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:16.165712 21498 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:16.157557 21459 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:08:16.117050 21553 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.150470 21288 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.153230 21596 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:08:16.160163 21549 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:16.168991 21549 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.170888 21549 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:16.171445 21535 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.190s	user 0.003s	sys 0.000s
I20260709 13:08:16.175632 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:16.178721 16636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51944 (request call id 665) took 1096 ms. Trace:
I20260709 13:08:16.179266 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:16.175469 21167 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:16.185971 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.186666 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.187417 16637 raft_consensus.cc:2393] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 8: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:16.181198 16636 rpcz_store.cc:276] 0709 13:08:15.082539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.083153 (+   614us) service_pool.cc:224] Handling call
0709 13:08:15.083378 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.314589 (+231211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.178506 (+863917us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54003d2a54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:16.178669 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449798912}
I20260709 13:08:16.206396 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.210165 16637 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:16.212662 21578 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:16.213024 16484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1601) took 1190 ms. Trace:
I20260709 13:08:16.213399 16484 rpcz_store.cc:276] 0709 13:08:15.022776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.141596 (+118820us) service_pool.cc:224] Handling call
0709 13:08:16.212860 (+1071264us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400258354. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:16.212972 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500759936}
I20260709 13:08:16.202991 21579 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:08:16.214879 21579 consensus_queue.cc:1243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:16.212579 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.216333 21238 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:16.218315 21498 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.218537 21560 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.218816 21359 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.219580 21359 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.221582 21224 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.186311 21459 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:16.144500 21477 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.227762 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:16.228305 16488 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.228440 16631 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:16.230273 21561 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.230723 21561 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.233356 21477 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.233536 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.226024 21459 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:16.237491 16560 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:16.242041 17182 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:16.242635 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.242987 16484 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:16.244293 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.244942 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.246665 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.247717 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.226437 21450 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.249645 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:16.221596 21359 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:16.259413 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:16.262145 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:16.267025 20517 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:16.268177 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.267050 16631 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:16.268687 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.270426 17182 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:16.271961 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.272936 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:16.273579 16489 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:16.274958 16638 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:16.274890 20517 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:16.274900 16483 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:16.243878 21596 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:16.277791 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:16.280537 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.281245 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.238535 21021 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:16.238736 21167 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:16.285916 17185 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:16.286857 16482 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:16.287457 16489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:16.285149 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.288072 16489 raft_consensus.cc:606] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:16.289698 16490 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:16.272472 21514 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.297071 16484 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: [10.7-13.8]
I20260709 13:08:16.297262 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.297832 16483 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:08:16.249043 20895 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.300652 16455 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.304155 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:16.304780 16486 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.261221 21281 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:16.290743 21596 consensus_queue.cc:1243] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:16.319870 21417 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:16.331859 21563 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:16.344766 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44221.3us
I20260709 13:08:16.344818 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:16.276611 21459 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:16.400695 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 158621us
I20260709 13:08:16.404125 16637 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:16.401371 16604 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:16.310339 21514 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:08:16.418782 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.426280 21528 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:16.349483 21375 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.427815 17184 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:16.429443 21417 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.430056 21290 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.430233 21417 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:16.430578 21290 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:16.432384 21290 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.433259 21551 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:16.433928 21413 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.434504 21413 consensus_queue.cc:1243] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:16.435472 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.414528 21520 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.430497 16559 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:16.436739 21417 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.439517 16486 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:16.439925 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:16.434599 16635 pending_rounds.cc:85] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 11
I20260709 13:08:16.440521 17184 raft_consensus.cc:1217] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[10.7-14.9]   Dedup: 10.7->[12.8-14.9]
I20260709 13:08:16.440578 16635 pending_rounds.cc:107] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:08:16.441078 17184 pending_rounds.cc:85] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Aborting all ops after (but not including) 7
I20260709 13:08:16.441392 17184 pending_rounds.cc:107] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:16.441256 16635 raft_consensus.cc:2889] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.441752 17184 raft_consensus.cc:2889] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.346235 21563 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:16.457480 16639 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:16.447923 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.459160 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:16.452961 16638 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:16.437331 21517 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.453790 21391 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:16.438076 20921 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:08:16.382916 21561 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:16.462420 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.470691 17187 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:16.472576 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:16.473803 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:16.474053 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.436861 21520 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.484177 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:16.485752 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:16.489903 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:16.452968 20895 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.470608 21563 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.476576 21548 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.474820 21539 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:16.497298 17153 leader_election.cc:336] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Timed out: RequestConsensusVote RPC to 127.15.6.2:34831 timed out after 1.653s (SENT)
I20260709 13:08:16.497072 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:16.485780 21553 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:16.494952 21562 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.509763 21562 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.500595 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:16.511384 16488 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:16.511760 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:16.512017 16562 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:16.501386 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:16.512822 21551 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:16.484462 21417 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:08:16.517498 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:16.518263 21358 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.518855 21358 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:16.520344 21358 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.516027 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:16.523902 16557 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
W20260709 13:08:16.527729 21610 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:08:16.483640 21478 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.528815 21459 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.529161 21514 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.487269 21462 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:08:16.532891 21517 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.486858 21596 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.489158 21485 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.537498 21450 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:16.538013 21450 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:16.494323 21579 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.539028 21450 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.542335 21262 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:16.543272 21262 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.497485 21477 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:16.544129 21477 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:16.544483 21477 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:16.545461 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:16.546993 21579 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:16.547150 21620 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.539348 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:16.550370 16638 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:16.554494 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.550959 21520 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.555989 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:16.556224 21579 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.561820 21485 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:16.562180 16559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49162 (request call id 633) took 1072 ms. Trace:
I20260709 13:08:16.562589 16559 rpcz_store.cc:276] 0709 13:08:15.490273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.490390 (+   117us) service_pool.cc:224] Handling call
0709 13:08:16.562042 (+1071652us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b540002d854. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:16.562133 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128303488}
I20260709 13:08:16.566814 16560 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:16.567764 21596 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.568513 21262 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:16.569489 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:16.572142 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1599) took 1549 ms. Trace:
I20260709 13:08:16.572515 16491 rpcz_store.cc:276] 0709 13:08:15.022250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.031712 (+  9462us) service_pool.cc:224] Handling call
0709 13:08:16.571964 (+1540252us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400288f54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:16.572086 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638764416}
I20260709 13:08:16.575278 16564 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.581014 17181 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:16.581472 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.582377 21287 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:16.588090 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.589622 16485 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:16.590691 16638 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:16.591449 16639 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:16.591744 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:16.592794 16491 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:08:16.593741 21560 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.594242 21560 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:16.595096 21560 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.601112 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:16.601888 21611 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.256s	user 0.003s	sys 0.000s
I20260709 13:08:16.604431 21553 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.605314 16482 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:16.605638 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:16.539669 21614 log.cc:927] Time spent T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:08:16.608217 16566 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:16.613622 16566 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:08:16.616652 21613 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.211s	user 0.000s	sys 0.006s
I20260709 13:08:16.607731 16639 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:16.616874 16560 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:16.626453 16559 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:16.655165 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:16.655965 16560 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.657876 16566 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:16.681293 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 134369us
I20260709 13:08:16.687175 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:16.690814 16564 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:08:16.693608 16564 pending_rounds.cc:85] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 9
I20260709 13:08:16.693925 16564 pending_rounds.cc:107] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:08:16.694217 16564 raft_consensus.cc:2889] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.695310 16386 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.685112 21295 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:16.699760 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:16.702505 16488 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:16.702855 16638 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:16.706791 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.708047 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:16.709820 16386 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:16.721570 16560 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:16.726295 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:16.726306 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da035835f764425db56e9649db0a0bcc"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
W20260709 13:08:16.726773 21456 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:08:16.727188 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:16.728139 16490 raft_consensus.cc:606] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:16.730458 17179 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:16.711308 16386 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 11, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 11 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:16.732740 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:16.733496 16386 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 12, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:16.736958 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:16.766085 16485 raft_consensus.cc:2393] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 11: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:16.741071 16561 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:16.660141 21548 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:16.743960 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 101493us
I20260709 13:08:16.744467 20517 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:16.761313 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 74217us
I20260709 13:08:16.778623 16562 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:16.757404 21556 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.791702 16557 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.741729 21477 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.758239 21262 consensus_queue.cc:1059] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:08:16.781239 21523 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:16.782080 21520 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.756623 21179 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:08:16.760406 21617 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:08:16.781258 21366 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.769549 21563 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.782162 21264 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:16.804037 21523 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.829921 16558 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:16.824108 21620 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:16.810653 21520 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.828029 21523 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.815757 21366 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.833544 21620 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:16.841840 21287 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:16.871065 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 82725.3us
I20260709 13:08:16.871348 21426 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:16.875993 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 95406.8us
W20260709 13:08:16.891991 21624 log.cc:927] Time spent T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.058s	user 0.000s	sys 0.004s
I20260709 13:08:16.917335 21514 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 13:08:16.909677 21619 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.124s	user 0.000s	sys 0.005s
I20260709 13:08:16.909327 21450 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.920662 21643 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.008s	sys 0.007s
I20260709 13:08:16.957659 16386 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 4 to 10, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 10 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:16.960304 16386 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 14, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:16.972894 21366 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:16.974128 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 79480.8us
I20260709 13:08:16.976325 21514 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.978436 21264 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:16.978924 21264 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:16.903123 21326 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:16.980847 21522 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:16.981202 21522 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:16.981956 21522 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.983215 21522 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.984517 16386 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 6 to 10, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:16.917655 21555 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:08:16.974670 21641 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:08:16.981891 21627 log.cc:927] Time spent T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:08:16.992460 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.991467 16456 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:16.927004 21620 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.974879 21450 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:16.998030 21326 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:08:17.033900 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:17.035483 16561 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:17.036283 16563 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:17.045207 16557 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:17.020277 21620 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.048604 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:17.032259 21626 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:08:17.050976 16559 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
W20260709 13:08:17.020381 21179 consensus_queue.cc:1175] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "035eaa2f12374a81a4df7868a5453d3c" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 7 last_received_current_leader { term: 16 index: 10 } }
I20260709 13:08:17.054983 16562 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:17.056535 21640 log.cc:927] Time spent T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:08:17.058090 21644 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:17.059353 21628 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:08:17.067615 21477 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.071439 21264 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.041926 21556 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:17.072139 21556 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.038022 20755 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:17.077461 16454 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:17.077733 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86343.2us
I20260709 13:08:17.079918 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:17.048146 21456 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.088555 21456 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.090528 21456 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.083280 21521 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:17.084721 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.087077 21563 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.081825 21315 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:17.082326 21567 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:17.097719 21567 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:17.095157 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:17.099072 21656 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.099263 17181 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:17.076705 20755 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:17.051689 21617 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:08:17.103211 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 51246.2us
I20260709 13:08:17.104852 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:17.103752 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.102973 21264 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:17.099591 21656 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.114907 21417 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.098517 21567 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.101737 21315 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:17.125041 21514 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.126372 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:17.136188 21653 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:17.136500 20755 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.110493 21563 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.138621 21563 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.138955 21563 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.144234 21450 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.149966 21561 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:17.157158 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:17.138262 21656 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.159953 21391 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:17.160604 21391 consensus_queue.cc:1243] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Peer 035eaa2f12374a81a4df7868a5453d3c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:17.162791 21550 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:17.163264 21550 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.165073 21550 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.135212 21498 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:17.167905 21498 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:17.168658 21498 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.169729 21498 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.175036 16386 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.173434 21523 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.178440 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:17.178866 21523 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:17.179033 17181 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:17.181453 21323 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.181967 21323 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.184659 21323 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.185221 16634 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:08:17.193409 16489 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:17.200224 21238 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.202111 21238 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.204377 21563 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.206281 21563 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.207046 21238 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.207644 21238 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:17.208112 21238 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.209924 21238 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.225404 17184 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:17.228796 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:17.213202 21579 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:17.253055 16482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:17.255438 16482 raft_consensus.cc:606] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:17.256063 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:17.278818 16388 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 241) took 17638 ms (client timeout 15000 ms). Trace:
I20260709 13:08:17.253710 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:17.280262 16484 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:08:17.280704 16487 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:17.252524 21523 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.284144 21523 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.284487 21523 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.284704 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:17.280139 16386 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:17.288051 16386 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 5 to 8, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 8 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:17.289276 16386 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 11 to 13, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:17.290838 16386 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 12 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:17.293599 21645 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
I20260709 13:08:17.295989 16386 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:17.279258 16388 rpcz_store.cc:269] 0709 13:07:59.639970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.640128 (+   158us) service_pool.cc:224] Handling call
0709 13:08:17.278708 (+17638580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:14.037001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:14.099935 (+ 62934us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:14.099980 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:14.100007 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:14.100772 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:14.100885 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:14.100912 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:14.101576 (+   664us) tablet.cc:701] Row locks acquired
0709 13:08:14.101624 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:08:14.101809 (+   185us) write_op.cc:270] Start()
0709 13:08:14.101952 (+   143us) write_op.cc:276] Timestamp: P: 1783602494101729 usec, L: 0
0709 13:08:14.101996 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:08:14.102728 (+   732us) log.cc:844] Serialized 2479 byte log entry
0709 13:08:14.654269 (+551541us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b18002dc6a0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633380e07 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339b455 00007f0636408190 00007f0636401ae7 00007f0636400dd9 00007f063640b930
0709 13:08:14.972191 (+317922us) op_driver.cc:464] REPLICATION: finished
0709 13:08:15.123098 (+150907us) write_op.cc:301] APPLY: starting
0709 13:08:15.123192 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:15.227005 (+103813us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:15.227061 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:15.243352 (+ 16291us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:15.243639 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:15.243705 (+    66us) write_op.cc:312] APPLY: finished
0709 13:08:15.244040 (+   335us) log.cc:844] Serialized 65 byte log entry
0709 13:08:15.244206 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.244320 (+   114us) write_op.cc:454] Released schema lock
0709 13:08:15.244362 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:15.244760 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.244786 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28362,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":150592,"apply.run_cpu_time_us":9329,"apply.run_wall_time_us":121646,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":173598,"prepare.run_cpu_time_us":18991,"prepare.run_wall_time_us":343440,"raft.queue_time_us":523586,"raft.run_cpu_time_us":40950,"raft.run_wall_time_us":172025,"replication_time_us":823660,"spinlock_wait_cycles":11430400,"thread_start_us":653702,"threads_started":4,"wal-append.queue_time_us":214585,"wal-append.run_cpu_time_us":29433,"wal-append.run_wall_time_us":1933881}]]}
I20260709 13:08:17.336889 20517 raft_consensus.cc:993] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:17.338201 21513 raft_consensus.cc:1081] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:17.338481 21315 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.338999 21315 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.333953 21391 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:17.341893 21556 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.339123 16484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:17.345892 21520 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.358424 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:17.360008 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.362916 16635 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:17.364315 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:17.368014 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.368818 16634 raft_consensus.cc:2410] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:08:17.370395 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:17.370723 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:17.372010 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:17.373425 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:17.380123 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.382784 21550 consensus_queue.cc:1059] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:17.363353 21656 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:17.387934 21418 raft_consensus.cc:993] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:17.393458 16482 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 8.
I20260709 13:08:17.394608 21459 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:17.423437 21459 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:17.399865 21418 raft_consensus.cc:1081] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:17.405162 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:17.424782 16557 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:17.425660 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:17.427016 16557 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:17.405102 21556 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.428844 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:17.429519 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 63233us
I20260709 13:08:17.436036 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:17.437289 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.436546 17181 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.406713 21658 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.414002 21656 consensus_queue.cc:1243] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:17.436851 16557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:17.445606 21295 raft_consensus.cc:993] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:17.453154 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:17.455816 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:17.456672 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:17.458655 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:17.460176 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.461083 16486 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:17.456948 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.461833 16631 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:08:17.464067 21659 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:08:17.464792 16373 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 16b5b367990f4b5c862484bdec0b9226 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:17.442629 21556 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.476210 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:17.451817 21651 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:08:17.510186 21663 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:08:17.510496 21666 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:17.513109 21523 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.524219 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:17.461143 21290 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:17.452108 21459 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.526912 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:17.527508 16565 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:17.528756 16565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da035835f764425db56e9649db0a0bcc"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:17.529248 16565 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.529572 16565 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.535295 17181 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:17.517452 16635 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:17.536316 21238 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.536693 21238 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.537037 21238 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.504720 20895 raft_consensus.cc:1081] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
W20260709 13:08:17.520342 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.525451 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.539968 16565 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.520985 20755 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.543911 16636 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:17.525974 21290 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.544687 21290 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.546659 21658 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.544277 16529 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:17.554361 16565 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.554281 16455 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.555088 20517 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:17.544798 21656 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:08:17.553781 21326 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:17.553928 20921 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.559046 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:17.557085 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.579327 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:17.580112 16565 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:17.548983 21553 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:17.584266 21523 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.585752 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:17.590137 21315 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.587776 17182 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:17.587177 16558 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:17.595552 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:17.600708 16565 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:08:17.596113 17187 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:17.558761 21556 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.620289 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:17.620703 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 63683.8us
I20260709 13:08:17.621910 21520 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:17.622093 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:17.623162 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:17.632097 21366 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:17.632500 21366 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:17.633298 21366 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.634209 21366 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.641404 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:17.644272 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 104756us
I20260709 13:08:17.643945 21450 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.665014 21450 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.667183 21450 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.649678 21556 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:17.670902 21556 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:17.671437 21556 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:17.667655 21450 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.650107 20895 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:17.677592 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 138803us
I20260709 13:08:17.562487 21290 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.648027 21456 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:17.689662 16456 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:08:17.652175 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.695393 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.696030 16635 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:17.697381 16637 raft_consensus.cc:2368] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
W20260709 13:08:17.704664 21660 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.232s	user 0.000s	sys 0.002s
I20260709 13:08:17.704943 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.661769 21287 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:08:17.709975 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 45274.3us
I20260709 13:08:17.710234 21238 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.712759 20517 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.713183 20517 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.717378 16484 raft_consensus.cc:606] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:17.726109 16486 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:17.731657 20517 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.726898 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.691768 21288 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:17.738718 21238 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:17.745754 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 122655us
I20260709 13:08:17.746912 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:17.755326 16485 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:08:17.759454 20517 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.672874 21556 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.735065 21579 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:17.765851 16557 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.767860 20517 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:17.766351 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:17.768256 16557 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.770619 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:17.771608 16640 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.776973 16560 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:17.759132 21477 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:17.814669 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44476.2us
I20260709 13:08:17.828145 21477 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:17.829010 21477 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.816193 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:17.832615 17182 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.822491 21456 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:17.835875 21579 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:17.836045 21456 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.838100 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:17.838467 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:17.838992 16488 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.839259 16488 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:17.840134 16488 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.841085 16488 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.845649 16491 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:17.846962 21366 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:17.847934 21555 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.823058 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.848264 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:17.848783 16491 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.848291 21555 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:17.824640 16635 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:17.849752 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:17.825106 21290 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:17.850431 21450 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.850498 21528 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:17.851511 21528 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:08:17.826004 21687 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:17.852470 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:17.852733 16530 leader_election.cc:400] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 8 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9.
W20260709 13:08:17.827575 21647 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:17.853665 21528 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.855296 21596 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:17.855581 21459 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:17.826771 21666 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:17.848074 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:17.861063 21555 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.862252 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.865252 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.866132 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:17.866748 16557 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:17.868950 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:17.862179 21555 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.872861 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:17.873378 16637 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.838016 21456 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:17.878841 16488 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:17.887467 20517 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:17.890831 20517 consensus_queue.cc:1243] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:17.902565 16486 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:17.900774 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:17.902935 16486 pending_rounds.cc:85] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 5
I20260709 13:08:17.903476 16486 pending_rounds.cc:107] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:17.903739 16486 raft_consensus.cc:2889] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.907558 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.913731 16635 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:17.914407 17182 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:17.914005 16637 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
W20260709 13:08:17.917469 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 373907us
I20260709 13:08:17.919121 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:17.922907 16491 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:08:17.896854 21560 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.930174 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:17.930168 16635 pending_rounds.cc:85] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 6
I20260709 13:08:17.931162 16635 pending_rounds.cc:107] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:08:17.931450 16635 raft_consensus.cc:2889] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.918814 21485 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:17.955585 20921 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.971366 20921 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:17.987010 21287 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:18.006552 16557 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:18.008862 16482 raft_consensus.cc:2410] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:08:18.012830 16640 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:18.013850 16455 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:18.014616 21561 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.015064 21561 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:18.016510 21561 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:18.031351 21684 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:08:18.057708 21699 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:18.064393 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:18.063565 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:18.039916 21287 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.065980 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:18.055003 21426 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:18.073150 21656 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:18.073720 21656 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:18.074384 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 144256us
I20260709 13:08:18.074566 21656 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.077092 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:18.071769 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:18.079003 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:18.079622 16489 raft_consensus.cc:3055] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:18.079964 16489 raft_consensus.cc:740] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:18.080667 16489 consensus_queue.cc:260] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:18.085371 16489 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.082754 21288 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:18.070989 21694 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.078477 21450 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.100626 21689 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.104254 21456 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:18.104766 21456 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.106662 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:18.107188 16562 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.107982 16566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:18.108480 16566 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.108850 16566 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.115245 16562 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:18.119233 16558 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:18.084254 21485 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:18.077831 21426 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.114202 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:18.123392 16486 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:18.121640 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:18.124236 16560 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.130740 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:18.131335 16637 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:18.108409 20921 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.129150 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:18.138908 16489 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:18.148672 16560 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:18.146122 16566 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.154314 16563 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:18.157311 21426 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.139010 21167 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.166067 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:18.169386 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:18.170771 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:18.172410 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:18.175034 16566 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.168736 16558 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:18.180938 16530 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:18.088795 21693 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:18.193791 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:18.193993 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:18.194775 16566 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:18.171556 21167 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:18.194379 16637 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.197765 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:18.201115 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:18.201691 17182 raft_consensus.cc:3060] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.186228 21691 raft_consensus.cc:2804] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.152637 21485 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.199378 21167 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.190899 21560 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:08:18.202841 21555 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.224742 17182 raft_consensus.cc:2468] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:18.215915 16637 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:18.228403 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:18.211119 21691 raft_consensus.cc:697] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:18.235860 21477 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:18.268934 16565 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.262588 21477 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:18.269969 21477 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.265852 21691 consensus_queue.cc:237] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:18.299103 16636 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:18.306772 17184 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:18.309845 21287 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:18.310746 21596 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:18.315142 21167 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.318332 21456 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.326934 16455 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:18.327472 20921 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:08:18.327890 21701 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.219s	user 0.000s	sys 0.003s
W20260709 13:08:18.339124 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 147107us
W20260709 13:08:18.341217 21700 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.317s	user 0.003s	sys 0.000s
I20260709 13:08:18.343560 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:18.372603 16484 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:18.352964 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:18.353143 21450 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:18.354441 16637 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:18.354763 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:18.356381 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:18.375808 16483 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:18.376155 16483 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
W20260709 13:08:18.375041 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 48184us
I20260709 13:08:18.359517 16482 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.373835 16634 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:18.379709 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 132) took 3918 ms. Trace:
I20260709 13:08:18.380957 16633 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 17: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:18.376816 16483 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.383054 16483 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:18.384711 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.380697 16386 rpcz_store.cc:276] 0709 13:08:14.460414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.462934 (+  2520us) service_pool.cc:224] Handling call
0709 13:08:18.366987 (+3904053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:17.398907 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:17.399577 (+   670us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:17.399613 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:08:17.399629 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:17.401587 (+  1958us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:17.401650 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:17.401676 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:08:17.514951 (+113275us) tablet.cc:701] Row locks acquired
0709 13:08:17.514967 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:17.515111 (+   144us) write_op.cc:270] Start()
0709 13:08:17.515219 (+   108us) write_op.cc:276] Timestamp: P: 1783602497515063 usec, L: 0
0709 13:08:17.515236 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:08:17.518750 (+  3514us) log.cc:844] Serialized 5196 byte log entry
0709 13:08:18.101160 (+582410us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.158284 (+ 57124us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f06333810ac 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f0639ec1ef0
0709 13:08:18.257051 (+ 98767us) write_op.cc:301] APPLY: starting
0709 13:08:18.257149 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.332819 (+ 75670us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.332840 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.347594 (+ 14754us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.347853 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:08:18.347896 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:18.348191 (+   295us) log.cc:844] Serialized 121 byte log entry
0709 13:08:18.348867 (+   676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.348999 (+   132us) write_op.cc:454] Released schema lock
0709 13:08:18.349056 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.349435 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.349460 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":498285,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":147062,"apply.run_cpu_time_us":14965,"apply.run_wall_time_us":99412,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":31506,"prepare.run_cpu_time_us":27054,"prepare.run_wall_time_us":295174,"raft.queue_time_us":49383,"raft.run_cpu_time_us":20108,"raft.run_wall_time_us":122294,"replication_time_us":573421,"spinlock_wait_cycles":30399360,"thread_start_us":309769,"threads_started":4,"wal-append.queue_time_us":399865}]]}
I20260709 13:08:18.414301 16482 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:18.423671 16631 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:18.430536 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44875.1us
I20260709 13:08:18.382205 21521 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.435099 16483 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:18.438028 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:18.396405 21450 consensus_queue.cc:1243] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer f842280ae2ac4c68b0b7f6c093e27357 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:18.375000 20921 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.448897 20517 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.454145 20921 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.454308 16385 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:18.456457 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:18.458972 21450 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:18.459347 21450 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:18.459689 21450 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.467937 20517 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:18.468716 20517 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.474327 21450 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.476260 21315 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:18.476668 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:18.477368 16483 raft_consensus.cc:2393] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:18.477871 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:18.477362 21450 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.438473 21693 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:18.485352 21514 raft_consensus.cc:993] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:18.485695 16635 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:18.485919 21326 raft_consensus.cc:1081] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:18.436172 21521 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.415557 21694 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:08:18.488801 16530 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:18.497107 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:18.487521 21701 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:08:18.491161 21715 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:18.495370 16385 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 13, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.492601 21521 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.514595 16385 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.505765 21596 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:18.540989 21596 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:18.552681 16385 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 9 to 10, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 10 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:18.549455 21717 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:08:18.558795 16385 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.564654 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:18.568029 16558 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:08:18.569844 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 111213us
I20260709 13:08:18.570923 16456 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:18.571624 20517 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:18.564543 21167 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:18.574712 16385 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.576357 16385 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.577469 16385 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.578658 16385 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.579581 16385 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 8 to 11, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 11 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:18.598397 21456 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:18.598892 21456 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:18.607570 16635 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:18.616083 16385 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:18.622196 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 48265.1us
I20260709 13:08:18.611852 21596 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.599686 21456 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.625139 21477 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:08:18.662184 21719 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:08:18.664727 16484 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:18.671460 21456 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.674567 21521 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.691218 16491 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:18.693135 16491 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:18.694845 21618 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:18.710119 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 83884.8us
I20260709 13:08:18.712678 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:18.718451 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:18.719015 16637 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.704492 21521 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.721935 16385 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 8 to 11, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.727450 16637 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:18.729934 16483 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:18.732393 16604 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:18.733204 21167 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:18.733668 21167 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:18.729399 16385 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 15, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 15 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:18.740334 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:18.740825 16563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:18.741348 16563 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.741694 16563 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.740862 16565 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.743465 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:18.718778 21692 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:18.746469 16455 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:18.746855 16385 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.749791 16385 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 9 to 12, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.754647 16558 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:18.768042 16385 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 13 to 14, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.769388 16385 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.771015 16565 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:18.771232 16456 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:18.779882 21167 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.773005 21326 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:18.787657 16563 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.783865 21418 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.812268 16637 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:18.824290 16563 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.803045 21520 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.808039 21326 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:18.803727 21238 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:18.855490 17187 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:18.860139 16486 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:18.838384 21520 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:18.870414 21730 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:18.871490 16562 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:08:18.871901 16562 pending_rounds.cc:85] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 4
I20260709 13:08:18.872120 16562 pending_rounds.cc:107] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:18.872326 16562 raft_consensus.cc:2889] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.850600 21459 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:18.875491 16638 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:08:18.875893 16638 pending_rounds.cc:85] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 5
I20260709 13:08:18.876108 16638 pending_rounds.cc:107] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:08:18.876358 16638 raft_consensus.cc:2889] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.876222 21522 raft_consensus.cc:993] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:18.880674 21553 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:18.881529 21418 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:08:18.890789 21520 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:18.896319 21561 raft_consensus.cc:1081] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:18.898691 16561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:18.899225 16561 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.899590 16561 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.900490 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:18.901124 16635 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
W20260709 13:08:18.901790 21733 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:18.901952 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:18.902472 16558 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:18.902884 16562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41626
I20260709 13:08:18.903396 16562 raft_consensus.cc:606] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Received request to transfer leadership
I20260709 13:08:18.903674 16562 raft_consensus.cc:614] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:18.860746 21326 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:18.907238 21728 log.cc:927] Time spent T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:08:18.914405 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:18.914779 17187 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:18.919173 21690 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:18.934592 20517 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:18.934942 20517 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.935209 20517 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:18.959623 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 96083.5us
I20260709 13:08:18.960559 21426 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:18.964069 21690 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:18.972023 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:18.972610 16486 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:18.972873 16486 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:18.973487 16486 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.977751 16486 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.979182 16483 raft_consensus.cc:1275] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:18.989281 20517 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:18.994747 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:18.995276 16565 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:18.991394 16561 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:19.002552 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:19.002908 16640 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:19.003073 16636 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.004972 16634 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:19.005374 16486 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:19.008945 20517 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:19.010988 16565 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:19.012771 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:19.026475 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:19.028054 16561 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:19.029953 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:19.030474 17181 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.039602 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:19.040233 16640 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:19.047823 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:19.048452 16488 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:19.048774 16488 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:19.050130 17181 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:19.052170 16558 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:19.032656 21522 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:19.036892 21694 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:19.058740 16640 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:19.056113 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:19.061525 16488 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:19.062762 16488 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.032797 21477 consensus_queue.cc:1048] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:08:19.076537 21734 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:19.044898 21456 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:08:19.093731 16488 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:19.095186 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.053869 21596 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:19.066532 21560 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:19.066751 21694 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:08:19.121192 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 84632.3us
I20260709 13:08:19.118803 21560 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:19.126888 21560 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:19.130883 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76008.3us
I20260709 13:08:19.136499 16636 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:19.139907 21522 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:19.140393 21517 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.140861 21517 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:19.142846 21517 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:19.147660 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:19.154155 16482 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:19.136399 20895 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:08:19.184367 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 48371.3us
I20260709 13:08:19.140774 21522 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:19.172806 21694 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:19.212096 21730 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 13:08:19.176429 21560 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:19.247205 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:19.249579 16635 raft_consensus.cc:2410] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:08:19.296689 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48731.2us
W20260709 13:08:19.302352 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 59955us
I20260709 13:08:19.360702 16455 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:19.384052 16561 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:19.391897 16637 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:08:19.406446 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53287.6us
I20260709 13:08:19.382134 21739 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:19.412412 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50646.1us
I20260709 13:08:19.426198 16637 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:08:19.435216 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69177.5us
I20260709 13:08:19.455582 21596 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:08:19.554425 21770 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
W20260709 13:08:19.556692 21761 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:19.469058 21767 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:08:19.581579 16437 auto_rebalancer.cc:893] Removing replace marker failed: Replica 035eaa2f12374a81a4df7868a5453d3c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:19.582119 16437 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:08:19.582397 16437 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:08:19.621048 17184 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:19.622575 21691 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:19.655076 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 207306us
I20260709 13:08:19.658731 16565 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:08:19.673233 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 217349us
I20260709 13:08:19.681137 21682 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 13:08:19.704823 21775 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:08:19.756477 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 200352us
I20260709 13:08:19.798695 16484 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:19.812373 21776 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:19.813700 21748 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:19.824980 16637 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:19.839037 21692 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:19.851810 16488 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:19.854092 16488 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:19.880946 16636 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:19.901652 21694 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:19.902607 21692 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:19.915903 21238 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:19.938521 16557 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:19.941018 21738 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:20.104779 16386 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.106419 16386 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.107717 16386 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 15, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.114341 16386 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.115494 16386 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 13 to 15, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.117110 16386 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.118505 16386 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.119684 16386 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 11 to 14, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.121217 16386 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.122540 16386 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.123886 16386 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 13, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 13 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.125279 16386 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 14 to 16, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.126533 16386 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 13 to 14, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.128232 16386 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.129385 16386 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.130535 16386 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 14, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:20.148698 16385 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 238) took 16565 ms (client timeout 15000 ms). Trace:
W20260709 13:08:20.151922 16385 rpcz_store.cc:269] 0709 13:08:03.583557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.585445 (+  1888us) service_pool.cc:224] Handling call
0709 13:08:20.148631 (+16563186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:19.161629 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:19.162141 (+   512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:19.162177 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:08:19.162193 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:19.163592 (+  1399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:19.163644 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:19.163672 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:08:19.316743 (+153071us) tablet.cc:701] Row locks acquired
0709 13:08:19.316765 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:19.350480 (+ 33715us) write_op.cc:270] Start()
0709 13:08:19.354582 (+  4102us) write_op.cc:276] Timestamp: P: 1783602499348820 usec, L: 0
0709 13:08:19.354607 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:19.408398 (+ 53791us) log.cc:844] Serialized 6597 byte log entry
0709 13:08:19.676954 (+268556us) op_driver.cc:464] REPLICATION: finished
0709 13:08:19.719529 (+ 42575us) spinlock_profiling.cc:243] Waited 926 us on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f06333810ac 00007f063c1dbab9 00007f063339d69b 00007f063339b93f 00007f063339dc02 00007f0639ec1ef0
0709 13:08:19.720415 (+   886us) write_op.cc:301] APPLY: starting
0709 13:08:19.720492 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:19.794295 (+ 73803us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:19.794322 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:20.064702 (+270380us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:20.064976 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:08:20.065019 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:20.065345 (+   326us) log.cc:844] Serialized 156 byte log entry
0709 13:08:20.067185 (+  1840us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.068610 (+  1425us) write_op.cc:454] Released schema lock
0709 13:08:20.069357 (+   747us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:20.084409 (+ 15052us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.085538 (+  1129us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64,"reported_tablets":51,"spinlock_wait_cycles":8704,"child_traces":[["op",{"apply.queue_time_us":43222,"apply.run_cpu_time_us":19866,"apply.run_wall_time_us":360825,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":202627,"prepare.run_cpu_time_us":12982,"prepare.run_wall_time_us":268132,"raft.queue_time_us":99494,"raft.run_cpu_time_us":3681,"raft.run_wall_time_us":45427,"replication_time_us":321350,"spinlock_wait_cycles":2130304,"thread_start_us":325082,"threads_started":4,"wal-append.queue_time_us":21096}]]}
I20260709 13:08:20.245833 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 133) took 1473 ms. Trace:
I20260709 13:08:20.253518 16386 rpcz_store.cc:276] 0709 13:08:18.782994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.789370 (+  6376us) service_pool.cc:224] Handling call
0709 13:08:20.245744 (+1456374us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:20.174823 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:20.175344 (+   521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:20.175376 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:20.175393 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:20.176704 (+  1311us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:20.176780 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:20.176806 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:08:20.177848 (+  1042us) tablet.cc:701] Row locks acquired
0709 13:08:20.177869 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:20.178013 (+   144us) write_op.cc:270] Start()
0709 13:08:20.178122 (+   109us) write_op.cc:276] Timestamp: P: 1783602500177967 usec, L: 0
0709 13:08:20.178144 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:20.178763 (+   619us) log.cc:844] Serialized 6318 byte log entry
0709 13:08:20.181310 (+  2547us) op_driver.cc:464] REPLICATION: finished
0709 13:08:20.181723 (+   413us) write_op.cc:301] APPLY: starting
0709 13:08:20.181795 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:20.192778 (+ 10983us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:20.192863 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:20.219110 (+ 26247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:20.219335 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:08:20.219377 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:20.219691 (+   314us) log.cc:844] Serialized 148 byte log entry
0709 13:08:20.220426 (+   735us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.220579 (+   153us) write_op.cc:454] Released schema lock
0709 13:08:20.220628 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:20.220954 (+   326us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.220981 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12200,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":17714,"apply.run_wall_time_us":39177,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66880,"num_ops":16,"prepare.queue_time_us":34793,"prepare.run_cpu_time_us":4218,"prepare.run_wall_time_us":4218,"replication_time_us":3045,"thread_start_us":33873,"threads_started":1}]]}
I20260709 13:08:20.270112 16389 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.284060 16389 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 12 to 14, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.285872 16389 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 14, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.287153 16389 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.293277 16389 catalog_manager.cc:5697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 9 to 12, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.295606 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.304399 16389 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.305711 16389 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.308261 16389 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 14, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.309926 16389 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.357395 16389 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 12 to 14, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.359812 16389 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 11, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 11 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.363134 16389 catalog_manager.cc:5697] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.368211 16389 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.378649 16389 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 9 to 12, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 12 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.381991 16389 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 12, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.418108 16483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:20.418697 16483 raft_consensus.cc:606] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:20.419173 16483 raft_consensus.cc:614] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:20.428452 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc4151437571420aa297eb389f8c35af"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:20.428987 16488 raft_consensus.cc:606] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:20.461499 16483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:20.462152 16483 raft_consensus.cc:606] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:20.470304 21738 raft_consensus.cc:993] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:20.485368 21561 raft_consensus.cc:1081] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:20.487322 16561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc4151437571420aa297eb389f8c35af"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:20.487895 16561 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.488236 16561 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.492323 16386 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 10 to 12, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 12 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.493855 16386 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.495466 16386 catalog_manager.cc:5697] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 8 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:20.497968 16636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:20.498525 16636 raft_consensus.cc:606] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:20.498831 16636 raft_consensus.cc:614] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:20.513295 16484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:20.513834 16484 raft_consensus.cc:606] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:20.514178 16484 raft_consensus.cc:614] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:20.518838 16561 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.534097 16483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:20.523551 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 228) took 3353 ms. Trace:
I20260709 13:08:20.542672 16483 raft_consensus.cc:606] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:20.542567 16389 rpcz_store.cc:276] 0709 13:08:17.170321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.170541 (+   220us) service_pool.cc:224] Handling call
0709 13:08:20.523496 (+3352955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:20.395813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:20.397070 (+  1257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:20.397105 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:20.397121 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:20.398613 (+  1492us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:20.398653 (+    40us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:20.398670 (+    17us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:08:20.399298 (+   628us) tablet.cc:701] Row locks acquired
0709 13:08:20.399306 (+     8us) write_op.cc:260] PREPARE: finished
0709 13:08:20.399401 (+    95us) write_op.cc:270] Start()
0709 13:08:20.399480 (+    79us) write_op.cc:276] Timestamp: P: 1783602500399370 usec, L: 0
0709 13:08:20.399491 (+    11us) op_driver.cc:348] REPLICATION: starting
0709 13:08:20.400063 (+   572us) log.cc:844] Serialized 5831 byte log entry
0709 13:08:20.402085 (+  2022us) op_driver.cc:464] REPLICATION: finished
0709 13:08:20.402406 (+   321us) write_op.cc:301] APPLY: starting
0709 13:08:20.402477 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:20.421102 (+ 18625us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:20.421164 (+    62us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:20.471744 (+ 50580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:20.471995 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:08:20.472039 (+    44us) write_op.cc:312] APPLY: finished
0709 13:08:20.473795 (+  1756us) log.cc:844] Serialized 139 byte log entry
0709 13:08:20.473959 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.474103 (+   144us) write_op.cc:454] Released schema lock
0709 13:08:20.474152 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:20.474477 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.488971 (+ 14494us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":15589,"apply.run_wall_time_us":72048,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62700,"num_ops":15,"prepare.queue_time_us":5619,"prepare.run_cpu_time_us":3327,"prepare.run_wall_time_us":6271,"replication_time_us":2493,"spinlock_wait_cycles":22400}]]}
I20260709 13:08:20.573921 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:20.575577 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:20.602584 16561 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:20.603123 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:20.603677 16636 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.612020 16636 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:20.613272 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:20.613787 17184 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.632162 17184 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:20.638135 16529 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:20.640169 21456 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:20.640655 21456 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:20.641502 21456 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.660161 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:20.660796 16488 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:20.661115 16488 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:20.661770 16488 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.663184 16488 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.664661 20517 raft_consensus.cc:993] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:20.665091 20517 raft_consensus.cc:1081] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:20.669485 16488 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:20.671273 17184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:08:20.671837 17184 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.672153 17184 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.682813 17184 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.546007 16387 catalog_manager.cc:5697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.684469 16387 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.685434 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:20.686081 16488 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:20.686415 16488 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:20.686234 16387 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 7 to 9, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 9 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.687284 16488 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.688386 16488 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.690322 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:20.690861 16636 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:20.696166 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 58119.9us
I20260709 13:08:20.696732 16488 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:20.697654 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:20.698735 21675 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:20.699208 21675 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:20.703869 21675 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.706142 16636 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:20.708238 17184 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:20.710680 16387 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.713618 16387 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.724764 16387 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.738265 16387 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 17, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.740427 16387 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 13 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.750099 16387 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.751935 16387 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 8 to 11, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 11 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.753320 16387 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.759073 16387 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.763128 16387 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.780391 16387 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.840525 16386 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 15 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.862937 21561 raft_consensus.cc:993] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:20.863396 21561 raft_consensus.cc:1081] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:20.873879 17184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:08:20.874409 17184 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.874761 17184 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.883599 17184 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.899025 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:20.899582 16488 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:20.899873 16488 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:20.900554 16488 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.901535 16488 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.913141 16488 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:20.914088 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:20.914875 21675 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:20.915336 21675 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:20.916194 21675 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:20.922412 17184 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:20.923089 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:20.923658 16636 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:20.939461 16636 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:20.952517 16386 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 15 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.962960 16388 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.970150 16388 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 13 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.976151 16388 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 12 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.980718 16387 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 239) took 1392 ms. Trace:
I20260709 13:08:20.982161 16388 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:20.983127 16387 rpcz_store.cc:276] 0709 13:08:19.587936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.588243 (+   307us) service_pool.cc:224] Handling call
0709 13:08:20.980662 (+1392419us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:20.790501 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:20.790983 (+   482us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:20.791015 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:20.791032 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:20.792129 (+  1097us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:20.792662 (+   533us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:20.792740 (+    78us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:20.793810 (+  1070us) tablet.cc:701] Row locks acquired
0709 13:08:20.793828 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:20.793965 (+   137us) write_op.cc:270] Start()
0709 13:08:20.794063 (+    98us) write_op.cc:276] Timestamp: P: 1783602500793922 usec, L: 0
0709 13:08:20.794084 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:20.794646 (+   562us) log.cc:844] Serialized 5456 byte log entry
0709 13:08:20.796844 (+  2198us) op_driver.cc:464] REPLICATION: finished
0709 13:08:20.797219 (+   375us) write_op.cc:301] APPLY: starting
0709 13:08:20.797289 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:20.806784 (+  9495us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:20.806870 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:20.826686 (+ 19816us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:20.826925 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:08:20.826970 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:20.827296 (+   326us) log.cc:844] Serialized 129 byte log entry
0709 13:08:20.828084 (+   788us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.828233 (+   149us) write_op.cc:454] Released schema lock
0709 13:08:20.828282 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:20.828581 (+   299us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.828607 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13789,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":212,"apply.run_cpu_time_us":15342,"apply.run_wall_time_us":31330,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58520,"num_ops":14,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":3831,"prepare.run_wall_time_us":4409,"replication_time_us":2639}]]}
I20260709 13:08:21.034847 16636 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:21.036607 21694 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.103744 16488 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:21.106273 21694 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.113049 16389 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 16, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:21.126801 16389 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:21.129406 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 242) took 2177 ms. Trace:
I20260709 13:08:21.129792 16388 rpcz_store.cc:276] 0709 13:08:18.951929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.952078 (+   149us) service_pool.cc:224] Handling call
0709 13:08:21.129345 (+2177267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:21.011472 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:21.011974 (+   502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:21.012009 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:21.012025 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:21.012547 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:21.012596 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:21.012622 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:21.012978 (+   356us) tablet.cc:701] Row locks acquired
0709 13:08:21.012991 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:08:21.013114 (+   123us) write_op.cc:270] Start()
0709 13:08:21.013207 (+    93us) write_op.cc:276] Timestamp: P: 1783602501013074 usec, L: 0
0709 13:08:21.013225 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:21.013729 (+   504us) log.cc:844] Serialized 1670 byte log entry
0709 13:08:21.016104 (+  2375us) op_driver.cc:464] REPLICATION: finished
0709 13:08:21.016484 (+   380us) write_op.cc:301] APPLY: starting
0709 13:08:21.016550 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:21.038892 (+ 22342us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:21.038986 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:21.041081 (+  2095us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:21.041227 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:21.041264 (+    37us) write_op.cc:312] APPLY: finished
0709 13:08:21.041436 (+   172us) log.cc:844] Serialized 49 byte log entry
0709 13:08:21.055287 (+ 13851us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.055385 (+    98us) write_op.cc:454] Released schema lock
0709 13:08:21.055425 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:21.078733 (+ 23308us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.078763 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18751,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":5388,"apply.run_wall_time_us":62203,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":2504,"prepare.run_wall_time_us":2505,"replication_time_us":2773}]]}
I20260709 13:08:21.128353 16389 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.138177 16389 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.148962 17184 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:21.149893 16389 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 16 to 17, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:21.153090 21694 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.263607 16388 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:21.301337 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64299.5us
W20260709 13:08:21.345532 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 51260.4us
I20260709 13:08:21.405262 16562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc4151437571420aa297eb389f8c35af"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41626
I20260709 13:08:21.409555 16635 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:21.412983 16488 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:21.414587 21675 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.441089 16562 raft_consensus.cc:606] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Received request to transfer leadership
I20260709 13:08:21.447912 16562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc4151437571420aa297eb389f8c35af"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41626
I20260709 13:08:21.448611 16562 raft_consensus.cc:606] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Received request to transfer leadership
W20260709 13:08:21.449831 16375 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for cc4151437571420aa297eb389f8c35af already in progress [suppressed 3 similar messages]
I20260709 13:08:21.469800 16636 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:08:21.473628 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet cc4151437571420aa297eb389f8c35af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:21.473857 21762 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:21.502564 16375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 52886.4us
I20260709 13:08:21.505097 16561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc4151437571420aa297eb389f8c35af"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41626
I20260709 13:08:21.505622 16561 raft_consensus.cc:606] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Received request to transfer leadership
I20260709 13:08:21.509699 21801 raft_consensus.cc:993] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:21.510118 21801 raft_consensus.cc:1081] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Signalling peer f842280ae2ac4c68b0b7f6c093e27357 to start an election
W20260709 13:08:21.513113 16437 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:21.513429 16437 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for cc4151437571420aa297eb389f8c35af already in progress
W20260709 13:08:21.513701 16437 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for cc4151437571420aa297eb389f8c35af already in progress
I20260709 13:08:21.524187 16636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc4151437571420aa297eb389f8c35af"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:35430
I20260709 13:08:21.524711 16636 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.525017 16636 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.527150 16483 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:21.532212 21762 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:21.544423 21762 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:21.541931 16636 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:21.550689 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:21.551182 16483 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:21.557293 16375 catalog_manager.cc:4755] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): ChangeConfig:REMOVE_PEER RPC failed for tablet cc4151437571420aa297eb389f8c35af: Remote error: Service unavailable: leader transfer in progress
I20260709 13:08:21.559616 16483 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:21.574729 16636 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:21.576596 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:21.576545 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:21.577193 17184 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.582221 17184 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:21.584257 16603 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:21.585379 21812 raft_consensus.cc:2804] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:21.586020 21812 raft_consensus.cc:697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:21.586828 21812 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:21.589758 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:21.590371 16561 raft_consensus.cc:3055] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:21.590641 16561 raft_consensus.cc:740] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:21.591323 16561 consensus_queue.cc:260] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:21.592933 16561 raft_consensus.cc:3060] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.643680 16561 raft_consensus.cc:2468] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:21.643198 16388 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 17 to 18, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 18 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.056789 17184 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:22.059175 21813 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:22.088742 16483 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:22.092170 21813 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:22.121537 16557 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:22.124868 21813 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:22.207592 16637 consensus_queue.cc:237] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:22.312330 17184 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:22.323813 21814 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:22.335264 21553 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 3 to 14, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:22.366978 17184 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 3 to 14, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:22.414927 16488 raft_consensus.cc:1275] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:22.441675 21814 consensus_queue.cc:1048] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:22.449630 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cc4151437571420aa297eb389f8c35af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 13:08:22.488448 16387 catalog_manager.cc:5697] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 14, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 18 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:22.532054 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 59957.8us
I20260709 13:08:22.548193 16483 raft_consensus.cc:2955] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 3 to 14, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:22.698364 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 89614.1us
W20260709 13:08:22.723280 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 92609.5us
W20260709 13:08:22.739470 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 127271us
I20260709 13:08:22.753594 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet cc4151437571420aa297eb389f8c35af with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:41626
I20260709 13:08:22.780164 21843 tablet_replica.cc:333] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:08:22.784276 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:22.811334 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 198981us
I20260709 13:08:22.824648 21843 raft_consensus.cc:2243] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.826021 21843 raft_consensus.cc:2272] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.843746 21843 ts_tablet_manager.cc:1916] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:22.870438 21843 ts_tablet_manager.cc:1929] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:08:22.874662 21843 log.cc:1199] T cc4151437571420aa297eb389f8c35af P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/cc4151437571420aa297eb389f8c35af
I20260709 13:08:22.881572 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet cc4151437571420aa297eb389f8c35af (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:22.914616 16561 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:22.959024 16636 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:22.961347 21830 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:22.962507 16529 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4deba3ef5feb443b8e28599a079603bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.963958 16483 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:22.968199 21830 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:22.984953 16482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:22.985682 16482 raft_consensus.cc:606] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:22.991592 16635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:22.992161 16635 raft_consensus.cc:606] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:22.998450 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "836ce75918dd4690b2a75522b473f405"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:22.999027 16486 raft_consensus.cc:606] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:23.009078 16482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:23.009615 16482 raft_consensus.cc:606] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:23.015663 16482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:23.016251 16482 raft_consensus.cc:606] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:23.017584 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:23.019093 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:23.021384 21831 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.038443 16634 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.044848 16483 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.071285 21842 raft_consensus.cc:993] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:23.071959 21841 raft_consensus.cc:1081] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:23.073850 17181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:08:23.074388 17181 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.074723 17181 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.070860 16387 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.087122 17181 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.091873 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:23.092540 16482 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.092828 16482 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:23.093746 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:23.093621 16482 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.094297 16636 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.097862 16482 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.101876 16636 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:23.111418 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:23.112867 21675 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:23.113317 21675 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:23.114183 21675 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.093626 17181 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:23.148031 16482 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:23.151993 21826 raft_consensus.cc:993] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:23.152520 21841 raft_consensus.cc:1081] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:23.155604 17184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:08:23.156378 17184 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.156750 17184 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.163964 21842 raft_consensus.cc:993] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:23.164510 21842 raft_consensus.cc:1081] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:23.166098 16557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "836ce75918dd4690b2a75522b473f405"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:23.166567 16557 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.166891 16557 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.175624 17184 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.178416 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:23.179168 16482 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:23.179493 16482 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:23.180341 16482 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.181340 16482 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.191540 16557 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:23.199839 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:23.200377 16483 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:23.200654 16483 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:23.201390 16483 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:23.202430 16483 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.208707 16389 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 13 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.212996 16557 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:23.213116 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:23.213681 16634 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.215261 16483 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:23.216436 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:23.217221 21830 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:23.217690 21830 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:23.218518 21830 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:23.221894 16634 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:23.241762 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:23.244833 16561 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.252105 16636 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:23.256701 16561 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:23.239122 17184 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:23.258486 16482 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:23.259564 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:23.260324 21675 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:23.260805 21675 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:23.261705 21675 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.263494 16389 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.298590 16389 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 13 to 14, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 14 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.310930 16482 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:23.317574 21813 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:23.324369 16561 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:08:23.326975 16603 consensus_peers.cc:597] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04f67e2620d84985a37dbf9b77909370. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:23.329041 21832 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.344348 21828 raft_consensus.cc:993] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:23.344797 21828 raft_consensus.cc:1081] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:23.346382 16562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:23.346873 16562 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.347221 16562 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.354409 16562 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:23.356245 16562 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:23.357247 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:23.357925 16636 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.360981 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:23.361562 16483 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:23.361876 16483 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:23.376402 16483 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:23.381690 16483 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.403229 16483 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:23.404215 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:23.405114 21694 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:23.405593 21694 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:23.406353 21694 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:23.408566 21813 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.410048 16483 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.418561 16636 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:23.434024 16557 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.441013 16389 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index -1 to 12, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.444492 21856 ts_tablet_manager.cc:933] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:23.449960 21856 tablet_copy_client.cc:323] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:08:23.452409 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet 4deba3ef5feb443b8e28599a079603bd from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:08:23.453003 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet 4deba3ef5feb443b8e28599a079603bd from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-4deba3ef5feb443b8e28599a079603bd
I20260709 13:08:23.462342 16576 tablet_copy_source_session.cc:215] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:23.480486 21856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4deba3ef5feb443b8e28599a079603bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.481580 16482 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:23.483279 16389 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 11 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 12 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.515470 21856 tablet_copy_client.cc:806] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:23.527455 21856 tablet_copy_client.cc:670] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:23.534884 21856 tablet_copy_client.cc:538] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:23.549062 21833 raft_consensus.cc:993] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:23.549623 21833 raft_consensus.cc:1081] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:23.552060 17184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48050
I20260709 13:08:23.552583 17184 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.552910 17184 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.553009 16636 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:23.554596 21675 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.569923 17184 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.599285 17184 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:23.600720 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:23.605458 16483 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.604408 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:23.605994 16634 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.606292 16634 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:23.607133 16634 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.608235 16634 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.617843 16635 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:23.619831 21842 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:23.620487 16634 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
W20260709 13:08:23.622833 16454 consensus_peers.cc:597] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 441a1d437e7b4eff9f56f88ce7d935e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:23.625134 16561 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:23.639097 16483 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:23.643107 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:23.648336 21675 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:23.648783 21675 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:23.649734 21675 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:23.652817 21842 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.665498 16482 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:23.666239 16557 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:23.668433 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 82483.8us
I20260709 13:08:23.671849 21830 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.669945 21837 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:08:23.675230 16483 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:23.676548 21837 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.698843 21828 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:08:23.708427 21860 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:08:23.709803 21856 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:23.709115 16389 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 13, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 13 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.711010 16557 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.712613 16635 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.731463 16634 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:23.734658 16387 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:23.804648 16637 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:08:23.890013 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 144806us
W20260709 13:08:23.941483 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 111013us
I20260709 13:08:23.952773 21694 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:08:24.063416 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:24.072482 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 132035us
I20260709 13:08:24.081015 16635 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:24.081550 21891 ts_tablet_manager.cc:933] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:24.113097 21891 tablet_copy_client.cc:323] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
W20260709 13:08:24.151886 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 375167us
W20260709 13:08:24.174320 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46425.3us
I20260709 13:08:24.176328 16557 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:24.178299 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 107830us
I20260709 13:08:24.185578 16482 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:24.186964 16482 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:24.192855 16488 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:24.199481 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 101118us
I20260709 13:08:24.192941 21862 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:24.256630 21875 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:08:24.258745 21804 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:08:24.261382 16482 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:24.263299 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet 04f67e2620d84985a37dbf9b77909370 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:08:24.263875 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet 04f67e2620d84985a37dbf9b77909370 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-04f67e2620d84985a37dbf9b77909370
I20260709 13:08:24.263947 16633 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:24.272413 16650 tablet_copy_source_session.cc:215] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:24.275470 16603 consensus_peers.cc:597] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1ada08378e34050bfc80a9f6893b014. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:24.275960 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 46680.5us
W20260709 13:08:24.323604 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 116089us
I20260709 13:08:24.291132 21905 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:24.336462 21890 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:24.339165 21891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f67e2620d84985a37dbf9b77909370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.336978 21908 ts_tablet_manager.cc:933] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:08:24.372614 21885 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:08:24.396039 21908 tablet_copy_client.cc:323] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
W20260709 13:08:24.400002 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 68479.3us
W20260709 13:08:24.400364 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 171894us
I20260709 13:08:24.418237 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet 441a1d437e7b4eff9f56f88ce7d935e5 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:08:24.418821 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet 441a1d437e7b4eff9f56f88ce7d935e5 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-441a1d437e7b4eff9f56f88ce7d935e5
I20260709 13:08:24.422468 21829 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:08:24.570171 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 111848us
W20260709 13:08:24.565491 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 159913us
W20260709 13:08:24.574708 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 115995us
W20260709 13:08:24.583518 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 139215us
I20260709 13:08:24.618866 16501 tablet_copy_source_session.cc:215] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:24.654078 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441a1d437e7b4eff9f56f88ce7d935e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.657763 21891 tablet_copy_client.cc:806] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:24.658370 21891 tablet_copy_client.cc:670] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:24.674681 16563 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:24.675894 21882 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:24.779384 16488 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:24.788163 21882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48146 (request call id 1) took 1071 ms. Trace:
I20260709 13:08:24.792922 21891 tablet_copy_client.cc:538] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:24.788611 21882 rpcz_store.cc:276] 0709 13:08:23.716825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.717354 (+   529us) service_pool.cc:224] Handling call
0709 13:08:23.744401 (+ 27047us) log.cc:844] Serialized 485 byte log entry
0709 13:08:24.086258 (+341857us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b180040ed00. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063339e3f3 00007f06333a07c1 00007f06333a0779 00007f06333a0709 00007f06333a06d1 00007f063339f9cd 000000000038f354 000000000038f199 00007f063338183a
0709 13:08:24.153440 (+ 67182us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b54004a2520. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636404142 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69 00007f06363ebc31 00007f06363eadfd 000000000038f354 000000000038f199 00007f063339e475
0709 13:08:24.788073 (+634633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757,"raft.queue_time_us":46235,"raft.run_cpu_time_us":2706,"raft.run_wall_time_us":215066,"spinlock_wait_cycles":5551744,"thread_start_us":197428,"threads_started":1,"wal-append.queue_time_us":233130}
I20260709 13:08:24.813860 21925 ts_tablet_manager.cc:933] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:24.864928 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 48181.6us
W20260709 13:08:24.881140 21856 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:25.000305 21891 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:25.011684 16388 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 11, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:25.013491 21908 tablet_copy_client.cc:806] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:25.014112 21908 tablet_copy_client.cc:670] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:25.015328 21925 tablet_copy_client.cc:323] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:08:25.022338 21908 tablet_copy_client.cc:538] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:25.044855 21908 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:25.049386 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet b1ada08378e34050bfc80a9f6893b014 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:08:25.049954 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet b1ada08378e34050bfc80a9f6893b014 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-b1ada08378e34050bfc80a9f6893b014
I20260709 13:08:25.058504 16650 tablet_copy_source_session.cc:215] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:25.061489 21925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ada08378e34050bfc80a9f6893b014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.065317 21856 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.068688 21856 tablet_bootstrap.cc:492] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:25.069375 21856 ts_tablet_manager.cc:1403] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 1.360s	user 0.059s	sys 0.018s
I20260709 13:08:25.072487 21856 raft_consensus.cc:359] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.073287 21856 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:25.073920 21856 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.076362 21856 ts_tablet_manager.cc:1434] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:25.077976 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-4deba3ef5feb443b8e28599a079603bd received from {username='slave'} at 127.0.0.1:49162
I20260709 13:08:25.078425 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-4deba3ef5feb443b8e28599a079603bd on tablet 4deba3ef5feb443b8e28599a079603bd with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:25.091812 21925 tablet_copy_client.cc:806] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:25.092363 21925 tablet_copy_client.cc:670] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:25.096125 21925 tablet_copy_client.cc:538] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:25.109980 21925 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:25.213042 21908 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.214440 21908 tablet_bootstrap.cc:492] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:25.215122 21908 ts_tablet_manager.cc:1403] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.170s	user 0.022s	sys 0.019s
I20260709 13:08:25.234766 21908 raft_consensus.cc:359] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.235594 21908 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:25.236253 21908 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.239087 21908 ts_tablet_manager.cc:1434] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:08:25.240679 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-441a1d437e7b4eff9f56f88ce7d935e5 received from {username='slave'} at 127.0.0.1:50636
I20260709 13:08:25.241113 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-441a1d437e7b4eff9f56f88ce7d935e5 on tablet 441a1d437e7b4eff9f56f88ce7d935e5 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:25.331609 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.387156 21925 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.404165 21925 tablet_bootstrap.cc:492] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:25.410943 21891 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.411291 21925 ts_tablet_manager.cc:1403] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.302s	user 0.037s	sys 0.018s
I20260709 13:08:25.432850 21925 raft_consensus.cc:359] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.434805 21925 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:25.435568 16634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:25.435492 21925 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.436182 16634 raft_consensus.cc:606] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:25.438162 21925 ts_tablet_manager.cc:1434] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:25.439846 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-b1ada08378e34050bfc80a9f6893b014 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:08:25.440253 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-b1ada08378e34050bfc80a9f6893b014 on tablet b1ada08378e34050bfc80a9f6893b014 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:25.448602 21891 tablet_bootstrap.cc:492] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:25.449337 21891 ts_tablet_manager.cc:1403] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.449s	user 0.039s	sys 0.009s
I20260709 13:08:25.476924 21891 raft_consensus.cc:359] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.477732 21891 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:25.478143 16634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:25.478737 16634 raft_consensus.cc:606] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:25.478353 21891 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:25.486194 16634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:25.488343 16634 raft_consensus.cc:606] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:25.492995 21891 ts_tablet_manager.cc:1434] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 13:08:25.501896 16634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:25.503479 16634 raft_consensus.cc:606] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:25.505784 16634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:25.506251 16634 raft_consensus.cc:606] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:25.507073 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-04f67e2620d84985a37dbf9b77909370 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:08:25.507524 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-04f67e2620d84985a37dbf9b77909370 on tablet 04f67e2620d84985a37dbf9b77909370 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:25.520440 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:25.522161 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:25.592221 17181 raft_consensus.cc:1217] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:08:25.610672 21887 raft_consensus.cc:993] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:25.611179 21887 raft_consensus.cc:1081] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:25.612711 16563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:25.613209 16563 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.613505 16563 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.616755 21833 raft_consensus.cc:993] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:25.617205 21833 raft_consensus.cc:1081] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:25.622987 17181 raft_consensus.cc:1217] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:08:25.624432 16491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:40234
I20260709 13:08:25.624922 16491 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.625229 16491 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.633366 16563 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:25.637987 16491 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.639875 16491 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:25.641419 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:25.657796 17181 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.643412 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:25.665995 16634 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.666292 16634 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:25.667035 16634 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.668215 16634 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.673578 17181 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:25.674744 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:25.675956 21893 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:25.678200 16634 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:25.678524 17184 raft_consensus.cc:1217] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 13:08:25.692999 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:25.693536 16491 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.716651 21893 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:25.717662 21893 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.724436 16563 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:25.726454 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:25.727074 16638 raft_consensus.cc:3055] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:25.727393 16638 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:25.728297 16638 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:25.730014 16491 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:25.733377 16530 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:25.734313 21888 raft_consensus.cc:2804] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:25.735749 21888 raft_consensus.cc:697] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:25.736605 21888 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:25.738602 16386 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 14 to 15, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 15 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.745539 16638 raft_consensus.cc:3060] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.760247 16638 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:25.811414 21833 raft_consensus.cc:993] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:25.811904 21833 raft_consensus.cc:1081] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:25.814194 16563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:25.814698 16563 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.815003 16563 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.816340 16385 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 15 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.821202 16563 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.824366 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:25.824469 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:25.824893 16638 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.825064 17183 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.825261 16638 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:25.826165 16638 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.826833 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:25.827247 16638 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.827378 16491 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.833925 16638 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:25.834342 17183 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:25.836326 16563 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:25.838788 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:25.839583 21888 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:25.840052 21888 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:25.840906 21888 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.856602 16491 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:25.865938 17184 raft_consensus.cc:1217] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:08:25.910271 21887 raft_consensus.cc:993] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:25.910737 21887 raft_consensus.cc:1081] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:25.912530 16483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:40234
I20260709 13:08:25.917371 16386 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 15, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.913012 16483 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.928434 16483 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.941438 21833 raft_consensus.cc:993] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:25.941939 21833 raft_consensus.cc:1081] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:25.944602 16558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:25.945080 16558 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.945401 16558 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.951920 16558 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.953675 16558 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:25.954581 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:25.955592 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:25.956060 17184 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.956159 16634 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:25.964063 17184 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:25.966279 16634 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:25.967077 16529 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:25.967206 16634 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.967896 21888 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:25.968370 21888 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:25.968457 16634 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.969148 21888 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:25.981356 16483 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:25.983827 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:25.984328 16558 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.988579 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:25.989112 16638 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:25.989385 16638 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:25.990103 16638 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:25.990437 16558 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:25.991163 16638 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.991709 16456 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:25.992583 21893 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.993040 21893 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:25.993826 21893 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:25.997131 16638 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:26.031154 16385 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 14, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.036049 21942 raft_consensus.cc:1064] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:26.038520 21942 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:26.081173 16386 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 10 to 11, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 11 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.083532 16483 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:26.097764 16634 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:26.141124 16558 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:26.142355 16638 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:26.142482 21941 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:26.146080 21901 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:26.154377 17183 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:26.155772 21942 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:26.175524 21878 raft_consensus.cc:1064] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:26.177983 21878 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:26.195060 21901 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:26.204056 16633 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:26.212144 21882 raft_consensus.cc:1064] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:26.213567 17184 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:26.213449 16558 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:26.214619 21882 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:26.215119 21949 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.228022 16483 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:26.230322 17181 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:26.234760 16635 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:26.238252 21949 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:26.239619 21949 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.242007 16634 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:26.247144 16491 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:26.255527 16634 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:26.257814 16388 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:26.262703 21901 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.247839 21949 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:08:26.278045 21878 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:26.257323 21956 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:26.301932 16488 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:26.305207 17183 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:26.315117 21887 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:26.316915 21861 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.327221 16558 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:26.327221 17183 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:26.333408 21882 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.332468 21893 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 13:08:26.492671 21960 log.cc:927] Time spent T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:08:26.523061 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:26.488248 21949 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:26.596050 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 234324us
I20260709 13:08:26.614180 16483 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:26.629174 16482 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:26.723345 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 85984.6us
I20260709 13:08:26.732837 17184 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:26.751783 17183 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:26.765244 16633 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:26.769122 16557 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:26.795055 16633 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:26.818446 17182 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:26.818311 17186 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:26.820327 16633 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:26.826848 21996 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:26.840667 21999 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:08:26.812230 21992 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:08:26.887669 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 56818.5us
I20260709 13:08:26.850857 21994 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:26.800850 21975 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:26.893329 21972 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:26.893582 21990 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:26.903965 21985 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:26.922724 21964 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:26.935117 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 154932us
I20260709 13:08:26.923605 16385 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:26.970957 16631 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:26.981667 16484 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.001214 21975 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:27.014079 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50391.9us
I20260709 13:08:26.968083 21882 raft_consensus.cc:1064] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:27.011687 17183 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.092199 22002 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:27.126456 21882 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:27.137627 21997 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:27.155043 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 76817.2us
W20260709 13:08:27.178203 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 124220us
I20260709 13:08:27.180634 16557 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.203209 21990 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:27.216575 16635 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.226511 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 441a1d437e7b4eff9f56f88ce7d935e5 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.247666 16483 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.234598 17182 raft_consensus.cc:2955] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:27.276696 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 167632us
I20260709 13:08:27.340837 16633 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.353773 16561 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:27.374347 21977 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:27.394869 16487 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:27.396694 22012 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:27.448460 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 141334us
I20260709 13:08:27.456632 17183 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:27.462949 21995 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:27.473434 21995 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.492379 16565 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.496435 17182 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.501086 16488 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.545528 16565 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:27.546674 16389 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 11 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.561007 16484 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:27.562597 21966 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:27.564945 17183 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:27.567173 21966 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:27.567569 16388 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 12 to 13, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.575491 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet 441a1d437e7b4eff9f56f88ce7d935e5 with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41626
I20260709 13:08:27.583191 21985 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.590098 16386 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.599293 16636 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:27.595607 17183 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.611701 16558 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:27.617539 17182 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:27.622430 16484 raft_consensus.cc:2955] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.629688 22027 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:08:27.631657 22012 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:27.649632 16636 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:27.658578 22035 tablet_replica.cc:333] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:08:27.666237 16563 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.675433 17182 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.661482 21979 raft_consensus.cc:2955] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.683670 22035 raft_consensus.cc:2243] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.686896 16563 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:27.692334 16385 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 13 to 14, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.698125 17183 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:27.699288 21995 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:27.702183 21995 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:27.684521 22035 raft_consensus.cc:2272] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.708876 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4deba3ef5feb443b8e28599a079603bd with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.709831 22035 ts_tablet_manager.cc:1916] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:27.715140 22003 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.718528 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04f67e2620d84985a37dbf9b77909370 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.719698 17183 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.724604 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:27.721410 16565 raft_consensus.cc:2955] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.738049 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet 4deba3ef5feb443b8e28599a079603bd with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:55922
I20260709 13:08:27.748107 22036 tablet_replica.cc:333] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:08:27.750919 22036 raft_consensus.cc:2243] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.752569 22036 raft_consensus.cc:2272] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.763191 22036 ts_tablet_manager.cc:1916] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:27.787442 16385 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 12 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.791469 16389 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 13 to 14, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:27.803580 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1ada08378e34050bfc80a9f6893b014 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.825795 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet b1ada08378e34050bfc80a9f6893b014 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:40216
I20260709 13:08:27.836201 22036 ts_tablet_manager.cc:1929] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:08:27.839661 22035 ts_tablet_manager.cc:1929] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:08:27.848656 22035 log.cc:1199] T 441a1d437e7b4eff9f56f88ce7d935e5 P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/441a1d437e7b4eff9f56f88ce7d935e5
I20260709 13:08:27.851073 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet 441a1d437e7b4eff9f56f88ce7d935e5 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:27.837257 16472 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f67e2620d84985a37dbf9b77909370 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:40216
I20260709 13:08:27.855978 22037 tablet_replica.cc:333] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:27.857076 22037 raft_consensus.cc:2243] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.857792 22037 raft_consensus.cc:2272] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.864256 22037 ts_tablet_manager.cc:1916] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:27.847270 22036 log.cc:1199] T 4deba3ef5feb443b8e28599a079603bd P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/4deba3ef5feb443b8e28599a079603bd
I20260709 13:08:27.882409 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet 4deba3ef5feb443b8e28599a079603bd (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:27.902187 16635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:27.902755 16635 raft_consensus.cc:606] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:27.905521 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:27.906045 16487 raft_consensus.cc:606] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:27.909225 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:27.909713 16487 raft_consensus.cc:606] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:27.911511 22037 ts_tablet_manager.cc:1929] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:08:27.911972 22037 log.cc:1199] T b1ada08378e34050bfc80a9f6893b014 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/b1ada08378e34050bfc80a9f6893b014
I20260709 13:08:27.912390 16565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:27.912917 16565 raft_consensus.cc:606] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:27.913818 22037 tablet_replica.cc:333] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:27.913760 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet b1ada08378e34050bfc80a9f6893b014 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:27.916947 16565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:27.917492 16565 raft_consensus.cc:606] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:27.918740 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:27.915031 22037 raft_consensus.cc:2243] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.923149 22037 raft_consensus.cc:2272] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.932668 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.934332 22037 ts_tablet_manager.cc:1916] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:27.960721 21994 raft_consensus.cc:993] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:27.961251 21994 raft_consensus.cc:1081] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Signalling peer f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:27.962788 16636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:35430
I20260709 13:08:27.963315 16636 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.963632 16636 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:27.971108 16636 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:27.973687 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:27.974200 16565 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:27.974447 16565 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:27.975131 16565 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:27.976936 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:27.977717 16487 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:27.979030 16565 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:27.991518 16487 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:27.993156 16565 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:27.993515 16636 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:27.994791 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:27.995633 21979 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:27.996100 21979 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:27.996857 21979 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:28.026678 22037 ts_tablet_manager.cc:1929] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.13
I20260709 13:08:28.027215 22037 log.cc:1199] T 04f67e2620d84985a37dbf9b77909370 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/04f67e2620d84985a37dbf9b77909370
I20260709 13:08:28.030344 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet 04f67e2620d84985a37dbf9b77909370 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:28.034237 16388 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 17 to 18, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 18 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.104923 21985 raft_consensus.cc:993] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:28.105406 21985 raft_consensus.cc:1081] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:28.106983 17183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48054
I20260709 13:08:28.107511 17183 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.107841 17183 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.131989 17183 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:28.139055 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:28.139583 16487 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.147480 17183 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:28.148030 16487 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:28.148119 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:28.162227 16565 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:28.162524 16565 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:28.163265 17152 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:28.165351 21885 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:28.165827 21885 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:28.166747 16565 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:28.168087 16565 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.170771 21885 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:28.180882 16565 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:28.206842 16388 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 15 to 16, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 16 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.263962 21974 raft_consensus.cc:993] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:28.264497 22024 raft_consensus.cc:1081] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:28.266340 17183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:08:28.266826 17183 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.267143 17183 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.273885 17183 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:28.275624 17183 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:28.278340 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:28.278944 16484 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:28.279232 16484 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:28.279886 16484 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:28.280987 16484 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.284091 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:28.284639 16635 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.302618 16635 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:28.304979 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:28.306317 16484 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:28.307158 21885 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:28.308293 21885 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:28.309100 21885 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:28.325735 22024 raft_consensus.cc:993] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:28.326242 22024 raft_consensus.cc:1081] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:28.334329 16563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:28.334821 16563 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.335142 16563 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.360711 16563 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:28.362495 16563 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:28.363320 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:28.363637 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:28.364310 16635 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.363924 16484 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:28.364979 16388 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 15 to 16, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 16 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.370858 16484 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:28.371783 16484 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:28.370421 16635 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:28.373605 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:28.374493 22013 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:28.375020 22013 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:28.375854 22013 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:28.387538 16484 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.394559 16488 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:28.398044 22012 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:28.399773 22012 raft_consensus.cc:993] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:28.403766 22003 raft_consensus.cc:1081] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:28.409309 16488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:40234
I20260709 13:08:28.409773 16488 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.410069 16488 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.410431 16388 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 13 to 14, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.414820 16484 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:28.423298 16488 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:28.425072 16488 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:28.425642 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:28.426203 16565 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.426424 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:28.426947 16636 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:28.427214 16636 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:28.427908 16636 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:28.428860 16636 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.434659 16565 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:28.436638 16456 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:28.438334 22024 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:28.438838 22024 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:28.439618 22024 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:28.448129 16565 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:28.457036 22003 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:28.476722 16636 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 10.
I20260709 13:08:28.494124 16388 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 9 to 10, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 10 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.747364 16487 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:28.748885 16565 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:28.751173 21885 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:28.754894 22008 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:28.760129 16487 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:28.766054 22039 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:28.832978 16636 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:28.847966 21885 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:28.921221 16638 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:28.927263 16565 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:28.932016 21974 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:28.934531 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.950542 16488 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:08:28.960282 21994 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:28.962819 16638 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:28.965832 21996 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:28.996368 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 49871.5us
I20260709 13:08:29.044468 21985 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:29.065160 16565 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:08:29.084457 16529 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca9e6e3a4a404a9893a40afed3d0179f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:29.126648 16488 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:29.129232 16635 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:29.143422 22013 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:29.147805 22013 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:29.191854 22060 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.208935 16635 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.215543 16488 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:29.326994 16388 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index -1 to 8, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.354027 16483 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.389701 16634 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:08:29.426918 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 63288.9us
I20260709 13:08:29.431613 16565 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:29.434644 22058 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:29.481108 22058 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:08:29.492741 16454 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d34e55d2ce67443aaecb395469a9c7ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:29.520174 22078 ts_tablet_manager.cc:933] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:29.520292 22059 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.522140 16558 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.534664 22078 tablet_copy_client.cc:323] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:08:29.537030 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet ca9e6e3a4a404a9893a40afed3d0179f from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:08:29.537549 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet ca9e6e3a4a404a9893a40afed3d0179f from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-ca9e6e3a4a404a9893a40afed3d0179f
I20260709 13:08:29.543975 16632 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.547224 16576 tablet_copy_source_session.cc:215] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:29.556085 22078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9e6e3a4a404a9893a40afed3d0179f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:29.570366 16488 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:29.597936 16389 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 9, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.613881 22078 tablet_copy_client.cc:806] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:29.622288 22078 tablet_copy_client.cc:670] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:29.632666 22078 tablet_copy_client.cc:538] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:29.642448 22078 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:29.668913 16638 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:29.671152 16454 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8c27c31776b4e60afb061384a2ea62e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:29.671419 16563 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:29.671617 22058 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:29.674774 22024 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:29.703337 22058 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.705762 16632 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.726531 16389 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.731738 16558 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:29.739398 22078 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:29.740334 22078 tablet_bootstrap.cc:492] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:29.740988 22078 ts_tablet_manager.cc:1403] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.008s
I20260709 13:08:29.744995 22078 raft_consensus.cc:359] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:29.745820 22078 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:29.746464 22078 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:29.751986 16563 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.762457 22078 ts_tablet_manager.cc:1434] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:08:29.764089 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-ca9e6e3a4a404a9893a40afed3d0179f received from {username='slave'} at 127.0.0.1:49162
I20260709 13:08:29.764508 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-ca9e6e3a4a404a9893a40afed3d0179f on tablet ca9e6e3a4a404a9893a40afed3d0179f with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:29.814468 16638 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:29.818390 21994 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:29.843680 16529 consensus_peers.cc:597] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f61b94df305e465c9e3aae1bf4931b69. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:29.862638 16488 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:29.865532 22066 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:29.912999 22013 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.917006 16487 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.918821 16632 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:29.944356 16388 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:30.032864 17186 raft_consensus.cc:1217] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 13:08:30.040550 22078 ts_tablet_manager.cc:933] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:08:30.033958 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:30.053012 22078 tablet_copy_client.cc:323] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:08:30.054778 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet d34e55d2ce67443aaecb395469a9c7ce from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:08:30.055295 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet d34e55d2ce67443aaecb395469a9c7ce from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-d34e55d2ce67443aaecb395469a9c7ce
I20260709 13:08:30.063374 16501 tablet_copy_source_session.cc:215] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:30.066424 22078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34e55d2ce67443aaecb395469a9c7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.095120 22078 tablet_copy_client.cc:806] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:30.095660 22078 tablet_copy_client.cc:670] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:30.099532 22078 tablet_copy_client.cc:538] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:30.120646 22078 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:30.180815 22078 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:30.191779 22078 tablet_bootstrap.cc:492] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:30.192482 22078 ts_tablet_manager.cc:1403] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.072s	user 0.030s	sys 0.004s
I20260709 13:08:30.194918 22078 raft_consensus.cc:359] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:30.200127 22078 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:30.200770 22078 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:30.202951 22078 ts_tablet_manager.cc:1434] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:08:30.219645 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-d34e55d2ce67443aaecb395469a9c7ce received from {username='slave'} at 127.0.0.1:50636
I20260709 13:08:30.220104 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-d34e55d2ce67443aaecb395469a9c7ce on tablet d34e55d2ce67443aaecb395469a9c7ce with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:30.259652 22078 ts_tablet_manager.cc:933] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:30.276831 16632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:30.277428 16632 raft_consensus.cc:606] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:30.285291 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:30.285981 16488 raft_consensus.cc:606] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:30.288779 16558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:30.289354 16558 raft_consensus.cc:606] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:30.290617 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:30.291182 22078 tablet_copy_client.cc:323] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:08:30.292235 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:30.296368 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet f61b94df305e465c9e3aae1bf4931b69 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:08:30.296885 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet f61b94df305e465c9e3aae1bf4931b69 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-f61b94df305e465c9e3aae1bf4931b69
I20260709 13:08:30.303435 22092 ts_tablet_manager.cc:933] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809)
I20260709 13:08:30.307718 16576 tablet_copy_source_session.cc:215] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:30.311481 22078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61b94df305e465c9e3aae1bf4931b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.329981 22092 tablet_copy_client.cc:323] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.1:42809
I20260709 13:08:30.331732 16501 tablet_copy_service.cc:140] P 359213375db14f3d874c121993f90d76: Received BeginTabletCopySession request for tablet a8c27c31776b4e60afb061384a2ea62e from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:50636)
I20260709 13:08:30.332261 16501 tablet_copy_service.cc:161] P 359213375db14f3d874c121993f90d76: Beginning new tablet copy session on tablet a8c27c31776b4e60afb061384a2ea62e from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:50636: session id = 16b5b367990f4b5c862484bdec0b9226-a8c27c31776b4e60afb061384a2ea62e
I20260709 13:08:30.332356 22078 tablet_copy_client.cc:806] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:30.333866 22078 tablet_copy_client.cc:670] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:30.337553 22078 tablet_copy_client.cc:538] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:30.344309 16501 tablet_copy_source_session.cc:215] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:30.345852 22078 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:30.349815 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c27c31776b4e60afb061384a2ea62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.386194 22092 tablet_copy_client.cc:806] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:30.398038 22092 tablet_copy_client.cc:670] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:30.401577 22092 tablet_copy_client.cc:538] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:30.448880 21994 raft_consensus.cc:1064] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:30.451390 21994 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:30.479247 22078 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:30.501854 22078 tablet_bootstrap.cc:492] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:30.502519 22078 ts_tablet_manager.cc:1403] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.157s	user 0.024s	sys 0.012s
I20260709 13:08:30.505791 22078 raft_consensus.cc:359] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:30.509253 22078 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:30.509865 22078 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:30.512733 21974 raft_consensus.cc:993] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:30.513252 21974 raft_consensus.cc:1081] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:30.518038 22078 ts_tablet_manager.cc:1434] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:08:30.519871 16558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:30.520339 16558 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.520651 16558 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.525779 17186 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:30.527309 16488 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:30.529210 16640 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:30.535048 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-f61b94df305e465c9e3aae1bf4931b69 received from {username='slave'} at 127.0.0.1:49162
I20260709 13:08:30.535465 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-f61b94df305e465c9e3aae1bf4931b69 on tablet f61b94df305e465c9e3aae1bf4931b69 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:30.535197 22096 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.534191 22092 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:30.541905 16558 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:30.540304 21994 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:30.546084 22096 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.546603 16558 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:30.547612 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:30.548174 17186 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.552277 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:30.552806 16487 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:30.553064 16487 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:30.553684 16487 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:30.556790 16487 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.572614 16487 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:30.574731 16530 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:30.577565 17186 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:30.580646 21994 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:30.581624 21994 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:30.582437 21994 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:30.592334 17186 raft_consensus.cc:1217] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:08:30.613358 22096 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:30.617388 16488 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:30.625090 22012 raft_consensus.cc:993] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:30.625675 22012 raft_consensus.cc:1081] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:30.638557 16558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55194
I20260709 13:08:30.639238 16558 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.639632 16558 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.641568 22013 raft_consensus.cc:993] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:30.642069 22066 raft_consensus.cc:1081] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Signalling peer f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:30.648761 16640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:35430
I20260709 13:08:30.649292 16640 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.649611 16640 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.660950 17183 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:30.684621 16640 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:30.685108 16389 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 8 to 9, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:30.686515 16640 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:30.690224 16385 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 11 to 12, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 12 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.694749 16640 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:30.696025 16558 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:30.698151 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:30.698772 16488 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.701212 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:30.701800 16638 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:30.702067 16638 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:30.703750 16638 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:30.704818 16638 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.698500 16558 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:30.711090 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:30.711632 17182 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.713016 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:30.713574 16565 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:30.713846 16565 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:30.714553 16565 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:30.715667 17186 raft_consensus.cc:1217] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:08:30.715679 16565 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.721930 17182 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:30.723716 16529 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:30.724241 16565 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:30.725685 22096 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:30.732304 22096 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:30.733193 22096 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:30.746644 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:30.747540 22012 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:30.748092 22012 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:30.749032 22012 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:30.750057 16488 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:30.772413 16638 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:31.715559 22108 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:31.716298 22108 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:31.718852 22108 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:31.822517 22092 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:31.848981 22092 tablet_bootstrap.cc:492] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:31.880795 22092 ts_tablet_manager.cc:1403] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 1.367s	user 0.041s	sys 0.022s
I20260709 13:08:31.984599 22092 raft_consensus.cc:359] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:32.039947 22092 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:32.043496 22092 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:32.273747 22108 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.274493 22108 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.277318 22108 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.363370 22092 ts_tablet_manager.cc:1434] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.382s	user 0.010s	sys 0.000s
I20260709 13:08:32.336927 22109 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.402737 22109 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.405138 22109 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.499784 22107 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.500546 22107 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.502676 22112 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.508878 22111 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.509431 22111 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.511461 22111 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.502708 22107 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.525306 22113 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.525966 22113 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.528429 22113 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.551697 22115 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.503262 22112 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.569756 22114 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.565240 22109 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.627332 22114 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.650547 22114 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.651907 22112 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.650580 22107 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.653128 22107 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.571972 22115 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.673162 22114 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.673735 22114 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.674186 22116 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.674710 22116 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.677423 22114 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.682554 22116 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.683728 22114 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.683947 22112 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.684229 22111 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.684509 22114 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.684516 22112 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.685060 22111 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.686774 22114 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.687099 22111 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.684630 22120 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.687608 22111 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.687273 22114 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:08:32.685487 22105 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.427s	user 0.007s	sys 0.005s
I20260709 13:08:32.688341 22114 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.690693 22114 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.687269 22112 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.687965 22120 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.699059 22120 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.711108 22112 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.684453 22124 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.711654 22112 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.711751 22124 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.709172 22123 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:32.713722 22112 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.714195 22112 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.717087 22114 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.714232 22123 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.717592 22114 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.719291 22123 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:32.719493 22114 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.715245 22112 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.719919 22116 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.720469 22116 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.721630 22112 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.722522 22116 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.726504 22122 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.711301 22120 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.737761 22120 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.739037 22133 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.729864 22098 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:32.742375 22121 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.742702 22133 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.742862 22098 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.743073 22121 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.745199 22098 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:32.745428 22121 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.688128 22111 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.646027 22108 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.736440 22112 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.736954 22114 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.727626 22124 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.740180 22120 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.740660 22122 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.742101 22135 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.746837 22134 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.731034 22131 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.748417 22117 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.733673 22128 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.645838 22118 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.628247 22109 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:32.750931 22113 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.754415 22130 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:32.755213 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.752591 22133 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.766363 22109 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.749181 22116 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.757019 22123 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.756763 22134 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.759119 22098 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.751194 22121 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.765013 22107 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.760308 22131 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.763876 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.752198 22114 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.750588 22108 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.761286 22120 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.774622 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.771346 22130 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.752346 22112 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.777477 22115 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.763850 22110 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.783169 22126 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:32.786243 22111 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.773182 22116 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.767331 22113 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.762897 22118 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.760792 22117 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.762358 22128 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.883868 22147 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:32.888103 22147 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.890821 22143 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.893877 22143 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.896189 22143 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.896694 22143 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.891604 22142 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.773980 22119 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.896901 22146 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:32.774713 22109 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.897668 22143 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.755717 22135 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.897861 22109 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.905131 22113 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:32.905460 22109 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.906009 22130 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.906689 22131 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.897284 22142 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.908893 22142 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:32.821023 22139 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:32.880636 22137 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.831665 22107 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.880939 22108 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.888685 22148 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.830190 22114 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.774798 22123 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.913587 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.923115 16638 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:32.787369 22134 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.775063 22098 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.924124 22147 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.924412 22118 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.922765 22148 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.809356 22120 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.925299 22098 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:32.926779 22120 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.903498 22110 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.920343 22128 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.921128 22135 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.921519 22137 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.933252 22129 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:32.933400 22116 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.927228 22098 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:32.916298 22139 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.914021 22113 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.897455 22146 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:32.925134 22122 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.897360 22119 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.929085 22107 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:32.930171 22123 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.892894 22126 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:32.930646 22112 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:32.778759 22121 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.016337 22128 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:32.933800 22143 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.060201 22128 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.016518 22142 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.061309 22142 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.061935 22126 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.933779 22129 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.934141 22137 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.938699 22145 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.031075 22150 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.062172 22128 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:32.927229 22148 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.053411 22152 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.103924 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.105736 16557 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:33.107498 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.109225 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.110478 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.112028 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.113377 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.116528 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.116676 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.182633 16558 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.183063 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.183722 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.184448 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.185364 16501 tablet_copy_service.cc:342] P 359213375db14f3d874c121993f90d76: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-a8c27c31776b4e60afb061384a2ea62e received from {username='slave'} at 127.0.0.1:50636
I20260709 13:08:33.118777 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.186136 16501 tablet_copy_service.cc:434] P 359213375db14f3d874c121993f90d76: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-a8c27c31776b4e60afb061384a2ea62e on tablet a8c27c31776b4e60afb061384a2ea62e with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:33.187453 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.188208 16560 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:33.184383 16456 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:33.189136 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.189870 16560 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.190811 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.121325 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.192348 16561 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:33.192467 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.193466 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.194694 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.195338 16561 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:33.121479 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.122639 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.196424 16562 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:33.185998 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.125672 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.127156 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:33.132416 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.134004 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.197598 16566 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.197983 16559 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:33.198117 16565 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
W20260709 13:08:32.944880 16603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.142s	user 0.020s	sys 0.012s
W20260709 13:08:33.200574 16603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.397s	user 0.021s	sys 0.013s
I20260709 13:08:33.201045 22164 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.201985 22164 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:32.941263 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.940796 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.941924 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.938917 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.164263 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.208209 16631 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:33.208913 16638 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 11.
I20260709 13:08:33.209746 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.173245 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.212757 16631 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:33.212879 16637 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:33.179008 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.031895 22074 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.213874 16635 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:33.214394 22074 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:33.215126 22003 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.213884 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:32.935878 22117 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.227097 22117 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.227743 22121 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.227982 22119 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.227828 22117 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.228411 22126 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.229275 22126 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.184470 16558 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:33.170557 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.210016 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.210047 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.211939 16636 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:33.191484 16560 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.214848 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.172061 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.215885 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.181559 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.216070 22003 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.231510 16635 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:33.193264 16640 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:32.937865 22110 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.220146 22098 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.059443 22113 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.224642 22107 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.225160 22111 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.241441 22137 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.064965 22150 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.241938 22148 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.243094 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.243626 22137 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.244565 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.229657 16631 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.241531 22128 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.065209 22152 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.242105 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.246762 22150 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.241446 22127 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.248039 22127 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:33.248986 16632 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:33.249125 22128 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.250766 22131 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.251030 22148 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.248474 22152 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.252214 22152 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.252853 22152 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:33.253350 17186 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:33.242681 22111 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.254528 16638 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.254179 22145 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.256385 22003 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.254902 22111 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.257032 16634 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.242188 22107 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.217278 22074 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.236702 22119 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.256567 22146 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.253605 22129 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.251426 22131 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.266870 22117 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.256664 22145 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.272440 16633 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:33.247201 22137 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.273393 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.256978 22130 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.250792 22127 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.275753 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.279713 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.272459 22123 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.287405 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.287967 22132 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.288932 22138 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.289595 22138 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.290952 22128 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.292105 22140 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.292804 22140 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.295011 22140 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.295540 22147 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.295984 22139 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.296290 22147 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.288635 22132 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.300761 22098 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.306377 22126 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.307323 22164 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.312698 22148 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.313191 22113 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.314318 22142 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.314754 22149 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.289428 22151 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.279170 22119 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.336513 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.281632 22155 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.337635 22163 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:33.319980 22153 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.281627 22130 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.338099 22163 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.338593 22163 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:33.339866 22147 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.341266 22153 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.342145 22111 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.343437 22153 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.322732 16631 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:33.313254 22152 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.298527 22138 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.327286 22149 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.327744 22131 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.328096 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.325838 22107 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.357969 17184 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:33.357990 22149 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.359333 22107 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:33.329221 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 72112.2us
I20260709 13:08:33.360641 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 283) took 2637 ms. Trace:
I20260709 13:08:33.331354 22132 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.332046 22151 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.361060 16386 rpcz_store.cc:276] 0709 13:08:30.722685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.722821 (+   136us) service_pool.cc:224] Handling call
0709 13:08:30.729947 (+  7126us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b540012d9d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f5090 00007f0636493f3a 00007f063c24a1cc 00007f063c34837e 00007f063a8092a4 00007f063a809232 00007f063a809161 00007f063a8090dc 00007f063a808392 00007f06347c648c 00007f06347c58c6
0709 13:08:33.360449 (+2630502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3088,"reported_tablets":1,"spinlock_wait_cycles":10236672}
W20260709 13:08:33.333254 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 149133us
I20260709 13:08:33.332979 22123 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.337361 22155 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.287583 22160 raft_consensus.cc:1064] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:33.364740 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.344841 22146 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.346252 22165 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.366015 22146 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.318289 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.365567 16637 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:33.365531 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.368199 22165 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.367235 22160 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.353238 16385 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 282) took 2670 ms. Trace:
I20260709 13:08:33.371311 22165 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.372397 22146 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.364691 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.346695 22147 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.339991 22130 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.376143 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.359561 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.378585 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.378783 22147 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.378585 17186 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:33.379159 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 186) took 2578 ms. Trace:
I20260709 13:08:33.380443 22135 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.380671 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.380862 22135 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.381300 22135 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.381579 16388 rpcz_store.cc:276] 0709 13:08:30.801043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.704876 (+1903833us) service_pool.cc:224] Handling call
0709 13:08:33.108762 (+403886us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b540012d9d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f5090 00007f0636493f3a 00007f063c24a1cc 00007f063c34837e 00007f063a8092a4 00007f063a809232 00007f063a809161 00007f063a8090dc 00007f063a808392 00007f06347c648c 00007f06347c58c6
0709 13:08:33.378992 (+270230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11055,"reported_tablets":1,"spinlock_wait_cycles":171508608}
I20260709 13:08:33.382622 17179 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.382908 22155 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.383697 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:33.385455 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002acae0 after lost signal to thread 15387
I20260709 13:08:33.386759 22123 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.381297 17187 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:33.387624 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.388494 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:08:33.386678 17209 debug-util.cc:398] Leaking SignalData structure 0x7b0800347d80 after lost signal to thread 16423
I20260709 13:08:33.362890 22151 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.390309 22136 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.391058 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.391602 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.381229 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.391543 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 271) took 2712 ms. Trace:
I20260709 13:08:33.393945 16483 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:33.380925 22147 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.394985 22136 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.393868 17183 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:33.397671 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.395721 16561 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:33.397146 22136 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.396080 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.398499 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.399724 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.398294 16487 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:33.393114 16485 raft_consensus.cc:1240] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.400449 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.401980 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.396997 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.395395 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.404455 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:08:33.391012 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002dea60 after lost signal to thread 16515
W20260709 13:08:33.411334 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002df300 after lost signal to thread 16516
I20260709 13:08:33.411132 22136 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:33.412628 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002de9a0 after lost signal to thread 16590
W20260709 13:08:33.429630 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08002de960 after lost signal to thread 16591
W20260709 13:08:33.392841 16604 connection.cc:256] RPC call timeout handler was delayed by -1.0884937069999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
I20260709 13:08:33.408561 22134 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.406322 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.413137 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.414216 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.415578 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.399886 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.396503 22119 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.417881 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.418798 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.410043 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.416230 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.418483 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.422397 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.420179 22162 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.419269 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.423072 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.406942 22163 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.424656 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.425212 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.425825 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.426829 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.429195 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.405656 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.407532 22135 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.430235 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.461457 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.473749 22134 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.473894 22163 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.474323 22134 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.474491 16489 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:33.435241 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.475518 22133 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.467092 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.429741 22136 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:33.475037 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65131.7us
I20260709 13:08:33.476688 22133 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.477375 22133 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.474615 22162 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.479218 16486 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:33.479696 22136 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.480130 22136 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.435492 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.477483 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.416301 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.430632 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:33.475915 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 52982.1us
I20260709 13:08:33.370335 16385 rpcz_store.cc:276] 0709 13:08:30.682505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.687707 (+  5202us) service_pool.cc:224] Handling call
0709 13:08:33.352983 (+2665276us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:33.221286 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:33.222368 (+  1082us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:33.222423 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:08:33.222460 (+    37us) tablet.cc:662] Decoding operations
0709 13:08:33.223094 (+   634us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:33.223189 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:33.223241 (+    52us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:33.223631 (+   390us) tablet.cc:701] Row locks acquired
0709 13:08:33.223683 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:08:33.224671 (+   988us) write_op.cc:270] Start()
0709 13:08:33.224842 (+   171us) write_op.cc:276] Timestamp: P: 1783602513224589 usec, L: 0
0709 13:08:33.224893 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 13:08:33.304911 (+ 80018us) log.cc:844] Serialized 527 byte log entry
0709 13:08:33.307040 (+  2129us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b540012d9d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636486e28 00007f0639ec1581 00007f0639ec0d58 00007f0639ec59f1 00007f0639ec59a9 00007f0639ec5939 00007f0639ec5901 00007f0639ec4b2d 000000000038f354 000000000038f199
0709 13:08:33.323416 (+ 16376us) op_driver.cc:464] REPLICATION: finished
0709 13:08:33.345202 (+ 21786us) write_op.cc:301] APPLY: starting
0709 13:08:33.345272 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:33.346189 (+   917us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:33.346216 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:33.346911 (+   695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:33.347058 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:33.347109 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:33.347286 (+   177us) log.cc:844] Serialized 25 byte log entry
0709 13:08:33.347441 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:33.347508 (+    67us) write_op.cc:454] Released schema lock
0709 13:08:33.347543 (+    35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":21555,"apply.run_cpu_time_us":2635,"apply.run_wall_time_us":2635,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":2356009,"prepare.run_cpu_time_us":7153,"prepare.run_wall_time_us":248370,"replication_time_us":97183,"spinlock_wait_cycles":181383424,"threads_started":1}]]}
I20260709 13:08:33.456156 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.485531 16484 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:33.458349 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.450155 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.485728 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:33.450562 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.480464 17182 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:33.482285 16636 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:33.473017 16557 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:33.489897 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.486975 17186 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:33.492599 22121 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.493033 22121 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.476557 22135 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.494418 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.493356 22121 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.480540 22136 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.499109 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.508423 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.509821 16631 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
W20260709 13:08:33.512566 17209 debug-util.cc:398] Leaking SignalData structure 0x7b08003889c0 after lost signal to thread 16664
W20260709 13:08:33.513309 17209 debug-util.cc:398] Leaking SignalData structure 0x7b0800348c40 after lost signal to thread 16665
I20260709 13:08:33.394332 16389 rpcz_store.cc:276] 0709 13:08:30.678220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.678363 (+   143us) service_pool.cc:224] Handling call
0709 13:08:33.390413 (+2712050us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:30.731857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:30.732342 (+   485us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:30.732375 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:08:30.732392 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:30.732693 (+   301us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:30.732755 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:30.732786 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:30.732947 (+   161us) tablet.cc:701] Row locks acquired
0709 13:08:30.732964 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:30.733087 (+   123us) write_op.cc:270] Start()
0709 13:08:30.733189 (+   102us) write_op.cc:276] Timestamp: P: 1783602510733044 usec, L: 0
0709 13:08:30.733215 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:32.767071 (+2033856us) log.cc:844] Serialized 587 byte log entry
0709 13:08:33.053557 (+286486us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540012d9d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636486e28 00007f0639ec1581 00007f0639ec0d58 00007f0639ec59f1 00007f0639ec59a9 00007f0639ec5939 00007f0639ec5901 00007f0639ec4b2d 000000000038f354 000000000038f199
0709 13:08:33.065367 (+ 11810us) op_driver.cc:464] REPLICATION: finished
0709 13:08:33.300991 (+235624us) write_op.cc:301] APPLY: starting
0709 13:08:33.301123 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:33.302936 (+  1813us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:33.302971 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:33.303644 (+   673us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:33.343479 (+ 39835us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:33.343543 (+    64us) write_op.cc:312] APPLY: finished
0709 13:08:33.343841 (+   298us) log.cc:844] Serialized 25 byte log entry
0709 13:08:33.344044 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:33.344130 (+    86us) write_op.cc:454] Released schema lock
0709 13:08:33.344204 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:33.344788 (+   584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:33.344822 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13042,"reported_tablets":4,"spinlock_wait_cycles":1313024,"child_traces":[["op",{"apply.queue_time_us":235314,"apply.run_cpu_time_us":4311,"apply.run_wall_time_us":43808,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":43761,"prepare.run_cpu_time_us":28228,"prepare.run_wall_time_us":2321899,"raft.queue_time_us":162349,"raft.run_cpu_time_us":5361,"raft.run_wall_time_us":236750,"replication_time_us":2330981,"spinlock_wait_cycles":4598550400,"thread_start_us":412104,"threads_started":4,"wal-append.queue_time_us":135643}]]}
I20260709 13:08:33.496690 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.493767 22163 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.517809 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.518877 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.520079 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.521747 22152 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.522223 22152 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.522660 22152 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.524181 22123 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:33.516656 22163 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.525291 22163 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.525516 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.526396 22123 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.526801 22123 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.527199 22123 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.531145 16604 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.531963 22155 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.532361 22155 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.532742 22155 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:33.532617 17209 debug-util.cc:398] Leaking SignalData structure 0x7b080022f980 after lost signal to thread 17212
W20260709 13:08:33.535480 17209 debug-util.cc:398] Leaking SignalData structure 0x7b0800368360 after lost signal to thread 17213
I20260709 13:08:33.534907 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.535820 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.532999 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.538775 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.534376 22133 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.541035 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:33.541865 22120 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.542565 22120 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.542918 22120 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.544184 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.544849 22119 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.545301 16456 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:33.548622 22124 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.549026 22124 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.549414 22124 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.554709 22116 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.555168 22116 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.555550 22116 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.554669 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:33.557106 17209 debug-util.cc:398] Leaking SignalData structure 0x7b080009e740 after lost signal to thread 22096
I20260709 13:08:33.557940 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.560062 22119 consensus_queue.cc:1059] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:33.513835 22134 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.568231 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.542253 22135 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.541862 22161 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.569938 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.570990 22134 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.571851 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.599972 22161 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.600521 22134 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.600971 22134 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.601310 22134 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.602754 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:33.603966 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 43998.3us
I20260709 13:08:33.604238 17183 raft_consensus.cc:1217] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:08:33.569573 22135 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.578958 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.602278 16456 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.584193 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.585870 22162 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.586890 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.606992 22115 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.590497 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.607362 22115 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.607744 22115 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.608937 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.610152 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.610404 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.611079 22114 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.611435 22114 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.611366 22140 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:33.611999 22114 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.612293 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.612507 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.605890 22135 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.613826 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.591378 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.614995 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:33.614925 17187 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:33.615384 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.615906 22112 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.594944 22111 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.616250 22112 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.616824 22112 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.613868 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.616938 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.614269 22140 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:33.612083 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.617846 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.561601 22121 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.618980 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.619442 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:33.619900 16490 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.620260 22121 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.600507 22161 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.620915 22108 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:33.621490 22108 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.621863 22108 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:33.599383 22133 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.623636 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.624042 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.625138 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.626742 22152 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.627839 16637 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.628356 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.628381 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:33.620869 16529 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:33.629565 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.630606 22160 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.631045 22160 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.631610 22160 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.631245 22162 raft_consensus.cc:3055] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:33.632324 22162 raft_consensus.cc:740] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:33.633304 22162 consensus_queue.cc:260] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.634397 22162 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.630924 22119 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:33.639042 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 77961us
I20260709 13:08:33.641528 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.642364 22107 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.642755 22135 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.643168 22134 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.630270 16483 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:33.645272 22134 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.648357 22115 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.649307 22114 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.650490 22115 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.651302 22116 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.630338 16529 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:33.652289 22135 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.652494 22140 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.652874 22140 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:33.653250 22140 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.632055 22120 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.630988 22123 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.655929 22123 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.630784 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.656682 22165 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.631630 22124 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:33.659242 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.659868 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.660473 22120 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.660823 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.661763 22124 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.605739 22155 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:33.662817 22112 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.679997 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.681344 22112 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.682308 16631 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:33.684662 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.685786 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:33.655934 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 98063.5us
I20260709 13:08:33.664013 22109 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.686491 16483 raft_consensus.cc:2393] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:33.686852 22109 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.687319 22109 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.667129 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:33.666302 22108 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.651187 22114 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.667088 22163 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.663161 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:33.671361 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.671569 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.672201 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.672767 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.672454 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.673108 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.671516 16489 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:33.673048 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.676117 22136 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.653340 22116 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.667050 22134 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.701224 22124 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.701370 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.701705 22124 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.701997 16490 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:33.702314 22124 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.702930 16487 raft_consensus.cc:1240] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:33.707084 22163 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:33.707479 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 44421.1us
I20260709 13:08:33.708024 16484 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:33.708763 22108 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.709798 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.710459 22114 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.712553 22114 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:33.712867 22155 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:33.712960 22114 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.700315 22134 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.719051 22134 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:33.721047 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.724707 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:33.724931 22152 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.725461 22119 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.726243 16605 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:33.726954 22119 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.728094 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.729621 22140 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.732234 22134 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.659214 22162 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:08:33.729554 22114 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.734611 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.735289 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.735208 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.736130 22119 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.736490 22119 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.736603 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.736851 22119 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.738056 22124 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.739286 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.741034 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.727559 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.744243 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.739920 22120 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.745011 22120 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.745394 22120 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.746044 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.746680 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.731567 22140 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.700865 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.749481 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.752240 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.754176 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.755749 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.757088 16455 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.757560 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.758334 22114 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.732802 22160 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.760066 22134 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.759995 22124 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:33.755468 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.761619 22136 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.762799 22161 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.763994 16636 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.757097 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.763725 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.765173 16565 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.747115 22109 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.767634 22109 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.768431 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.768930 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.769244 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.769536 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.769244 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.750100 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.765633 22161 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.770925 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.771469 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.767879 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.772524 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.774413 16558 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.775292 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.776172 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.775231 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.778280 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.777841 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.780130 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.775293 22134 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.781118 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.781255 22134 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.781658 22134 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.782083 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:33.781757 22145 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:33.784596 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.763574 22120 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.785676 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.786921 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.774843 22152 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.785406 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.789750 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:33.775900 22107 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.790652 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.792251 16486 raft_consensus.cc:2393] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:33.793438 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.793632 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.794837 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.795539 16482 raft_consensus.cc:2393] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:33.796307 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.796788 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.797010 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.799283 16485 raft_consensus.cc:1240] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:33.799981 16489 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.800807 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:33.801489 16484 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 18: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:33.802183 22107 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.786897 22123 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.790248 22155 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.807814 16491 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:33.808749 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.812922 16565 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:33.813295 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.822597 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.809063 22123 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.823238 22123 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.824937 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.825814 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.826359 16456 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.832372 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.825193 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.810990 22155 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:33.839274 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.836730 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.840197 16482 raft_consensus.cc:1240] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:33.823256 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.844674 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.847018 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.847496 16562 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.848416 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.849514 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:33.850879 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 57315.5us
I20260709 13:08:33.846932 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.852972 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:33.853703 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.853189 16605 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.857335 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.859153 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.858100 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.864255 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.841070 22155 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.863377 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:33.842206 22112 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:33.865728 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.867913 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.868284 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.867969 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.870098 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.879226 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.879515 16605 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:33.880788 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.883528 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.884562 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.884788 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.878719 22109 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:08:33.886096 22109 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.886317 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.886493 22109 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:33.887452 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.888381 22174 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.888568 16557 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.879447 22112 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:33.889855 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.890519 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.890849 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.891534 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.890481 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.892573 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.893172 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.894737 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.895804 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.897418 16636 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 18: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:33.890223 22112 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.886097 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:33.898550 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:33.895644 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.902112 16639 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:33.884879 22152 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.922709 22130 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:33.915405 22160 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.923714 22130 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:33.924432 22160 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.924772 22160 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:33.925554 22160 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.926632 22160 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.929005 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:33.929731 22117 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.930092 22117 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:33.930413 22117 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.932284 22140 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:33.932683 22140 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:33.933557 22140 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.936975 22120 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:33.945297 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:33.947814 16604 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.949270 16604 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:33.887421 22109 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.912370 22119 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:33.962595 16558 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:33.963508 16565 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.967088 16456 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:33.968053 22120 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:33.968557 22120 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:33.969437 22120 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.970971 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:33.971874 22111 raft_consensus.cc:1064] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
W20260709 13:08:33.972129 22171 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:08:33.951642 22139 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:33.985064 22121 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.961640 22117 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:33.964836 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:33.995174 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 115724us
I20260709 13:08:33.964464 22151 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.964986 22164 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.011293 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.018026 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:33.952071 22123 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.020082 16558 raft_consensus.cc:1240] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:08:34.020386 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 55639us
I20260709 13:08:34.022527 16455 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.023360 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.025120 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:34.028465 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:34.028622 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 93931.9us
I20260709 13:08:34.031353 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.032547 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.033635 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:34.037882 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 115435us
W20260709 13:08:34.031056 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 60286.9us
I20260709 13:08:34.027894 22139 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.044404 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.029785 22109 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.039160 22121 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.029970 22136 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.038671 22124 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.054805 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.059145 16455 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.061228 22115 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.060184 22133 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.063197 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.064985 16454 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.043340 22177 consensus_queue.cc:1059] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:08:34.068696 22098 raft_consensus.cc:3055] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.068648 22117 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:34.044724 22116 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.055253 22114 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.069854 22116 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.069087 22098 raft_consensus.cc:740] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:34.070860 22119 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:34.071033 22098 consensus_queue.cc:260] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.077908 22155 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.079939 22155 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:34.039101 22173 consensus_queue.cc:1059] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:08:34.067745 16454 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:34.083326 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.084051 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 54620.3us
I20260709 13:08:34.084996 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:34.070022 22114 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.088265 22173 raft_consensus.cc:3055] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.088627 22173 raft_consensus.cc:740] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:34.089483 22173 consensus_queue.cc:260] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.089968 22123 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:34.090610 22173 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.085470 22134 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.094164 22134 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:34.101547 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.120327 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:34.121899 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:34.123266 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:34.124446 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 56804.3us
I20260709 13:08:34.124604 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:34.125209 16454 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:34.125763 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.125826 22108 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.126324 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.127292 22134 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:34.126192 22114 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.128609 22114 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.129462 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.130206 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:34.130489 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.130724 22112 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:34.131942 22124 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.133160 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.130913 16389 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 15, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.133929 22140 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.128538 22098 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.137287 16454 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:34.138214 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 93122.9us
I20260709 13:08:34.133914 16638 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:34.140022 16530 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.141688 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:34.146190 16605 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.148965 16455 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.150389 22112 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.151332 22147 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.153463 16455 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:34.153769 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.147696 22108 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.153457 22139 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.147703 22109 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.147212 22111 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:34.159921 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.161940 16605 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.175246 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:34.184167 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 132534us
I20260709 13:08:34.177497 22139 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.179001 22108 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:34.177965 22124 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.164584 22173 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.189795 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:34.190443 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:34.190824 17184 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:34.192608 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.192965 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:34.194213 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.195360 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.197079 16489 raft_consensus.cc:1240] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.197991 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:34.201246 22109 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.202915 17152 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:34.194639 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:34.204618 16484 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:34.205129 16489 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.205674 16491 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.206377 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:34.206897 16486 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.204522 16485 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:34.191252 22108 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:34.207051 16484 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.197011 16488 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.208781 22179 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.209169 22179 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:34.209507 22179 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:34.213188 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 47861us
I20260709 13:08:34.213261 22108 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.214426 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:34.220132 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 80181.6us
I20260709 13:08:34.226907 16638 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:34.227767 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.221824 22166 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.235216 16557 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:34.224246 16454 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.236290 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.242781 22179 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.222721 22160 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:34.245843 22188 consensus_queue.cc:1059] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:34.246853 22188 raft_consensus.cc:3055] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.246975 22120 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.248364 16454 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.249182 22109 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:34.249459 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.250545 22179 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:34.251091 22188 raft_consensus.cc:740] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.251473 22151 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.252506 22188 consensus_queue.cc:260] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.253749 22188 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.223614 22111 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.258183 16605 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.259521 22120 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.259552 22162 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.261204 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.262086 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.287526 16563 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.288014 17153 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.288669 16633 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:34.289297 22183 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.292569 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.272001 22184 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.295001 22184 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.262686 22121 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:34.298223 22163 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:34.299903 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.293691 17153 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.302294 17152 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.303315 22115 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.304045 22183 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.304591 22120 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.305490 22115 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.262086 22162 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.305814 22115 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:34.271852 22160 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:34.306646 22115 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.307101 22151 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.307509 22151 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.312551 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.313685 22151 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.314183 16638 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:34.314838 22151 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.317777 17152 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.318908 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.311676 22115 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:34.336918 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.323215 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:34.352308 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.359148 17153 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:34.360041 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 47587.3us
I20260709 13:08:34.348984 22184 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.362802 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.349150 22179 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.372829 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.358268 22142 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.369184 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.374745 22182 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.377143 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:34.380154 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:34.361963 22183 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.381078 16485 raft_consensus.cc:1240] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.382158 22178 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.380520 16530 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.360793 22163 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.385042 16487 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:34.385679 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 66839us
I20260709 13:08:34.385807 22142 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.371968 22117 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.399688 16485 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:34.399435 16385 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.400976 16385 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 16, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.386452 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.387321 16488 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:34.392904 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:34.406272 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.406786 22178 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.408260 22179 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:34.408656 22179 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:34.408690 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.409160 22179 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.412281 22117 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.401216 22188 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.417510 22179 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.419375 22117 consensus_queue.cc:1059] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.420353 22117 raft_consensus.cc:3055] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.420775 22117 raft_consensus.cc:740] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.406904 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:34.419560 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.421643 22117 consensus_queue.cc:260] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.422164 22182 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.423007 22117 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.423518 17152 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.420406 16563 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:34.423821 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:34.424224 22142 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.424575 16485 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:34.425278 17152 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.425844 22111 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:34.426795 16488 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.422006 16486 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:34.428660 16485 raft_consensus.cc:1240] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.429119 22162 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:34.422941 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.430514 22162 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:34.431082 22166 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:34.432300 22162 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:34.432660 22162 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:34.433444 22162 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.432232 22166 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:34.434888 22162 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:34.435204 22166 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.436668 16484 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:34.439420 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.439916 22142 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.443539 22140 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.445199 17152 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:34.440838 22179 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:34.441293 22166 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.440932 22182 consensus_queue.cc:1059] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:34.440235 22190 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.442196 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.448465 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.449350 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.447609 22142 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:34.450570 22142 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:34.450959 22142 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.452018 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:34.460438 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 87663.7us
I20260709 13:08:34.464468 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.464740 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.465166 22188 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.468791 22183 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:34.460168 22107 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.460417 22190 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.461048 22173 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.472379 16530 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.473173 22199 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:34.461567 22185 consensus_queue.cc:1059] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:08:34.474686 22185 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.475013 22185 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:34.475939 22140 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.475817 22185 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.477097 22185 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.477169 16530 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.477774 22188 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.479089 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.479748 22178 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.480669 16530 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.463002 22151 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.485338 22183 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.485213 22202 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.463824 22182 consensus_queue.cc:1243] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer 359213375db14f3d874c121993f90d76 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:34.489264 22108 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:34.494130 22182 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:34.494483 22182 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.495285 22182 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.496477 22182 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:34.497352 22184 raft_consensus.cc:3055] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.497745 22184 raft_consensus.cc:740] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.498540 22184 consensus_queue.cc:260] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.463667 22179 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:34.493040 22140 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.462682 22117 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:08:34.465231 22139 consensus_queue.cc:1059] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:34.492050 16557 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:34.504727 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.504930 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.493427 22190 consensus_queue.cc:1059] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.510278 22139 raft_consensus.cc:3055] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.510466 16485 raft_consensus.cc:1240] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.510743 22139 raft_consensus.cc:740] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:34.510927 22178 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.491346 22188 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:34.511924 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 47245.9us
I20260709 13:08:34.512533 22130 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.511754 22151 consensus_queue.cc:1059] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:34.499742 22184 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.515640 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.513403 22117 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.517323 22117 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.518105 22117 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.519208 22117 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.519639 22151 consensus_queue.cc:1059] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:34.520144 22147 raft_consensus.cc:3055] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.520514 22147 raft_consensus.cc:740] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.520731 22151 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.521085 22151 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.522415 16563 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:34.521221 22139 consensus_queue.cc:260] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.524113 22139 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.524740 22179 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.510769 22190 raft_consensus.cc:3055] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.525115 22179 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.529910 22188 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.530069 22111 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:34.529507 22199 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.530759 22199 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.531018 22147 consensus_queue.cc:260] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.531587 22199 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.532181 22147 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.532827 22199 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.527545 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.526055 22190 raft_consensus.cc:740] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.535192 22190 consensus_queue.cc:260] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.536293 22190 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.538854 22142 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.541581 22199 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.542501 22151 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.544003 22188 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:34.544512 22188 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.545275 22188 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.548738 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.551935 22140 raft_consensus.cc:3055] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:34.552274 22142 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:34.552534 22165 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:34.553058 22165 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.553862 22165 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.526397 22183 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.555413 22178 consensus_queue.cc:1059] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.555955 22183 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.556741 22183 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.564960 22151 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.565712 22178 raft_consensus.cc:3055] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.566327 22178 raft_consensus.cc:740] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.567085 22178 consensus_queue.cc:260] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:34.568315 22178 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:34.578701 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 49681.7us
I20260709 13:08:34.582505 16636 raft_consensus.cc:1240] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:08:34.582849 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 118140us
I20260709 13:08:34.552294 22140 raft_consensus.cc:740] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:34.600642 16454 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:34.603439 16488 raft_consensus.cc:1240] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.605300 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:34.605787 16638 raft_consensus.cc:1240] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.605978 16636 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 13: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:34.606429 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:34.614656 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:34.614807 17153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.623008 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:34.625798 17180 raft_consensus.cc:1240] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:34.626752 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:34.627744 17179 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:34.628610 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:34.629279 16488 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:34.632165 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.649853 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.631949 22163 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.653524 17186 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.599825 22179 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.648587 22183 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.661201 17152 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.653355 22202 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:34.673544 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 50126.7us
I20260709 13:08:34.626783 22201 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:08:34.656644 22209 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.676990 22182 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.663012 22142 consensus_queue.cc:1059] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:08:34.699319 22163 raft_consensus.cc:1064] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:34.687690 22108 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:08:34.632582 22140 consensus_queue.cc:260] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.694128 16635 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:34.710531 22117 consensus_queue.cc:1059] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:34.707201 16385 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 12 to 13, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:34.724272 22179 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.726477 22205 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.726845 22205 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.727655 22205 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.728825 22205 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.717854 22160 consensus_queue.cc:1059] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:08:34.706923 22163 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.715070 22142 raft_consensus.cc:3055] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.751296 16634 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:08:34.752928 16634 pending_rounds.cc:85] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting all ops after (but not including) 7
I20260709 13:08:34.753166 16634 pending_rounds.cc:107] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:08:34.753437 16634 raft_consensus.cc:2889] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:34.759856 17151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.750919 22121 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:08:34.764962 17179 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:34.748690 16638 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:34.763528 16389 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:34.772512 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 187837us
I20260709 13:08:34.777493 22135 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:34.754321 22142 raft_consensus.cc:740] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.779899 22142 consensus_queue.cc:260] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.781147 22142 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.787196 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.788501 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:34.790877 17184 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
W20260709 13:08:34.793551 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 108548us
I20260709 13:08:34.801664 16489 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:34.810132 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.818032 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.818864 17153 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.820268 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:34.823310 22203 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:08:34.829723 22203 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.830066 22203 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.830902 22203 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.822103 22183 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.834268 22199 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.835000 17182 raft_consensus.cc:1240] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.836997 22211 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 3 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:34.840422 22203 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.821740 22184 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.861625 22140 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.864193 22201 raft_consensus.cc:3055] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.864583 22201 raft_consensus.cc:740] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:34.865434 22201 consensus_queue.cc:260] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.866618 22201 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.882763 17183 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
W20260709 13:08:34.894783 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.897692 16637 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 3 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:34.920472 22161 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:34.920996 22161 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.921541 16639 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:34.922959 22120 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.922883 22161 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:34.926159 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:34.928983 17183 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
W20260709 13:08:34.930059 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 245921us
I20260709 13:08:34.931845 16454 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.932700 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:34.923669 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41626 (request call id 10) took 1037 ms. Trace:
I20260709 13:08:34.929030 16385 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.935597 16454 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:34.934167 22112 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:08:34.934044 22107 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:34.939630 22107 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:34.940003 22107 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.934916 22163 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:34.951489 22163 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:34.953976 22163 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.955772 17182 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEARNER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:34.958141 22109 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:34.963702 22109 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:34.964529 22109 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:34.936362 22211 rpcz_store.cc:276] 0709 13:08:33.886422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.886574 (+   152us) service_pool.cc:224] Handling call
0709 13:08:33.895699 (+  9125us) log.cc:844] Serialized 480 byte log entry
0709 13:08:34.137996 (+242297us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b180023b840. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f0633318c0a 00007f063ca58219 00007f06333a0a40 00007f063339b4e4 00007f063339b455 00007f06363e4b0b 00007f0636469b63 00007f0636491752 00007f06364899fa
0709 13:08:34.923589 (+785593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57554,"raft.queue_time_us":105090,"raft.run_cpu_time_us":1267,"raft.run_wall_time_us":51110,"spinlock_wait_cycles":11543808,"thread_start_us":125971,"threads_started":1,"wal-append.queue_time_us":163647}
I20260709 13:08:34.966478 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2d7c9def9a84db7a3a3e5199a328236 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
W20260709 13:08:34.968950 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 285826us
I20260709 13:08:34.996150 16389 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 3 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:34.982107 22160 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:08:35.001343 22160 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:35.001701 22160 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:35.007472 22139 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:35.007995 22139 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.002868 22160 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.011533 22160 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.014111 17185 raft_consensus.cc:2955] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 3 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:35.015321 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet a2d7c9def9a84db7a3a3e5199a328236 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40216
I20260709 13:08:35.017589 17182 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:35.024541 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:35.025960 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.026641 16484 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.025151 16561 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:35.027957 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.028628 16488 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.032532 17183 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:35.029158 16560 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.018054 22139 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.044345 22136 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:08:35.086933 22173 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:35.087649 16563 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:35.087450 22173 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.089483 22173 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.107368 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.115310 16560 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:35.116602 22147 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:35.117383 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:35.117622 22151 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:35.118079 16560 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:35.118849 17185 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.122316 22115 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:35.118042 22151 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:35.124593 22151 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.125833 22151 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.126454 17185 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:08:35.131959 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 87463.3us
I20260709 13:08:35.133760 22230 tablet_replica.cc:333] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:35.135160 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.135882 16488 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.128237 22215 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.146087 22231 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:35.146498 22231 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:35.146848 22231 raft_consensus.cc:3060] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.145138 22215 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.136315 22218 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:08:35.159137 17185 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:35.170697 16488 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:35.170766 16484 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:35.183482 22133 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:35.185269 22107 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.187319 22107 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.172272 22218 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:35.199294 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.200060 16484 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.171977 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.213877 22230 raft_consensus.cc:2243] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:35.215510 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:35.220769 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 49561.4us
I20260709 13:08:35.232892 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:35.231520 16385 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 13 to 14, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.236696 16385 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 15 to 16, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.214293 22211 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:08:35.196461 22231 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.229278 22218 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:35.238099 22139 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:35.255409 22212 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:35.292848 17179 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:35.287947 22230 raft_consensus.cc:2272] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:35.298440 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.292634 22139 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:35.309780 22139 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.313048 22231 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.314301 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:35.316752 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.322032 16488 raft_consensus.cc:2393] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.314674 22235 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.323873 22235 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:35.325546 22235 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.306474 22212 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.345247 16558 raft_consensus.cc:2468] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:35.363618 16605 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.353392 22230 ts_tablet_manager.cc:1916] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:35.369295 22161 raft_consensus.cc:2804] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:35.377434 22237 log.cc:927] Time spent T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:08:35.379130 17183 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:35.402755 22185 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:35.403326 22185 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.405422 22185 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.406214 22139 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.411983 22135 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:35.413659 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:35.414248 16560 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:35.419921 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.425484 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.427505 16489 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 12: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.429427 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:35.430104 17184 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:35.427717 22231 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:35.431042 22231 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:35.431399 22231 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.423493 22161 raft_consensus.cc:697] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:35.434613 22161 consensus_queue.cc:237] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.428397 17182 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:35.457398 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.458133 16489 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.551898 22139 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.571605 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:35.572486 17179 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:35.573966 16529 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:08:35.579402 22238 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:08:35.571745 22212 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:35.579216 22244 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:35.579845 16560 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:35.584621 22218 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.595602 22218 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:08:35.644238 22241 log.cc:927] Time spent T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:08:35.645809 22245 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:35.650882 22231 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.616110 22218 raft_consensus.cc:3060] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.653441 22147 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:35.653946 22147 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.656642 22147 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.657717 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:35.658680 17183 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:35.659294 17185 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:35.659924 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:35.660861 22147 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:35.661347 22147 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:35.661814 22147 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.662273 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.662971 16489 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.661767 22108 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:08:35.678913 22215 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.680233 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.679355 22136 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:35.680850 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.681665 22140 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.682065 22215 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.682717 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:35.683723 22247 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:35.682126 22140 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.683264 16386 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 13 to 14, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.682566 22215 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.685449 22140 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.686758 22215 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.689867 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.690402 16639 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:35.692022 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.692585 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.692559 16489 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:35.693610 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.694458 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:35.695179 22212 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.695529 22140 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.695766 16639 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:35.695962 22140 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.696355 22140 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.703140 22140 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.695542 22212 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.704208 22212 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.714773 22212 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.718833 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:35.719436 17185 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:35.745472 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:35.751048 22162 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.753811 22162 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.745462 22215 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:35.756369 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.756557 22215 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.756969 16485 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:35.757362 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:35.758522 22215 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.759343 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:35.760082 22235 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:35.760449 22235 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.760593 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.760850 22235 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:35.761312 16485 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.761801 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.767652 22235 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.772060 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.772550 16485 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:35.774076 22162 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.774858 22235 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.777357 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:35.741425 22203 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.778861 22203 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.779451 16485 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 19.
I20260709 13:08:35.780678 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:35.781703 22203 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.782809 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.750329 22236 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.786571 22236 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.787616 16639 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:35.789037 22236 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.789129 22162 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.789676 22162 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.790418 22231 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.790757 16530 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.791249 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:35.791929 17183 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:35.792070 22178 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.791946 22162 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.792440 22178 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:35.792876 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.793126 22178 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.793470 16489 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 19.
I20260709 13:08:35.794585 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.789130 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.795833 16485 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:35.796773 16604 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.797483 22234 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:35.797852 22234 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.798159 22234 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:35.798550 22162 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:35.798947 22162 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.799275 22162 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.799849 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:35.800922 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:35.805301 22234 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.808166 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.808642 16484 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:35.809329 22140 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.810215 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:35.810708 16639 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.811110 22234 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:35.786095 22235 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:35.812093 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.812579 16488 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.745743 22218 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.816581 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.816895 16639 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:35.817243 16485 raft_consensus.cc:2393] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.817870 16530 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.818933 16488 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:35.819564 22165 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.824651 22165 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:35.825421 22165 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.825965 22178 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.821054 16558 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:35.821920 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:35.822220 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:35.828613 16485 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:35.823115 16565 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:35.823045 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:35.823993 16484 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 20.
I20260709 13:08:35.830096 16564 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:35.830499 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.831153 16488 raft_consensus.cc:2393] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.832010 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.818960 22147 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.833143 22231 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:35.833849 22215 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.834286 22215 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.835090 22234 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:35.835724 22234 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 20 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:35.836166 22215 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.836583 22234 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.838011 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.838078 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.838613 16484 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:35.839071 16635 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:35.841231 22147 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.841665 22215 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:35.812004 22235 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:35.842135 22215 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.843122 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:35.843938 22140 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:35.844290 22140 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.844733 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.845083 22236 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:35.845508 16485 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.845345 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.846299 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:35.843075 22235 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.849417 16484 raft_consensus.cc:2393] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:35.835652 17185 raft_consensus.cc:2468] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:35.851992 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:35.853194 16529 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.854825 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:35.855317 17183 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:35.847306 22147 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.859067 16560 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:35.863714 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.863534 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.865811 22247 raft_consensus.cc:2804] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.866310 22247 raft_consensus.cc:697] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:35.866707 22248 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:35.855182 22178 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.816584 22218 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.867348 22248 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:35.865396 22212 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.844664 22140 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.870822 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:35.871356 17183 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.868409 22248 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.869860 22155 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:35.875100 22155 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:35.875950 22155 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.874657 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:35.880919 16635 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.871209 22107 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:35.884279 22107 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:35.885159 22107 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.867126 22247 consensus_queue.cc:237] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.890401 16635 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:35.893018 16484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:35.893622 16484 raft_consensus.cc:606] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:35.896319 16560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:35.896821 16560 raft_consensus.cc:606] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:35.900394 16484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:35.900920 16484 raft_consensus.cc:606] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:35.902066 22212 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.902573 22212 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.905421 16484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:35.905927 16484 raft_consensus.cc:606] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:35.906229 16484 raft_consensus.cc:614] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:35.907696 22251 raft_consensus.cc:993] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:35.908174 22211 raft_consensus.cc:1081] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:35.902489 16530 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:35.910588 17183 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
W20260709 13:08:35.911067 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 316275us
I20260709 13:08:35.920675 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.921301 16635 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:35.915561 22215 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.935905 16638 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.912155 22203 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.912570 22218 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.948944 16635 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.949150 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.950053 16560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da035835f764425db56e9649db0a0bcc"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:35.950543 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:35.950620 16560 raft_consensus.cc:606] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:35.952304 16560 raft_consensus.cc:614] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:35.953985 16638 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:35.899564 22230 ts_tablet_manager.cc:1929] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:08:35.922370 22160 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:35.869916 22147 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.960304 16638 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:35.962836 17183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48054
I20260709 13:08:35.968698 17183 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:35.969038 17183 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.963748 16635 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:35.968040 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:35.972226 22212 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.972937 22230 log.cc:1199] T a2d7c9def9a84db7a3a3e5199a328236 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/a2d7c9def9a84db7a3a3e5199a328236
I20260709 13:08:35.973052 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:35.934469 22140 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:35.973342 22147 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:35.978189 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:35.949931 22151 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:35.983179 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:35.983757 16489 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:35.980216 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:35.958760 22211 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.958484 22218 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:35.960186 22255 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.993177 22211 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:35.994874 22211 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.003245 22140 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.988338 16633 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:36.006866 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:36.005590 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.007777 16637 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.980567 17183 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.955176 22203 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:35.977192 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.013250 16485 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:35.980918 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.014247 16635 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:36.016572 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.017131 16566 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:36.020232 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.020315 16637 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:36.024161 17183 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:35.973270 22160 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.025487 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.017395 16566 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:36.028255 16637 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.028613 17182 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:36.003885 22151 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.030515 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:35.993880 22251 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:36.031533 16530 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.024111 22115 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.037845 22115 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.018692 22248 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:36.039023 22248 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.039346 22248 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.039824 22115 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.010707 22255 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.041632 22255 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.033221 22250 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.042120 22203 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.042197 22250 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.044246 22250 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.044788 16484 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:36.045426 22218 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.046015 22161 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:36.033712 22264 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.048450 22254 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:36.048802 22264 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.050693 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.033659 22147 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.051266 22147 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.051640 22147 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.051270 17182 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:36.057305 22151 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.033397 16566 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.062165 16566 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.017844 22163 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.032804 16485 raft_consensus.cc:3060] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.064041 22163 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.050931 22264 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.065976 22163 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.067019 22251 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.070341 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.070278 16485 raft_consensus.cc:2468] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:36.072172 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.072486 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.073841 16638 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:36.036901 16637 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:36.050621 22124 raft_consensus.cc:993] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: : Instructing follower f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:36.069516 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:36.079315 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.076713 17152 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.033295 22266 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.109478 17152 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.109395 16558 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:36.112056 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.123759 16389 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 16, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.074792 22140 raft_consensus.cc:2804] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:36.131471 22274 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:36.125589 22266 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.108911 22165 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:36.145026 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 86126.6us
I20260709 13:08:36.135221 16385 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 283) took 1039 ms. Trace:
I20260709 13:08:36.127702 16389 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 16, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.138834 16566 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:36.108639 22212 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.139485 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 91688.3us
I20260709 13:08:36.122256 22203 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.116257 22160 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.078171 22231 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.145964 16385 rpcz_store.cc:276] 0709 13:08:35.095726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.095852 (+   126us) service_pool.cc:224] Handling call
0709 13:08:36.135156 (+1039304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:35.294526 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:35.356139 (+ 61613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:35.360107 (+  3968us) write_op.cc:435] Acquired schema lock
0709 13:08:35.365061 (+  4954us) tablet.cc:662] Decoding operations
0709 13:08:35.424392 (+ 59331us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:35.426096 (+  1704us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:35.428852 (+  2756us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:35.560879 (+132027us) tablet.cc:701] Row locks acquired
0709 13:08:35.560899 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:35.570290 (+  9391us) write_op.cc:270] Start()
0709 13:08:35.576107 (+  5817us) write_op.cc:276] Timestamp: P: 1783602515568457 usec, L: 0
0709 13:08:35.576135 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:08:35.613118 (+ 36983us) log.cc:844] Serialized 901 byte log entry
0709 13:08:35.923334 (+310216us) op_driver.cc:464] REPLICATION: finished
0709 13:08:35.993731 (+ 70397us) write_op.cc:301] APPLY: starting
0709 13:08:36.004523 (+ 10792us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.052311 (+ 47788us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.052418 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.053607 (+  1189us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.053787 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:08:36.053829 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:36.053997 (+   168us) log.cc:844] Serialized 33 byte log entry
0709 13:08:36.054155 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.054226 (+    71us) write_op.cc:454] Released schema lock
0709 13:08:36.054263 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.054652 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.054678 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":70176,"apply.run_cpu_time_us":4182,"apply.run_wall_time_us":60917,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":4853,"prepare.run_cpu_time_us":3910,"prepare.run_wall_time_us":338369,"replication_time_us":345118,"thread_start_us":39884,"threads_started":1}]]}
I20260709 13:08:36.048842 22162 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.125722 22264 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:36.156071 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 86698.6us
I20260709 13:08:36.167076 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.165069 22124 raft_consensus.cc:1081] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Signalling peer f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:36.172241 22266 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.177446 22147 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.178378 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.178977 16633 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:36.179253 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.179840 16566 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:36.180058 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.180863 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.181432 16488 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:36.182920 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.183468 16631 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:36.156735 22203 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.184319 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.186764 16484 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 19.
I20260709 13:08:36.187527 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.187664 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.180079 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.179781 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.188253 16488 raft_consensus.cc:2368] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 19. Current term is 20.
I20260709 13:08:36.189575 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:36.189102 16634 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:36.184453 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.196753 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.197257 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:36.198614 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.161088 22136 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.200186 16639 raft_consensus.cc:2368] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.200933 16488 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.202414 16633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:35424
I20260709 13:08:36.202924 16633 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.203244 16633 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.178146 22134 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:08:36.202179 22266 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:36.204639 22266 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.205570 22255 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.201103 22136 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.206314 22136 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.206066 22255 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.207088 22266 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.208005 22255 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.209209 22253 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.209584 22253 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.209880 22253 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.164266 22231 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.153148 22274 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.213631 22231 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.214457 16559 raft_consensus.cc:2393] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 15: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:36.205479 22211 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.216014 16635 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:36.205740 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet a2d7c9def9a84db7a3a3e5199a328236 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:36.216763 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.217751 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.218040 16634 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.221958 16488 raft_consensus.cc:1275] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:36.222903 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.223805 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.224370 16484 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.226783 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.227350 16564 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:36.230527 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.230746 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.231350 17182 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 19.
I20260709 13:08:36.232389 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.233166 16636 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 18: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:36.186131 22151 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.216727 22107 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.232754 16454 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:36.185024 22161 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.222461 22242 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:36.227479 16633 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.152264 22165 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.156682 22212 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.236109 16530 leader_election.cc:400] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 19. Current term is 20.
I20260709 13:08:36.250074 16530 leader_election.cc:403] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.200201 22203 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.231982 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.216192 22147 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.236546 16563 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:36.243425 16484 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:36.219482 22250 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.235713 22266 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.245764 22231 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.247189 22124 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:36.252306 16633 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.274230 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.286896 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.287382 16637 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:36.248164 22140 raft_consensus.cc:697] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 18 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:36.272382 22264 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:36.291618 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.289958 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.292348 16484 raft_consensus.cc:2393] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 18: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.294679 17152 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.271499 22266 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.269928 22273 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.269654 22250 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.273504 22274 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.272912 22231 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.299768 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.288777 22255 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.289258 22111 raft_consensus.cc:2764] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:36.287956 22124 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.292546 22215 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:36.249066 22151 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.290546 22147 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.310012 16489 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:36.249775 22161 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.319094 16489 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:36.306931 22250 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.329056 22151 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.329716 22147 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.331336 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.318951 22124 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:36.333174 22236 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:36.331624 22147 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.333673 22236 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.333611 16489 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.311589 22231 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.316220 22254 raft_consensus.cc:993] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:36.304296 22266 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.305996 22273 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.248447 22107 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.321599 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.322956 22264 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.317562 22251 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.327521 22161 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.310567 22155 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:36.314990 22274 consensus_queue.cc:1048] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:36.342587 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.343899 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.335628 22236 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.345988 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.352308 16564 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.346429 16565 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.331811 22281 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:36.348727 17184 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:36.337800 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.353636 17183 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
W20260709 13:08:36.360282 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 139404us
W20260709 13:08:36.361519 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 71001.6us
I20260709 13:08:36.318610 22255 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.365422 17183 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:36.355190 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 60606.9us
I20260709 13:08:36.344339 22162 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.347958 22273 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.356310 22281 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.366740 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:36.363160 22114 raft_consensus.cc:1081] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:36.375373 22151 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.346963 22140 consensus_queue.cc:237] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.378854 22284 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.365350 22253 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.391243 16634 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:36.392429 16485 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.370469 22211 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.355068 22155 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.383953 22151 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:36.401188 22151 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.372241 22281 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:36.385241 22255 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.386492 22107 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.387372 22212 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.388859 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 288) took 1015 ms. Trace:
I20260709 13:08:36.391038 16565 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:36.393294 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.421094 16639 raft_consensus.cc:2393] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:36.393589 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:36.398545 22268 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
I20260709 13:08:36.399111 22253 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.393864 22284 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.407677 16564 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:36.408322 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.405476 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.409168 22286 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.430410 22286 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.432397 22286 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:36.433769 22272 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:08:36.416239 16489 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.434893 16632 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:36.426414 16636 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:36.435546 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.429020 22284 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.429869 16529 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:36.449899 16634 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:36.409484 22165 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.452026 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.452675 16639 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:36.452899 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.453507 16564 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.438360 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.454559 17183 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:36.454577 16484 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:36.456441 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.456892 16565 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:36.456918 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:36.461057 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.462044 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.462410 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.464103 16559 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:36.438597 16530 leader_election.cc:400] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.413496 16386 rpcz_store.cc:276] 0709 13:08:35.373911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.374018 (+   107us) service_pool.cc:224] Handling call
0709 13:08:36.388802 (+1014784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:35.686309 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:35.686768 (+   459us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:35.686798 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:08:35.686814 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:35.687121 (+   307us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:35.687161 (+    40us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:35.687195 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:35.687358 (+   163us) tablet.cc:701] Row locks acquired
0709 13:08:35.687374 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:35.687488 (+   114us) write_op.cc:270] Start()
0709 13:08:35.687586 (+    98us) write_op.cc:276] Timestamp: P: 1783602515687448 usec, L: 0
0709 13:08:35.687605 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:35.688154 (+   549us) log.cc:844] Serialized 527 byte log entry
0709 13:08:35.964472 (+276318us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.054997 (+ 90525us) write_op.cc:301] APPLY: starting
0709 13:08:36.055063 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.076364 (+ 21301us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.121741 (+ 45377us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.228231 (+106490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.246439 (+ 18208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:36.251393 (+  4954us) write_op.cc:312] APPLY: finished
0709 13:08:36.273848 (+ 22455us) log.cc:844] Serialized 25 byte log entry
0709 13:08:36.293669 (+ 19821us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.298493 (+  4824us) write_op.cc:454] Released schema lock
0709 13:08:36.300004 (+  1511us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.344232 (+ 44228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.347057 (+  2825us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":87151,"apply.run_cpu_time_us":3471,"apply.run_wall_time_us":262229,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":412,"prepare.run_cpu_time_us":2061,"prepare.run_wall_time_us":2060,"replication_time_us":276107,"thread_start_us":49575,"threads_started":1}]]}
I20260709 13:08:36.466068 16530 leader_election.cc:403] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.466264 16561 raft_consensus.cc:2410] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:36.434633 22212 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:36.437134 22114 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.437445 22109 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.447510 16489 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:36.402910 22248 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.488042 16560 raft_consensus.cc:2368] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 18. Current term is 19.
I20260709 13:08:36.488616 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.489149 16557 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.489537 22248 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.490898 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.491709 22234 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:36.492089 22234 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.492405 22234 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.416181 22285 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.497231 22231 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.499730 22114 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.501981 22114 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.504045 16566 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:36.506867 22203 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.508220 22234 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.508584 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.509150 17179 raft_consensus.cc:2368] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15.
I20260709 13:08:36.510279 22287 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:36.511142 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.511518 22234 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.512823 22136 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.514946 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.465874 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.471412 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.470779 16564 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:36.515754 17183 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:36.516000 22124 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.478250 22250 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.465356 22284 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:08:36.465114 22108 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.516973 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45635.1us
I20260709 13:08:36.517028 22108 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.508862 22109 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.518131 16530 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.518946 22211 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.519084 22108 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.467658 22163 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.479890 22107 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.519511 22211 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:36.519672 22109 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.519907 22107 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:36.516573 22147 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.482894 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.486025 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.486616 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.521169 16482 raft_consensus.cc:2368] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 18. Current term is 19.
I20260709 13:08:36.521144 16486 raft_consensus.cc:3060] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.520718 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 275) took 1067 ms. Trace:
I20260709 13:08:36.508940 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:36.522744 22250 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.523492 22136 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.523706 22163 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.563719 22163 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.563949 22264 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.524276 16558 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.525139 16484 raft_consensus.cc:2368] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.566249 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.567011 16485 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:36.526269 22273 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.527005 16483 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:36.527771 16488 raft_consensus.cc:2368] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 19. Current term is 20.
I20260709 13:08:36.528083 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.516461 22287 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.529141 22124 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.520622 22211 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.528970 22107 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.528643 16486 raft_consensus.cc:2468] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:36.521149 22212 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.530076 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:36.476789 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.532438 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.533726 16565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:36.529518 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.522535 22155 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.538106 22134 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:36.541240 22203 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.541703 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.607498 16632 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.549181 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.550653 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:36.551236 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.552744 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:36.552274 22266 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.522362 16389 rpcz_store.cc:276] 0709 13:08:35.453308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.464851 (+ 11543us) service_pool.cc:224] Handling call
0709 13:08:36.520644 (+1055793us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:36.164956 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:36.170363 (+  5407us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:36.170393 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:08:36.170408 (+    15us) tablet.cc:662] Decoding operations
0709 13:08:36.170790 (+   382us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:36.170840 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:36.170864 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:36.171180 (+   316us) tablet.cc:701] Row locks acquired
0709 13:08:36.171196 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:36.171327 (+   131us) write_op.cc:270] Start()
0709 13:08:36.171430 (+   103us) write_op.cc:276] Timestamp: P: 1783602516171285 usec, L: 0
0709 13:08:36.171449 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.172028 (+   579us) log.cc:844] Serialized 901 byte log entry
0709 13:08:36.182021 (+  9993us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.182574 (+   553us) write_op.cc:301] APPLY: starting
0709 13:08:36.182648 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.370471 (+187823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.380063 (+  9592us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.485908 (+105845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.486089 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:08:36.486131 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:36.486308 (+   177us) log.cc:844] Serialized 33 byte log entry
0709 13:08:36.486475 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.486550 (+    75us) write_op.cc:454] Released schema lock
0709 13:08:36.486592 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.486936 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.486961 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13135,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":340,"apply.run_cpu_time_us":5776,"apply.run_wall_time_us":304348,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":2518,"prepare.run_wall_time_us":13172,"replication_time_us":10469}]]}
I20260709 13:08:36.556262 22281 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.557099 22285 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.557672 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.468089 22286 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:36.559582 22215 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 19. Current term is 20.
I20260709 13:08:36.560145 22284 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:36.527145 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.617741 17185 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 15: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:36.561879 22231 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.568657 16605 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.569403 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.619913 16633 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.570307 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.620703 16635 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.570931 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.572005 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.572026 16557 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:36.621523 16634 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:36.621752 16638 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 18: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:36.622041 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.622486 16557 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.622069 17182 raft_consensus.cc:2368] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 19. Current term is 20.
I20260709 13:08:36.572819 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.573746 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.574472 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.624069 16562 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:36.574678 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.576203 16603 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.597777 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:36.463172 22160 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.598824 16490 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:08:36.601197 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 71192.3us
I20260709 13:08:36.601552 16565 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.628862 16565 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.601994 16487 raft_consensus.cc:2393] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.564400 22264 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.606106 16529 leader_election.cc:400] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15.
I20260709 13:08:36.606257 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.606812 16491 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.608071 17183 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:36.631918 17181 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.610524 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.591496 22287 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.614265 22286 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.591760 22165 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:08:36.608287 22139 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:08:36.641975 16563 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:36.638350 16635 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:36.629838 16557 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
W20260709 13:08:36.642016 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 73418us
W20260709 13:08:36.642151 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 66009.6us
I20260709 13:08:36.633931 16529 leader_election.cc:403] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.660812 22266 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.660797 17181 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:36.663349 22231 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.663807 22231 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:36.664165 22231 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:36.665333 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 63033.9us
I20260709 13:08:36.649744 16634 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 20.
I20260709 13:08:36.644806 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.651939 16633 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:36.609902 22134 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.668397 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.627849 22151 raft_consensus.cc:2764] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:36.670073 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:36.672117 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.677948 16491 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.654305 16565 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.678222 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.672854 16635 raft_consensus.cc:2393] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.679351 17153 leader_election.cc:400] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 18. Current term is 19.
I20260709 13:08:36.665462 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.676689 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.680990 16633 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.641460 22160 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.682204 16634 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:36.684015 22139 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:36.684870 22250 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:36.691352 22139 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:36.692324 22139 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.685036 22134 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.685315 16489 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:36.691440 22250 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:36.694111 22264 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.686086 22212 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.694612 22250 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.678309 22248 raft_consensus.cc:3060] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.648150 22287 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.683668 22282 raft_consensus.cc:2764] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:08:36.688155 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.651427 22286 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.701978 16456 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.703002 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:36.653347 22276 raft_consensus.cc:2804] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:36.704190 22276 raft_consensus.cc:697] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:36.704300 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.705601 22108 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:36.706086 22108 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 17 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:36.706868 22108 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.707959 22112 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.708577 22112 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:36.708904 22112 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.709216 22112 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.681258 16455 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.712144 22111 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.712525 16455 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:36.712651 22111 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:36.687268 22273 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:36.713711 22114 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:36.713573 22111 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.714352 22276 consensus_queue.cc:237] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.714221 22114 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:36.716430 22114 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.712291 22281 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.724618 16632 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:36.725982 17152 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.730579 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:36.732862 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.733381 16489 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.734647 16633 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:36.738281 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.740783 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:36.742129 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 51584.9us
I20260709 13:08:36.743283 16565 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.739552 16489 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:36.745273 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:08:36.748102 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 65797.5us
I20260709 13:08:36.748466 16530 leader_election.cc:400] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 18. Current term is 19.
I20260709 13:08:36.748781 16530 leader_election.cc:403] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.749728 16530 leader_election.cc:400] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.751116 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.751768 17182 raft_consensus.cc:2368] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.752382 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:36.752939 16564 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.754427 16561 raft_consensus.cc:2393] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.754576 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.747514 16456 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.755376 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.758039 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.758551 16634 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.761059 16564 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:36.764664 16529 leader_election.cc:400] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.764964 16529 leader_election.cc:403] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.769323 16631 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 20: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:36.773654 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:36.774749 22266 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:36.691043 22160 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.778577 22287 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.780831 22247 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.781939 22286 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.784802 22287 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.764065 22264 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:36.785552 22218 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:36.785567 22264 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:36.787057 22264 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.788316 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:36.788718 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:36.793125 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:36.793243 16530 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.793509 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.793677 16489 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.788867 17181 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.799494 16634 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:36.799898 16489 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:36.754916 22281 raft_consensus.cc:2804] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.801642 17152 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
W20260709 13:08:36.808792 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 197997us
I20260709 13:08:36.804909 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:36.810113 16632 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.811496 22266 raft_consensus.cc:2804] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:36.812001 22266 raft_consensus.cc:697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:36.812774 22266 consensus_queue.cc:237] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.769169 22133 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.796972 22286 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:36.818884 22281 raft_consensus.cc:697] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:36.819675 22281 consensus_queue.cc:237] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.802294 22284 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:08:36.825834 16604 leader_election.cc:400] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 19. Current term is 20.
I20260709 13:08:36.826148 16604 leader_election.cc:403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.827082 22284 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 19. Current term is 20.
I20260709 13:08:36.827294 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:36.829273 22234 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.809194 22218 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:36.836575 22218 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:36.853888 22248 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15.
I20260709 13:08:36.860584 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:36.861307 17185 raft_consensus.cc:2393] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 13: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:36.864303 22160 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.864943 22231 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.865880 16560 raft_consensus.cc:2368] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
I20260709 13:08:36.865899 16635 raft_consensus.cc:3060] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.868252 16456 leader_election.cc:400] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
I20260709 13:08:36.868530 16456 leader_election.cc:403] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.807346 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:36.755570 22273 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.805622 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:36.871973 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 66420.2us
I20260709 13:08:36.873238 22231 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:36.873937 17188 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:36.876096 22273 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.874161 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:36.884905 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45731.4us
I20260709 13:08:36.888526 16557 raft_consensus.cc:2468] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:36.890414 17181 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:36.896852 16635 raft_consensus.cc:2468] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:36.897472 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:36.912220 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 53661.2us
I20260709 13:08:36.917855 16603 leader_election.cc:400] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 19. Current term is 20.
W20260709 13:08:36.919026 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 64436.6us
I20260709 13:08:36.921542 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:36.922271 22236 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.923872 22236 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.927987 16557 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:36.932500 22284 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:36.943015 22248 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:36.943532 22248 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:36.944437 22248 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:36.951351 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 144063us
I20260709 13:08:36.953420 16631 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:36.953927 16634 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:36.961666 16632 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:36.837435 22218 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:36.972378 22109 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.886008 22112 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:36.974701 22282 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 18. Current term is 19.
I20260709 13:08:37.025568 16530 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:37.067755 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:37.071957 22112 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:37.098280 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:37.015570 22147 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:37.062325 22287 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.127941 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:37.029611 22251 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:08:37.112154 22283 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:37.129005 22136 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.215834 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:37.216419 16485 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.141290 22287 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:37.218072 16489 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:37.220963 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:37.221064 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:37.218555 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:37.222095 16484 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:37.218814 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:37.222837 16483 raft_consensus.cc:1275] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:37.223007 16490 raft_consensus.cc:2368] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:37.221077 16488 raft_consensus.cc:1275] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:08:37.222805 16491 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:37.224262 16491 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:37.225536 16487 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:37.220501 22295 log.cc:927] Time spent T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:37.235277 22252 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:37.235086 16491 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:37.175642 22283 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:37.259713 16485 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
W20260709 13:08:37.256321 22309 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:08:37.265007 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:37.260512 22252 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.263557 22133 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.264428 22139 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:37.284044 22252 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.308679 16488 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:37.310846 16484 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:37.300324 22234 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.327533 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:37.330346 16482 raft_consensus.cc:2368] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18.
W20260709 13:08:37.333184 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 65910.1us
I20260709 13:08:37.337473 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:37.352066 22297 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:08:37.286068 22287 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:37.380646 22306 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:08:37.379470 22307 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:08:37.376470 22301 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:37.382750 22283 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:37.377306 22304 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:08:37.381722 22308 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:08:37.449626 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 184702us
I20260709 13:08:37.458484 16632 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:37.466605 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:37.440162 16558 raft_consensus.cc:1240] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:37.460333 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 190220us
W20260709 13:08:37.486157 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 149888us
W20260709 13:08:37.496766 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 171934us
I20260709 13:08:37.506784 16559 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:37.507449 16560 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:37.507858 16560 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:37.508541 16560 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:37.509373 16560 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.511521 16490 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:37.519035 16559 raft_consensus.cc:1275] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:37.519464 16565 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:37.508040 22312 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 13:08:37.497843 22324 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.534909 16560 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:08:37.535378 16560 pending_rounds.cc:85] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 7
I20260709 13:08:37.535660 16560 pending_rounds.cc:107] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:08:37.535948 16560 raft_consensus.cc:2889] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:37.552192 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 67210us
I20260709 13:08:37.552023 22324 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:37.553030 22324 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.556035 22336 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:37.557327 22336 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:37.566722 22302 log.cc:927] Time spent T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
W20260709 13:08:37.568403 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.570155 22322 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:08:37.571915 22109 consensus_meta.cc:287] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
W20260709 13:08:37.571779 22317 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:08:37.600939 22326 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:37.572289 22109 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 13. Current term is 14.
W20260709 13:08:37.619325 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 63391.9us
W20260709 13:08:37.622402 22315 log.cc:927] Time spent T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:08:37.623456 22299 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:08:37.627246 22252 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:37.627671 16486 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:37.629400 22252 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:37.631265 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:37.641811 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 114037us
I20260709 13:08:37.646375 16491 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:37.647481 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 127256us
I20260709 13:08:37.652030 17179 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:37.657471 22247 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:37.663651 22343 consensus_queue.cc:1048] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:37.666069 22346 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:37.674942 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 117653us
I20260709 13:08:37.654577 22336 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:37.688287 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 171948us
I20260709 13:08:37.689050 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:37.690092 16633 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:08:37.692435 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.747480 22298 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.489s	user 0.001s	sys 0.001s
W20260709 13:08:37.749214 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 50910.3us
I20260709 13:08:37.751240 16491 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:37.694176 22248 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.766320 22339 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.766858 22339 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:37.768365 22337 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:37.687896 22343 consensus_queue.cc:1175] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "035eaa2f12374a81a4df7868a5453d3c" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:08:37.763424 22248 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:37.747388 22266 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
W20260709 13:08:37.814524 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 163357us
I20260709 13:08:37.805809 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:37.804157 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 127079us
I20260709 13:08:37.816440 22339 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:37.814667 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 121136us
W20260709 13:08:37.812022 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 62197.9us
I20260709 13:08:37.818414 22255 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.819347 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:37.823176 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:37.807054 22248 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:37.833079 16566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55194 (request call id 2995) took 1250 ms. Trace:
I20260709 13:08:37.833484 16566 rpcz_store.cc:276] 0709 13:08:36.582979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.632306 (+ 49327us) service_pool.cc:224] Handling call
0709 13:08:36.632593 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.632832 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.632857 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.647288 (+ 14431us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.973541 (+326253us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:36.973576 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.973639 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.747062 (+773423us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b240027e678. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332249c4 00007f0633222acb 00007f06333dddc9 00007f06333dda55 00007f06333dd09d 00007f063600f10e 00007f063602688c 00007f0636025bb6 00007f06360257d8 00007f063602f221
0709 13:08:37.830682 (+ 83620us) raft_consensus.cc:1685] finished
0709 13:08:37.830702 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.832993 (+  2291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":729,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":11244,"spinlock_wait_cycles":48888192,"thread_start_us":290361,"threads_started":1,"wal-append.queue_time_us":459674}
I20260709 13:08:37.818849 22252 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:08:37.840111 22296 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.619s	user 0.002s	sys 0.000s
I20260709 13:08:37.843984 22352 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.844502 22352 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:37.846344 22352 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:37.857465 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:37.858075 16559 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:37.858348 16604 leader_election.cc:400] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18.
I20260709 13:08:37.858652 16604 leader_election.cc:403] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.860551 16605 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:37.869608 16529 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.873963 22160 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:37.875605 22300 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.572s	user 0.000s	sys 0.001s
I20260709 13:08:37.878408 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:37.878961 17181 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.888617 17181 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:37.889848 16632 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:37.892680 16635 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:37.893160 16491 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:37.894147 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:37.894515 16490 raft_consensus.cc:1240] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:37.896183 16638 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:37.896741 16529 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:37.901420 16632 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:08:37.907749 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 79379.1us
I20260709 13:08:37.910339 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:37.911052 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 62900.3us
I20260709 13:08:37.910029 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:37.898744 22139 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 17. Current term is 18.
I20260709 13:08:37.929096 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:37.933691 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:37.922379 22218 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.942153 16485 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:37.943221 16491 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:37.948482 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:37.951572 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 94551.2us
I20260709 13:08:37.959941 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:37.971278 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 90867us
W20260709 13:08:37.976599 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 76268.8us
I20260709 13:08:37.979285 16530 leader_election.cc:400] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:37.958012 22218 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:37.980237 22283 consensus_queue.cc:1048] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:37.981099 22147 consensus_queue.cc:1048] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.966398 22212 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:08:37.992435 22385 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:37.993264 22385 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:37.996122 22368 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.998238 22358 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:08:37.998281 22357 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.998518 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:37.986462 22333 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:08:37.998160 22385 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:37.998584 22376 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:37.981938 22248 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:08:38.020458 22350 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:08:38.024636 22140 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.025132 22140 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.061973 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:38.063746 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 81916.1us
W20260709 13:08:38.071035 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 87843.7us
I20260709 13:08:38.072835 16633 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:08:38.075740 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.081254 16484 raft_consensus.cc:1240] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:08:38.085359 16566 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:38.057682 22350 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.064622 22140 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.095063 16565 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:38.097188 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:38.103200 22393 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.103740 22393 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.104151 22377 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:38.118582 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 53206.6us
I20260709 13:08:38.066376 22218 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.107529 22147 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:08:38.099102 22350 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.187252 22350 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.187734 17184 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:38.184775 22147 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.194857 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:38.220661 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 139128us
W20260709 13:08:38.222270 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 269649us
I20260709 13:08:38.233130 22135 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:08:38.191918 22147 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:38.248009 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.252758 22264 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:38.292063 22147 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.286026 22264 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.294757 22264 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:38.296002 22341 log.cc:927] Time spent T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.391s	user 0.004s	sys 0.000s
I20260709 13:08:38.317451 22264 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.319509 22264 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.321980 22264 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.329609 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2032) took 1108 ms. Trace:
I20260709 13:08:38.329974 16486 rpcz_store.cc:276] 0709 13:08:37.220697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.220864 (+   167us) service_pool.cc:224] Handling call
0709 13:08:38.329430 (+1108566us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540004fbd4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:38.329528 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920086912}
I20260709 13:08:38.342767 22251 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.343283 22251 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.345196 22251 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.346222 22251 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.347713 22211 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.356423 22211 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:38.356858 22383 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:38.383173 22264 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.347895 22284 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:38.388322 22264 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.357373 22383 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:38.358803 22276 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.396054 22211 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.346840 22251 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:38.412180 22399 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:38.383245 22350 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:38.424566 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:38.427524 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:38.429901 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:38.430482 16485 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 19.
I20260709 13:08:38.430642 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:38.431272 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:38.394959 22215 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:08:38.448279 17152 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:38.422451 22284 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.426224 22350 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.423873 22276 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.459244 22390 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.451292 22211 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.440434 22400 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.440860 22376 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:38.462302 22218 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.506819 22264 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.473482 22383 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:38.507007 22410 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:08:38.511698 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:38.468678 22273 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.476254 22108 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.519517 22108 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.521090 22410 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.521440 22108 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.521757 22397 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.522259 22397 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.524115 22397 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.524194 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:38.525885 22350 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:38.528574 22284 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.528499 22276 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.506738 22391 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:38.632004 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 117510us
I20260709 13:08:38.513759 22218 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.475473 22400 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:38.521571 22410 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:38.627456 22276 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.820850 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 231217us
W20260709 13:08:38.827966 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 372266us
W20260709 13:08:38.841550 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 208787us
I20260709 13:08:38.851912 22417 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.852447 22417 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:38.852945 22410 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.828572 22391 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.854035 22410 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:38.854503 22410 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:38.855145 22391 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.867158 22411 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:38.869997 22411 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.865061 22335 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.873458 22400 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:38.875463 22356 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 1.117s	user 0.007s	sys 0.000s
I20260709 13:08:38.873031 22417 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.868058 16633 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:08:38.868422 22251 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.878875 22133 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:38.837001 22276 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.869414 22410 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.885345 22406 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:38.893186 22319 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:38.900501 22163 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.894491 22390 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.885977 22335 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:38.924386 22348 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.166s	user 0.005s	sys 0.000s
W20260709 13:08:38.927191 22353 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 1.170s	user 0.005s	sys 0.003s
I20260709 13:08:38.938187 22335 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.939527 22276 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.918298 22319 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:38.943919 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:38.913899 22163 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:38.944129 16456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.018s	sys 0.006s
I20260709 13:08:38.903116 22133 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:38.946703 16456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.018s	sys 0.006s
W20260709 13:08:38.948263 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 988327us
I20260709 13:08:38.949548 16633 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:38.917543 22218 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.944082 22319 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:38.954653 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:38.955461 16633 raft_consensus.cc:2410] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:38.917826 22390 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:38.961556 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 127613us
I20260709 13:08:38.962443 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:38.954952 22411 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:38.963477 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 491646us
I20260709 13:08:38.953732 22163 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:38.969836 17183 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:38.971017 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:38.971593 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:38.972393 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:38.973438 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:38.974069 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:38.974659 16491 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:38.977614 16482 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:38.954943 22252 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:38.978363 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:38.980468 16635 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:38.980458 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:38.972173 17180 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:38.989426 17152 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:38.988845 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:38.964241 22406 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:38.972841 22349 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.999619 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.000881 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.081372 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.058430 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.020351 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.100970 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.007130 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.056655 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.007709 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.072466 22419 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.054642 22411 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:39.003347 22344 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.141s
I20260709 13:08:38.995931 22418 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:39.005211 22360 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:39.159765 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:39.059229 22408 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:39.163162 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.166977 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.175239 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.007066 22406 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:39.181282 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 69970.6us
I20260709 13:08:39.179767 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:39.162997 22424 log.cc:927] Time spent T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:39.183472 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.183363 22389 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.005861 22349 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:39.183733 22421 log.cc:927] Time spent T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:08:39.196615 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.196890 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.199051 16565 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:39.200090 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.201195 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.204862 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.171389 22418 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:39.213541 16640 raft_consensus.cc:1275] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:39.215399 16639 raft_consensus.cc:1275] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:39.218977 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.224689 16483 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:39.203393 22334 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:39.191414 22211 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.204298 22251 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.203114 22139 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.231829 22133 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.236618 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.242040 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.240096 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.244321 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.177812 22423 consensus_queue.cc:1059] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:08:39.218765 22418 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.182955 22360 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.218979 22165 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:39.229770 22334 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:39.245375 22390 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.261579 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.261699 16491 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:39.204316 22389 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.212960 22419 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.275918 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.260046 22282 raft_consensus.cc:3055] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:39.282042 22406 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.283104 17184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 952) took 1221 ms. Trace:
I20260709 13:08:39.283478 17184 rpcz_store.cc:276] 0709 13:08:38.061626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.061760 (+   134us) service_pool.cc:224] Handling call
0709 13:08:39.282914 (+1221154us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540063d654. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:39.283034 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287700736}
I20260709 13:08:39.277869 22160 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:08:39.191534 22408 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.287153 22408 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:39.287629 22408 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.288141 22408 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.288743 22357 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:39.289178 22357 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.289825 22349 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.291626 22360 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:39.294010 22355 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 1.525s	user 0.004s	sys 0.002s
I20260709 13:08:39.294673 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.295156 17179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48054 (request call id 947) took 1626 ms. Trace:
I20260709 13:08:39.296185 22423 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.295516 17179 rpcz_store.cc:276] 0709 13:08:37.669049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.669183 (+   134us) service_pool.cc:224] Handling call
0709 13:08:37.669869 (+   686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.670186 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.670214 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.676081 (+  5867us) log.cc:844] Serialized 480 byte log entry
0709 13:08:37.696192 (+ 20111us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:37.696226 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.696282 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.283181 (+1586899us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:39.294873 (+ 11692us) raft_consensus.cc:1685] finished
0709 13:08:39.294897 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.295090 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95647104,"thread_start_us":8752,"threads_started":1,"wal-append.queue_time_us":78382}
I20260709 13:08:39.296653 22248 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:39.250269 22139 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.298095 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.298691 22139 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.262475 22334 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.299463 22390 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.300657 22393 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.301280 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.302326 22423 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:39.300606 22408 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:39.303887 22427 log.cc:927] Time spent T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:08:39.247808 22251 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.305792 16530 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.312945 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.313561 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.278503 22282 raft_consensus.cc:740] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:39.318967 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.316722 22409 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:39.320909 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:39.322999 22436 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:08:39.323841 22430 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:39.312341 22234 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:39.316879 22423 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:39.314800 22410 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:39.393667 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 80459.6us
I20260709 13:08:39.313822 16491 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:39.407294 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:39.407274 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:39.407485 22438 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.093s	user 0.005s	sys 0.000s
I20260709 13:08:39.415100 22363 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:39.456583 22431 log.cc:927] Time spent T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:08:39.464457 22437 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:39.465070 22437 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.476747 22340 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.477352 22340 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.421171 22329 raft_consensus.cc:493] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.398182 22234 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.495190 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.503621 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.513113 17187 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:39.467641 22437 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.571645 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.488713 22358 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.486543 22273 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.574242 17182 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:39.495069 22363 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.622936 22363 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:39.624446 22408 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:39.641487 22408 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.643452 22408 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:39.644686 22218 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.645198 22218 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.645596 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.646176 16558 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:39.646759 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.647053 22218 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.647519 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.647810 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.648034 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.648761 22254 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.648922 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.646998 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.649255 22254 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.651136 22254 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.651842 22327 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.652326 22327 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.654249 22327 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.503458 22445 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.656065 22445 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.648556 16562 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
W20260709 13:08:39.661566 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 168453us
I20260709 13:08:39.420398 22282 consensus_queue.cc:260] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.573446 22409 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.589095 22340 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.600718 22396 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.624505 22234 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.491638 22329 raft_consensus.cc:515] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:39.665729 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 271106us
I20260709 13:08:39.664439 22437 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:08:39.684369 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.663914 22408 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:39.669816 22440 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:39.692410 22442 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:08:39.692696 22332 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:39.669678 22389 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.696396 22445 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.624823 22273 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.610183 22358 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:39.687907 22444 log.cc:927] Time spent T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:08:39.682727 22282 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.672601 22409 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.700661 22408 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.691133 22437 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.736660 22451 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.677695 22396 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.730631 22445 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.768056 22445 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.770007 22445 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.770416 22445 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.770815 22445 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.771133 22273 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.745867 22450 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.708904 22332 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.702016 22440 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.748878 22418 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.750255 22334 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.779430 22408 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.780241 22334 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.750841 16389 catalog_manager.cc:5697] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.781100 22437 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:39.781594 22437 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.782030 22437 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.782147 16389 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.751753 22329 leader_election.cc:290] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.754302 22419 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.759536 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.761629 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.777487 22409 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.783725 16389 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:39.793598 16389 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 16 to 17, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.772572 22451 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:39.796895 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.795024 16389 catalog_manager.cc:5697] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 15 to 16, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:39.809268 16389 catalog_manager.cc:5697] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 15, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.812153 16389 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.818531 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:39.784587 22358 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:39.807487 22357 consensus_meta.cc:287] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
I20260709 13:08:39.826295 22251 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.828460 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:39.831096 22443 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.557s	user 0.000s	sys 0.003s
I20260709 13:08:39.840056 22336 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.772073 22450 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.815930 22437 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:39.847293 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b8d067430b24267b8a20f78d68ac412 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer f842280ae2ac4c68b0b7f6c093e27357 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:39.863039 22437 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:39.845126 22264 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.864606 22264 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.866595 22264 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.869444 17153 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.871508 17153 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:39.872848 17153 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.841367 22357 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.874495 17153 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.876631 22357 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.873238 22437 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:08:39.870142 22264 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:08:39.880070 22455 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:39.880761 22264 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:39.881286 22396 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:39.873920 22358 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:39.896675 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.899780 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.896924 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.895171 22455 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:39.897526 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.900425 16566 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:39.897989 22418 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:39.898380 22332 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:39.898536 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.898823 22440 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.899187 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.899596 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.900223 16563 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:39.902697 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.900839 16564 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 8.
I20260709 13:08:39.903158 16561 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:39.904000 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:39.904558 16566 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:39.906050 22451 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:39.906455 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.908169 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.901641 22455 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.912057 22455 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.900029 22358 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.947973 22451 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:39.948513 22451 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:39.950336 22451 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:39.928306 22358 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.981459 22425 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:39.982133 22319 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.981858 22252 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.988919 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.989930 17184 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:39.990515 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:39.995343 16456 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:39.996114 22250 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:40.000809 22396 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.010321 22409 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:40.011206 22396 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.012219 16456 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.013057 22369 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.013350 22422 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:39.987448 22319 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.014601 16456 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:39.987411 22252 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:39.987502 22425 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.015630 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.013839 22422 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.020190 16634 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:40.020573 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.020826 22383 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.021329 22383 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.022325 22422 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.015710 22250 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.036316 22252 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.037139 22396 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.038151 22425 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.039098 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.046067 22319 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.064133 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.065256 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.065795 16633 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:40.069142 16634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35430 (request call id 2089) took 1061 ms. Trace:
I20260709 13:08:40.069487 16634 rpcz_store.cc:276] 0709 13:08:39.007386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.007499 (+   113us) service_pool.cc:224] Handling call
0709 13:08:40.068979 (+1061480us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54002fc954. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:40.069069 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979860864}
I20260709 13:08:40.070325 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.069900 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.074214 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.075778 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.074327 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.078656 16483 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 18: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:40.078433 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:40.078506 22412 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:40.082052 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.082127 22412 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.080297 22418 consensus_queue.cc:1048] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:08:40.087415 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.087934 22332 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.080145 22451 consensus_queue.cc:1048] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:08:40.089044 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.090308 22450 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.073621 22360 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:40.090929 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.092257 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.092837 16635 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 20.
I20260709 13:08:40.093640 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.088842 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.094554 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:40.094892 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.095402 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.089620 16640 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.096688 16637 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:08:40.087976 22439 log.cc:927] Time spent T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.690s	user 0.009s	sys 0.000s
I20260709 13:08:40.098349 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.099028 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.098944 16632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35430 (request call id 2088) took 1093 ms. Trace:
W20260709 13:08:40.102110 22429 log.cc:927] Time spent T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.884s	user 0.003s	sys 0.002s
I20260709 13:08:40.101382 16632 rpcz_store.cc:276] 0709 13:08:39.005444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.005929 (+   485us) service_pool.cc:224] Handling call
0709 13:08:39.106356 (+100427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.167293 (+ 60937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.167322 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.167745 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.237398 (+ 69653us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:39.237437 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.237500 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.087443 (+849943us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:40.098684 (+ 11241us) raft_consensus.cc:1685] finished
0709 13:08:40.098704 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.098878 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32977,"raft.queue_time_us":8388,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8973,"spinlock_wait_cycles":17914240,"thread_start_us":24453,"threads_started":1,"wal-append.queue_time_us":135825}
I20260709 13:08:40.103209 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.104250 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.095590 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:40.104126 22457 log.cc:927] Time spent T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:40.104533 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.106340 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.105075 22360 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.104274 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.106503 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.105073 22422 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.108271 22422 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.108630 22422 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.108997 22450 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.090251 22332 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.110338 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.110731 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.111008 16483 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 17: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:40.111312 22332 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.111505 16490 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:40.108642 22360 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.108812 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.114341 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.115392 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.105530 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.104051 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.108680 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.117458 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.118003 16559 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:40.118223 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.118609 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.119205 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.119339 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.105197 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.119887 16559 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:40.120344 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.120520 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.121220 16490 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:40.121229 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:40.122491 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.093173 22455 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.129484 22273 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:40.127226 22450 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.136673 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2041) took 1621 ms. Trace:
I20260709 13:08:40.138501 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.139192 17180 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.139509 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.149060 16486 rpcz_store.cc:276] 0709 13:08:38.515190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.515357 (+   167us) service_pool.cc:224] Handling call
0709 13:08:38.515627 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.820862 (+305235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.820894 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.834702 (+ 13808us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.961630 (+126928us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:38.983238 (+ 21608us) log.cc:844] Serialized 14 byte log entry
0709 13:08:38.998365 (+ 15127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.136298 (+1137933us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5400050ad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:40.136343 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.136385 (+    42us) raft_consensus.cc:1685] finished
0709 13:08:40.136488 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.136599 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":283404,"prepare.queue_time_us":20384,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":302584,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":18719,"spinlock_wait_cycles":64007552,"thread_start_us":123181,"threads_started":1,"wal-append.queue_time_us":156687}
I20260709 13:08:40.150619 16489 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:40.151098 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.151258 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.151810 16559 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 19.
I20260709 13:08:40.152648 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.152889 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.154000 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.154974 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.155172 17188 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:40.156484 16557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 3411) took 1203 ms. Trace:
I20260709 13:08:40.142884 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:40.145002 17183 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:40.146198 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.146714 17179 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:40.147569 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.164408 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.166141 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.156828 16557 rpcz_store.cc:276] 0709 13:08:38.952571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.952679 (+   108us) service_pool.cc:224] Handling call
0709 13:08:38.952943 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.958058 (+  5115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.958085 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.958500 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.040635 (+ 82135us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:39.040678 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.040749 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.101607 (+1060858us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332c4c85 00007f06332c56a2 00007f06360371db 00007f0636032aaf 00007f063602686e 00007f0636025bb6 00007f06360257d8 00007f063602f221 00007f063602f1d9 00007f063602f169
0709 13:08:40.140211 (+ 38604us) raft_consensus.cc:1685] finished
0709 13:08:40.140229 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.156412 (+ 16183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4781,"raft.queue_time_us":8655,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2635,"spinlock_wait_cycles":40668032,"thread_start_us":81822,"threads_started":1,"wal-append.queue_time_us":219147}
I20260709 13:08:40.168596 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.089672 22412 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.165494 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:40.179458 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.179435 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.181370 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.182000 16557 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 20.
I20260709 13:08:40.179834 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:40.186218 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44527.9us
I20260709 13:08:40.186234 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.188725 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:40.189431 17187 raft_consensus.cc:1240] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:40.189383 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.190682 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.191229 16557 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:40.192044 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.193946 16455 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.194837 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.193029 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1670d7fa8dd74ffb9fc8584e273d75da" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.066562 22358 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.193897 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.200708 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.156077 22451 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.156211 22236 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:40.202596 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.200788 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.203508 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.180208 22418 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:40.204599 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.206668 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.168704 22115 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:40.179495 22250 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:40.180663 22453 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.214092 16603 leader_election.cc:304] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.217139 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:40.210075 22357 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.216225 22375 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.225551 22454 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:40.225953 22454 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.226178 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.226621 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.226998 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:40.227430 22135 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.227653 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.210244 22336 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:40.228897 22460 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:08:40.229419 22454 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.154844 22411 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:08:40.234205 17182 raft_consensus.cc:1240] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:40.234728 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.198477 22273 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.237314 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.238660 17153 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.240324 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.170145 22422 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.241541 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.212468 22332 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.231052 17179 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:40.179168 22440 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:08:40.258893 22437 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.259770 17153 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.244352 16603 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.206349 22236 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.207820 22418 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.207577 22318 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.211396 22450 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.267168 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.210508 22115 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.239916 22135 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:40.268728 22135 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.269207 22440 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:40.269577 22440 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:40.270339 22440 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.271013 22418 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:40.271435 22440 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.272122 22236 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.273134 16563 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:40.275939 22234 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.278056 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.279099 22264 raft_consensus.cc:2749] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.278008 22135 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.279736 22264 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:40.281003 22264 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.281343 22264 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:40.281615 22135 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.285429 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.286334 22445 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.232906 22453 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.287662 22453 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.290398 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.261767 22451 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:40.291111 22451 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:40.230036 22368 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:40.280483 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:40.272310 22462 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:08:40.297741 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.299865 22445 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.300256 22450 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.301909 22236 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.243076 22273 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.256356 22415 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.308368 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.261413 22409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41626 (request call id 11) took 4100 ms. Trace:
I20260709 13:08:40.289769 22115 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:40.262338 22332 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.314481 16560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55186 (request call id 3412) took 1357 ms. Trace:
I20260709 13:08:40.298022 22451 raft_consensus.cc:3060] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:40.320217 22450 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.322072 22422 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.305696 22368 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.326349 16560 rpcz_store.cc:276] 0709 13:08:38.956807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.956926 (+   119us) service_pool.cc:224] Handling call
0709 13:08:38.957205 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.963695 (+  6490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.963723 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.964127 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.202337 (+238210us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:39.202374 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.304369 (+1101995us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b540032aad4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:40.304418 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.304473 (+    55us) raft_consensus.cc:1685] finished
0709 13:08:40.304487 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.314421 (+  9934us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2672,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":18682,"spinlock_wait_cycles":14231808,"thread_start_us":207739,"threads_started":1,"wal-append.queue_time_us":291550}
I20260709 13:08:40.310211 22445 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.314723 22437 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.343765 22236 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:40.324470 22273 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.330149 22332 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.324652 22415 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.356527 22415 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.357796 16631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35424 (request call id 3340) took 1930 ms. Trace:
I20260709 13:08:40.358162 16631 rpcz_store.cc:276] 0709 13:08:38.427762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.427929 (+   167us) service_pool.cc:224] Handling call
0709 13:08:38.437757 (+  9828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.438107 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.438136 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.017775 (+1579639us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b2c00128e18. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d94372 00007f06364c6a01 00007f063648b43a 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2
0709 13:08:40.018058 (+   283us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.115664 (+ 97606us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:40.115697 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.115756 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.352169 (+236413us) raft_consensus.cc:1685] finished
0709 13:08:40.352190 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.357736 (+  5546us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1930,"spinlock_wait_cycles":4400768,"thread_start_us":95845,"threads_started":1,"wal-append.queue_time_us":294743}
I20260709 13:08:40.364202 22455 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.337157 22368 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:40.372426 22428 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 1.147s	user 0.000s	sys 0.008s
I20260709 13:08:40.376422 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.376871 22454 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.378921 22454 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.379938 22358 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.347123 22445 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.380648 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.324862 22409 rpcz_store.cc:276] 0709 13:08:36.136322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.136608 (+   286us) service_pool.cc:224] Handling call
0709 13:08:36.469058 (+332450us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54003cec20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636408520 00007f0636491b42 00007f0636490800 00007f06364899fa 00007f063b4514c9 00007f06349cdc54 00007f06349cdbe2 00007f06349cdb11 00007f06349cda8c 00007f06349ccd42
0709 13:08:36.566485 (+ 97427us) log.cc:844] Serialized 480 byte log entry
0709 13:08:37.273604 (+707119us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b54003cec20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636404142 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69 00007f06363ebc31 00007f06363eadfd 000000000038f354 000000000038f199 00007f063339e475
0709 13:08:37.644227 (+370623us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b54003cec20. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063640bb26 00007f063640549a 00007f0636404714 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69 00007f06363ebc31 00007f06363eadfd 000000000038f354
0709 13:08:37.839839 (+195612us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b240027e678. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f06332249c4 00007f0633222acb 00007f06333dddc9 00007f06333dda55 00007f06333dd09d 00007f063600f10e 00007f063602688c 00007f0636025bb6 00007f06360257d8 00007f063602f221
0709 13:08:40.236759 (+2396920us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42571,"raft.queue_time_us":55946,"raft.run_cpu_time_us":12408,"raft.run_wall_time_us":901627,"spinlock_wait_cycles":229808512,"thread_start_us":402234,"threads_started":1,"wal-append.queue_time_us":531756,"wal-append.run_cpu_time_us":6005,"wal-append.run_wall_time_us":1733854}
I20260709 13:08:40.382038 22383 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:40.384166 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca9e6e3a4a404a9893a40afed3d0179f with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:40.334204 22357 raft_consensus.cc:2749] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.380151 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.398459 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.403326 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.346802 22437 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.409231 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.412793 16564 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:40.413977 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:40.411172 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.423910 16637 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
W20260709 13:08:40.426062 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65033.6us
I20260709 13:08:40.432221 16482 raft_consensus.cc:1240] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.435235 16639 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:40.436825 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:40.416330 22437 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.438375 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.407408 22352 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:40.465155 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.420460 22418 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.441432 22383 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.443044 22140 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:40.481083 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.483758 16490 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.448969 22276 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.482892 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.488607 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.489214 16488 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:40.498890 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.499202 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.500329 16484 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:40.501133 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.501863 22115 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:40.502810 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.504338 16483 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 20: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:40.505545 22115 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.490892 22451 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.506673 22445 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.507880 22451 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:40.522864 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.523622 16484 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 13: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:40.526966 16488 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:40.527724 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.484567 22147 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.484054 22391 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.570060 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.571054 22273 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.571380 22377 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.515609 22415 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.571843 22139 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:40.564908 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:40.511305 22368 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.564631 17182 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:40.574409 16489 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 21: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:40.571498 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.575192 22368 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.575908 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:40.576625 17187 raft_consensus.cc:2393] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 17: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:40.480825 22266 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.577672 22266 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:40.568570 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 43925.6us
I20260709 13:08:40.583631 16488 raft_consensus.cc:2393] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 18: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:40.568825 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:40.585040 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 51467.9us
I20260709 13:08:40.550554 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.531906 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.537590 16490 raft_consensus.cc:2468] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 11.
I20260709 13:08:40.548691 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.588438 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.588725 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.534466 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:40.589797 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 282636us
I20260709 13:08:40.592375 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.591693 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:40.568262 22470 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:08:40.595491 16490 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:40.501886 22327 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:08:40.579630 22266 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:40.595831 16488 raft_consensus.cc:1240] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:40.614780 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 76868.5us
I20260709 13:08:40.618229 17152 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.570015 22445 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.573696 22415 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.624485 17188 raft_consensus.cc:1240] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.499336 22264 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.607931 22454 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.534930 22140 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:40.636181 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.494271 22276 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.624940 22266 raft_consensus.cc:2804] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:40.589274 22391 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.607194 22147 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.655006 22139 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:40.654601 22155 consensus_queue.cc:1059] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:08:40.653218 22234 consensus_queue.cc:1059] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:08:40.685017 22445 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.685859 22266 raft_consensus.cc:697] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
W20260709 13:08:40.685647 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58008.2us
I20260709 13:08:40.690618 22418 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.692348 22264 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.697786 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.641695 22336 consensus_queue.cc:1059] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:08:40.731513 17188 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:40.732745 22336 raft_consensus.cc:3055] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:40.733134 22336 raft_consensus.cc:740] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:40.733968 22336 consensus_queue.cc:260] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.735399 22234 raft_consensus.cc:3055] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:40.735811 22234 raft_consensus.cc:740] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:40.736372 22352 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.736704 22234 consensus_queue.cc:260] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.737147 22486 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:40.738131 22234 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.738333 22378 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:40.736928 22352 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.738808 22378 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:40.739759 22378 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.740480 22352 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:40.738796 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.742820 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.742965 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:40.742738 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 116250us
I20260709 13:08:40.652236 22160 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:08:40.743634 16455 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.745353 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.746726 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.747757 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.741103 22378 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.746351 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.749249 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.741437 22264 consensus_queue.cc:1059] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:08:40.749854 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.750998 22391 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.700426 22445 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.752561 22266 consensus_queue.cc:237] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:40.753661 22471 log.cc:927] Time spent T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.286s	user 0.000s	sys 0.003s
I20260709 13:08:40.753518 22453 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.754011 22211 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:40.754374 22160 raft_consensus.cc:3055] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:40.728474 22319 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:40.690621 22332 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.784751 22160 raft_consensus.cc:740] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:40.789793 22332 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.791476 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:40.792096 17188 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.802268 17186 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:40.805997 22276 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:40.808223 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 68463.9us
I20260709 13:08:40.808243 22252 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:40.812232 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.800647 22273 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:40.813097 22334 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:40.813459 22334 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:40.814189 22334 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.814567 22236 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.815137 22334 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.816150 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.816706 16484 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.821357 22445 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.823086 16636 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:40.769663 22282 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:40.770866 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.771703 22422 consensus_queue.cc:1059] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:40.824445 22474 log.cc:927] Time spent T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:08:40.772285 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.824882 22453 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.778194 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:40.825353 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 53140.3us
I20260709 13:08:40.815117 22236 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.826412 22147 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.826424 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.827184 22361 raft_consensus.cc:3055] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:40.827631 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.825316 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:40.829341 22160 consensus_queue.cc:260] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.830627 22160 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.815083 22358 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:40.832055 22358 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:40.784528 22264 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.727314 22140 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.832283 17153 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.801769 22369 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.832995 22369 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.821229 22351 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:40.823633 22383 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.831491 22282 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:40.834762 17153 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.836247 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.836777 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.835429 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:40.842666 22409 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:40.843186 22409 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.844595 22264 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.845582 22409 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.846524 22445 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.842330 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.847180 22264 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.848843 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.849659 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.848958 22135 raft_consensus.cc:493] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.825569 22400 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:40.852205 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.859318 22400 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.859953 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.860893 22369 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.860894 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.862007 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.862624 22319 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:40.863102 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.852670 16485 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:40.864297 16490 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:40.865213 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.866189 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:40.853293 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.858810 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.867709 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.871160 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.872308 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.873294 16640 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:40.853719 17188 raft_consensus.cc:2468] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:40.852113 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.762025 22484 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:40.884882 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:40.880111 16484 raft_consensus.cc:2468] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:40.892071 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.892087 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.782826 16560 raft_consensus.cc:2468] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:40.893410 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.893335 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:40.858173 22273 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.858526 22351 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:40.858793 22366 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.827572 22361 raft_consensus.cc:740] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:40.894825 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:40.763228 16529 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.847671 22264 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.827697 22236 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:40.886242 16603 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:40.827530 22147 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.857683 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.842144 22453 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.898108 16483 raft_consensus.cc:1240] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:40.850443 22383 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.859716 22400 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.900159 22445 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.899734 22211 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:40.905977 16606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.901065 22109 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.908936 17153 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
W20260709 13:08:40.909368 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 51773us
I20260709 13:08:40.902698 22147 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:40.895839 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 132664us
I20260709 13:08:40.899124 17152 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.902439 22377 raft_consensus.cc:2804] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:40.899704 22351 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:40.869117 22135 raft_consensus.cc:515] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.901381 22273 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:40.925928 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.926821 16560 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:40.910203 22250 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.918821 16529 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.922758 17152 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.923698 16454 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.931612 17179 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:40.931849 16529 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.902110 22437 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.936388 17152 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.947387 16529 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.903226 22366 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:40.921504 22147 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.949828 16529 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.952270 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.924365 22477 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.925473 22453 raft_consensus.cc:2804] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:40.949857 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.952773 16529 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.956864 17152 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:40.924278 22109 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.962271 16454 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:40.932564 22377 raft_consensus.cc:697] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:40.963084 16491 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:40.963430 16529 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:40.949666 22418 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.956588 22488 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.949514 22409 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.966784 16529 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.949939 22485 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.954881 22445 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.953152 22211 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.966313 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.966391 22136 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:40.971321 22422 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.972657 22109 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:40.972398 22377 consensus_queue.cc:237] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.954211 22361 consensus_queue.cc:260] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.978719 16560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:40.912844 22358 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.956189 22391 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.960341 22273 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.970404 22453 raft_consensus.cc:697] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:40.980978 22337 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.993098 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.994738 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:40.984813 22136 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:40.966953 22218 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.968869 22415 raft_consensus.cc:2804] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:40.968482 22484 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.004084 22415 raft_consensus.cc:697] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:41.004997 22415 consensus_queue.cc:237] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.005518 22366 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:40.990765 16560 raft_consensus.cc:606] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:40.996009 22109 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.987227 22351 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.989638 22266 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:41.009214 22351 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.009039 22266 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.007529 22147 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.011086 22266 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.012010 22147 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.001332 16454 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.012609 22361 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:41.033150 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.033672 16454 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.033959 22383 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.013116 16560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:41.013778 22453 consensus_queue.cc:237] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:40.992776 22115 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.033090 16487 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:41.000643 22336 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.003104 22136 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.036973 22369 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.994578 22337 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:41.040259 22337 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.016196 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.024123 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:41.047541 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.048586 22422 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.024689 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:41.047430 22396 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:40.986349 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.024689 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.051932 16636 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 14: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:41.028246 22319 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:41.035699 16560 raft_consensus.cc:606] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:41.055435 22400 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.056646 22136 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.013686 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.057628 22400 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.060622 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.075896 22136 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:41.021311 22437 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.065188 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:41.083278 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:41.066740 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:41.084504 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:41.069285 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 139956us
I20260709 13:08:41.069403 16565 raft_consensus.cc:1240] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:41.070406 22337 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.087770 22400 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:41.061456 16604 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.078883 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.089663 22337 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:41.090392 22454 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.079576 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:41.079727 17186 raft_consensus.cc:1240] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:41.093391 16456 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.093556 22264 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:41.094156 22337 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.094939 17183 raft_consensus.cc:1240] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:41.094165 22264 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.097285 22264 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.081265 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:41.076409 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:41.102572 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.102701 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:41.103245 17179 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:41.105044 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:41.107738 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 46352.5us
I20260709 13:08:41.108891 22276 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.110420 22155 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.111181 22155 consensus_queue.cc:1243] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:41.111634 22155 consensus_queue.cc:1059] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:41.112574 22155 raft_consensus.cc:3055] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:41.112892 22155 raft_consensus.cc:740] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.113703 22155 consensus_queue.cc:260] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.114923 22155 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.122885 16604 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.123804 22352 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.125845 22139 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:41.126979 22486 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:41.127346 22486 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.128213 22486 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.129952 22486 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.107414 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.111837 22276 raft_consensus.cc:3055] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:41.134102 22276 raft_consensus.cc:740] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.134449 16489 raft_consensus.cc:2955] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:41.135205 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.136907 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.138176 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.139243 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.139786 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.106055 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:41.144155 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:41.147779 17152 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:40.995406 22254 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:08:41.149689 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.150454 16486 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:41.151046 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:41.153596 17179 raft_consensus.cc:1240] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:41.153847 22422 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:41.154508 16560 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:41.158763 22135 leader_election.cc:290] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.159529 22375 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.165174 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:41.183735 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:41.167701 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.183568 16529 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:41.169919 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.192595 16604 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.190692 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.187100 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:41.159968 22437 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:41.187539 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a89d28915e9486ba50f8fdafb99a037" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.207190 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.162303 22282 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:41.162070 22319 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.149492 22377 consensus_queue.cc:1059] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:08:41.238860 17186 raft_consensus.cc:1240] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:41.162213 22107 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:08:41.240334 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.185438 22351 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:41.223081 22250 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.245144 17179 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:41.208163 22383 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:41.283615 16455 leader_election.cc:304] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.207890 22336 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:41.224850 22453 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:41.319064 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 78788.4us
I20260709 13:08:41.245390 22396 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.240352 22234 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:41.329722 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 137200us
I20260709 13:08:41.239670 22361 consensus_queue.cc:1059] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:08:41.325047 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.241915 22425 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.240629 22282 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:41.360169 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 153133us
I20260709 13:08:41.325784 22334 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.365706 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:41.368197 22112 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.368731 22334 consensus_queue.cc:1059] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:41.368367 16488 raft_consensus.cc:606] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
W20260709 13:08:41.369683 22505 log.cc:927] Time spent T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:08:41.372552 22107 raft_consensus.cc:3055] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:41.372897 22107 raft_consensus.cc:740] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.373613 22107 consensus_queue.cc:260] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.374748 22107 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:41.403769 16639 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:41.405454 22234 consensus_queue.cc:1059] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:41.406631 22375 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:41.406999 22375 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.407842 22375 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.408401 22319 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.409502 22375 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:41.328366 22488 raft_consensus.cc:2749] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.444491 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:41.444672 16604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.330299 22254 consensus_queue.cc:1059] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.108s
I20260709 13:08:41.447844 16566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da035835f764425db56e9649db0a0bcc"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:41.448371 16566 raft_consensus.cc:606] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.448280 22332 raft_consensus.cc:3055] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:41.449944 22332 raft_consensus.cc:740] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.450688 22332 consensus_queue.cc:260] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.451923 22332 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.453724 16489 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:41.455071 22254 raft_consensus.cc:3055] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:41.455474 22254 raft_consensus.cc:740] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:41.456188 22254 consensus_queue.cc:260] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.457317 22254 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:41.457726 17186 raft_consensus.cc:1240] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:41.459088 22510 consensus_queue.cc:1059] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.459923 22510 consensus_queue.cc:1243] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:08:41.463901 22411 consensus_queue.cc:1175] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f842280ae2ac4c68b0b7f6c093e27357" responder_term: 20 status { last_received { term: 20 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 20 index: 14 } }
I20260709 13:08:41.323668 22250 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.482426 22250 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:41.483636 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 300132us
I20260709 13:08:41.476125 16566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:41.485157 16566 raft_consensus.cc:606] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:41.485473 16566 raft_consensus.cc:614] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:41.477456 22358 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.479204 22276 consensus_queue.cc:260] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.471298 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:41.486366 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:41.487604 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:41.488886 16487 raft_consensus.cc:1240] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:41.493001 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:41.494174 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:41.494899 16559 raft_consensus.cc:2410] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:08:41.492458 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:41.497644 16456 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:41.488950 22139 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:41.502810 22155 consensus_queue.cc:1059] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:08:41.499544 22319 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:41.505784 22276 raft_consensus.cc:3060] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.514930 22514 raft_consensus.cc:993] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:41.506637 22139 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.515462 22396 raft_consensus.cc:1081] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:41.506290 22147 consensus_queue.cc:1059] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:41.521083 17187 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:41.522096 22282 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.527976 16456 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:41.529780 22250 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.529621 22139 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.523427 22147 consensus_queue.cc:1243] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer 16b5b367990f4b5c862484bdec0b9226 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:41.538965 22368 raft_consensus.cc:3055] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:41.539330 22368 raft_consensus.cc:740] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:41.524363 22400 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:41.554912 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.562748 16636 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:41.565699 17186 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:08:41.581642 22502 log.cc:927] Time spent T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:08:41.570063 22234 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 13:08:41.583176 22506 log.cc:927] Time spent T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:08:41.567390 22352 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.608763 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:41.618642 16633 raft_consensus.cc:1240] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:41.620888 22264 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.636281 22211 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:41.640817 22378 raft_consensus.cc:3055] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:41.641202 22378 raft_consensus.cc:740] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.642066 22378 consensus_queue.cc:260] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.643534 22378 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.654387 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.609709 22368 consensus_queue.cc:260] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.656611 22422 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:41.657316 22409 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:41.657110 22422 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.659647 22368 raft_consensus.cc:3060] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.655733 16530 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.663306 22282 raft_consensus.cc:3055] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:41.663681 22282 raft_consensus.cc:740] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:41.664393 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.664405 22282 consensus_queue.cc:260] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.665117 22425 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:41.665702 22282 raft_consensus.cc:3060] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.665972 22218 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.668102 22422 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:41.665645 22425 consensus_queue.cc:1175] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "359213375db14f3d874c121993f90d76" responder_term: 15 status { last_received { term: 12 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: [14.11-14.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:41.681951 16488 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:41.682873 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.683955 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.688344 16489 raft_consensus.cc:1240] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:41.693514 16632 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:41.697613 16559 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:41.697955 16559 pending_rounds.cc:85] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 10
I20260709 13:08:41.698163 16559 pending_rounds.cc:107] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:41.698385 16559 raft_consensus.cc:2889] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.699229 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.703228 16489 raft_consensus.cc:1275] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:41.705089 16491 raft_consensus.cc:1275] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:41.705914 16489 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:41.708770 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:41.711752 16638 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 17: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:41.713020 16560 raft_consensus.cc:1240] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:41.714258 16560 raft_consensus.cc:1275] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:41.713492 16489 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:41.714881 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.719769 17187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48054
I20260709 13:08:41.720358 17187 raft_consensus.cc:493] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.724524 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:41.725829 17188 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:41.726869 17187 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.729391 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 284) took 4683 ms. Trace:
I20260709 13:08:41.718317 16388 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.731582 16388 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 15 to 16, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.733155 16388 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.737905 16388 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.739470 17187 raft_consensus.cc:515] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.729182 22358 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:41.744344 17181 raft_consensus.cc:1240] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:41.752689 16487 raft_consensus.cc:1275] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:41.718916 22453 consensus_queue.cc:1048] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:08:41.718847 22282 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:41.764348 22400 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:41.764837 22400 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.755394 22358 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.755436 22351 consensus_queue.cc:1059] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:08:41.767961 22351 raft_consensus.cc:3055] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:41.768281 22351 raft_consensus.cc:740] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:41.768990 22351 consensus_queue.cc:260] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.770197 22351 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.771046 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.771991 22451 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:41.772954 22484 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.767966 22437 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:08:41.775921 22282 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:41.776290 22282 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:41.776579 22264 consensus_queue.cc:1048] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:41.776989 22282 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.778180 22282 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.779165 22400 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:41.729743 16389 rpcz_store.cc:276] 0709 13:08:37.034135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.034388 (+   253us) service_pool.cc:224] Handling call
0709 13:08:41.717510 (+4683122us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:39.969303 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:39.969822 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:39.969854 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:39.969870 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:39.970613 (+   743us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:39.970679 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:39.970708 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:08:39.971228 (+   520us) tablet.cc:701] Row locks acquired
0709 13:08:39.971246 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:39.971379 (+   133us) write_op.cc:270] Start()
0709 13:08:39.971484 (+   105us) write_op.cc:276] Timestamp: P: 1783602519971332 usec, L: 0
0709 13:08:39.971504 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:40.003244 (+ 31740us) log.cc:844] Serialized 2847 byte log entry
0709 13:08:40.564399 (+561155us) op_driver.cc:464] REPLICATION: finished
0709 13:08:40.730135 (+165736us) write_op.cc:301] APPLY: starting
0709 13:08:40.730220 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:41.057975 (+327755us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18004537c0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f06361ca0ec 00007f0636216c0a 00007f06362164f7 00007f0636216490 00007f06361cdf48 00007f0639ee21bb 00007f0639ee2532 00007f0639f29b93 00007f0639dd6de3
0709 13:08:41.058607 (+   632us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:41.058647 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:41.259000 (+200353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:41.259220 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:08:41.259268 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:41.259505 (+   237us) log.cc:844] Serialized 73 byte log entry
0709 13:08:41.259671 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.271695 (+ 12024us) write_op.cc:454] Released schema lock
0709 13:08:41.283341 (+ 11646us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:41.361411 (+ 78070us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.363678 (+  2267us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":165467,"apply.run_cpu_time_us":15966,"apply.run_wall_time_us":598804,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":151562,"prepare.run_cpu_time_us":12103,"prepare.run_wall_time_us":81678,"raft.queue_time_us":261656,"raft.run_cpu_time_us":32429,"raft.run_wall_time_us":258090,"replication_time_us":592713,"spinlock_wait_cycles":4493696,"thread_start_us":448813,"threads_started":4,"wal-append.queue_time_us":164804}]]}
I20260709 13:08:41.780581 16529 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:41.786573 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:41.787143 16631 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:41.795311 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:41.796029 17183 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:41.773340 22396 raft_consensus.cc:993] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:41.788832 22218 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:41.781371 22512 consensus_queue.cc:1175] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "359213375db14f3d874c121993f90d76" responder_term: 14 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:41.817780 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:41.773386 22451 consensus_queue.cc:1048] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:41.817757 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:41.818818 22511 raft_consensus.cc:1081] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Signalling peer f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:41.812824 22514 consensus_queue.cc:1059] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:08:41.822924 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 75550.7us
I20260709 13:08:41.825554 16631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da035835f764425db56e9649db0a0bcc"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:35430
I20260709 13:08:41.826066 16631 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.826424 16631 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.835103 16631 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.807941 22485 consensus_queue.cc:1059] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:08:41.814262 22218 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:41.810742 22352 consensus_queue.cc:1048] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:08:41.843513 17187 leader_election.cc:290] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.847211 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:41.852113 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16de3b472e2a4b62908fb29412b52f14" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:41.852880 22489 raft_consensus.cc:993] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:41.853345 22489 raft_consensus.cc:1081] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:41.855428 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.856624 17152 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.857338 22264 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:41.862754 22358 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:41.864562 22147 raft_consensus.cc:3055] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:41.864945 22147 raft_consensus.cc:740] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:41.865691 22147 consensus_queue.cc:260] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.847747 16636 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.866765 22147 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.867924 22378 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:41.868402 22378 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.869959 16559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:41.870455 16559 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.870775 16559 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.872063 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:41.875874 22378 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:41.834699 22422 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:41.884261 22422 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:41.884677 22422 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.842276 22218 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:41.891983 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 54192.1us
I20260709 13:08:41.895514 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:41.896692 16604 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:41.887765 16636 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:41.901911 17152 leader_election.cc:304] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:41.888890 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:41.903337 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:41.903689 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:41.904014 16558 raft_consensus.cc:3055] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:41.904311 16558 raft_consensus.cc:740] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:41.904960 16487 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.905254 16558 consensus_queue.cc:260] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.909277 16558 raft_consensus.cc:3060] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.894148 16559 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.910414 16566 raft_consensus.cc:3055] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:41.912994 16566 raft_consensus.cc:740] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
W20260709 13:08:41.907338 22519 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.003s
I20260709 13:08:41.908175 22451 raft_consensus.cc:2804] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:41.904300 22517 log.cc:927] Time spent T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.063s	user 0.000s	sys 0.003s
I20260709 13:08:41.902784 22378 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:41.917181 16566 consensus_queue.cc:260] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.918331 16566 raft_consensus.cc:3060] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.919888 22451 raft_consensus.cc:697] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:41.920805 22451 consensus_queue.cc:237] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.926499 22422 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.942433 16566 raft_consensus.cc:2468] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
W20260709 13:08:41.942921 22425 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:41.949916 16558 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:41.922510 22218 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:41.977195 22218 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:41.955492 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:41.979151 16488 raft_consensus.cc:3055] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:41.979465 16488 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:41.980126 16488 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:41.981148 16488 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.985281 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:41.986017 16633 raft_consensus.cc:2393] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 17: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:41.957517 16631 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:42.000710 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:41.957950 16559 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:41.958564 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:42.011564 16636 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:42.012172 22422 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.013568 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:42.014266 17184 raft_consensus.cc:2393] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:42.017999 16636 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:42.019089 16530 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:41.956526 16487 raft_consensus.cc:2468] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:41.970228 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:41.967540 22351 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.020268 22218 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:42.020766 22218 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:42.020606 22351 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.007587 17187 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:42.023685 16529 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:42.021860 16604 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:41.999567 16488 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:42.035779 16632 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:42.036778 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:42.037330 22378 raft_consensus.cc:2804] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:42.037817 22378 raft_consensus.cc:697] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:42.038650 22378 consensus_queue.cc:237] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:42.039265 22351 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.039721 22396 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:42.040242 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.040848 17187 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:42.042126 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.043346 16487 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:42.051772 22514 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:42.053759 22514 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:42.054580 22514 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.044359 22396 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:42.044829 22361 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:42.039551 22218 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:42.052003 22234 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:08:42.086676 22234 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.087172 22234 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.056507 22396 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.092406 16559 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:08:42.093575 16559 pending_rounds.cc:85] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 7
I20260709 13:08:42.093796 16559 pending_rounds.cc:107] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:42.094180 16559 raft_consensus.cc:2889] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.094902 22485 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.061538 22361 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.095556 22351 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:42.096078 22361 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.106999 22234 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.108732 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.095353 22485 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.111334 22485 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.112771 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.113058 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:42.113636 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:42.113706 16482 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:42.113384 17181 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:42.115880 16529 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:42.119899 22485 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:42.120322 22485 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.120712 22485 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.132745 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.133394 16558 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:42.109439 17184 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:42.159538 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:42.160414 22351 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:42.160812 22351 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.169628 22437 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.170236 22437 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.172343 22437 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:42.174062 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:42.175660 16483 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:42.177791 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.178401 16560 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:42.176750 17152 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:42.161123 22351 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.206955 22451 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:42.222752 22451 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.242012 22451 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.283329 22451 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.299726 22351 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.312428 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:42.252508 22361 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.312008 22485 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.331069 22361 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.332036 22485 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.333539 22451 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:42.328023 22351 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.338923 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:42.339469 16483 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.340180 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:42.340759 16489 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.344064 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:42.344570 16558 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.345238 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:42.346267 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:42.346788 17184 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.348110 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:42.348639 17187 raft_consensus.cc:3060] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.356168 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5cfc5d25214ed5a2298f98f0b9a0a9" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:42.356359 16558 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:42.356696 17181 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.345791 16562 raft_consensus.cc:3060] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.358714 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:42.363955 16489 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:42.365016 17187 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:42.369972 16483 raft_consensus.cc:2468] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:42.372505 16530 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:42.375403 17181 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:42.364135 17184 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:42.378057 16603 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.380268 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:42.379616 22351 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.382620 22361 raft_consensus.cc:2804] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:42.389379 22351 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.379925 22485 raft_consensus.cc:2804] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:42.390514 22485 raft_consensus.cc:697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 18 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:42.396275 22352 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.397926 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.401847 22351 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.391561 22276 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:42.403362 22276 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:42.393743 22361 raft_consensus.cc:697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:42.404378 22276 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.404572 22361 consensus_queue.cc:237] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.396723 22352 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.403278 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.409300 17184 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:42.382632 22264 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:42.414500 22264 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:42.392107 22485 consensus_queue.cc:237] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.439023 16603 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:42.440670 16560 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:42.441073 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.437012 22264 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.442919 22415 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:42.448025 22352 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.449023 22351 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:42.450093 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.452176 17184 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:42.450325 16631 raft_consensus.cc:1275] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:42.454157 22451 consensus_queue.cc:1048] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:42.454550 16562 raft_consensus.cc:2468] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:42.455284 16603 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:42.456209 22378 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:42.456638 22378 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.457007 22378 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.456369 22352 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.462438 22352 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.464430 22352 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.467303 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.467901 17184 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:42.468083 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.470018 22351 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.479725 16603 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:42.483979 22351 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.490818 22352 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:42.495441 22485 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:42.507513 17184 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:42.498003 22352 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.487418 22378 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.515954 22415 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.516466 22415 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.520483 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.519821 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:42.525444 16489 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:42.527477 22351 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.521293 22409 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:08:42.530390 22425 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:42.511586 22352 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.545554 22425 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.534361 22147 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:42.523228 22485 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:42.547575 22425 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.548025 22147 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.548703 22276 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:42.549945 22147 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.550740 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:42.551218 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:42.550128 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:42.552289 16489 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:42.553478 16636 raft_consensus.cc:2368] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:42.553905 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.554600 17181 raft_consensus.cc:2393] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:42.555330 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.556010 17187 raft_consensus.cc:2393] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:42.556484 16530 leader_election.cc:400] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:42.556780 16530 leader_election.cc:403] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:42.558537 22351 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.559376 22485 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:42.560117 22485 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.560312 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:42.560883 17187 raft_consensus.cc:3060] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.565071 22415 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:42.552032 16386 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 14 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.567471 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ada08378e34050bfc80a9f6893b014" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:42.572444 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:42.573158 16636 raft_consensus.cc:2393] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:42.574218 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:42.574980 16636 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:42.575979 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:42.582027 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 289) took 2240 ms. Trace:
I20260709 13:08:42.583133 17187 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:42.584086 16386 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 15, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 15 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.579876 22358 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:42.594551 22358 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.595481 16566 raft_consensus.cc:1275] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:42.595916 22358 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.597124 22378 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.605741 16603 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.605695 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:42.608856 22351 consensus_queue.cc:1048] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:42.609759 22147 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:42.610095 22351 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.610783 22361 raft_consensus.cc:2804] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:42.611253 22361 raft_consensus.cc:697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:42.612138 22361 consensus_queue.cc:237] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.610582 22351 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.615955 22147 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.618119 22147 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.619390 22351 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.607592 16386 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 18 to 20, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 20 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.628481 16386 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 17, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 17 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.582427 16388 rpcz_store.cc:276] 0709 13:08:40.341240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.341364 (+   124us) service_pool.cc:224] Handling call
0709 13:08:40.408259 (+ 66895us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b5400002490. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0633226db1 00007f0633367640 00007f063c23eb76 00007f063c348c3e 00007f063a8092a4 00007f063a809232 00007f063a809161 00007f063a8090dc 00007f063a808392 00007f06347c648c 00007f06347c58c6
0709 13:08:42.581972 (+2173713us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.059231 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.064210 (+  4979us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.064247 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:08:42.064265 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:42.064832 (+   567us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.064889 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.064916 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:42.065289 (+   373us) tablet.cc:701] Row locks acquired
0709 13:08:42.065306 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:42.065441 (+   135us) write_op.cc:270] Start()
0709 13:08:42.065558 (+   117us) write_op.cc:276] Timestamp: P: 1783602522065397 usec, L: 0
0709 13:08:42.065581 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.066225 (+   644us) log.cc:844] Serialized 1665 byte log entry
0709 13:08:42.274302 (+208077us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.411891 (+137589us) write_op.cc:301] APPLY: starting
0709 13:08:42.412130 (+   239us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.452630 (+ 40500us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.452730 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:42.455417 (+  2687us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:42.455605 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:42.455646 (+    41us) write_op.cc:312] APPLY: finished
0709 13:08:42.484147 (+ 28501us) log.cc:844] Serialized 49 byte log entry
0709 13:08:42.494366 (+ 10219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.496214 (+  1848us) write_op.cc:454] Released schema lock
0709 13:08:42.496744 (+   530us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:42.510252 (+ 13508us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.511649 (+  1397us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":89368,"reported_tablets":10,"spinlock_wait_cycles":65641856,"child_traces":[["op",{"apply.queue_time_us":125194,"apply.run_cpu_time_us":6916,"apply.run_wall_time_us":91208,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20847,"num_ops":4,"prepare.queue_time_us":270902,"prepare.run_cpu_time_us":2961,"prepare.run_wall_time_us":7330,"replication_time_us":208498,"spinlock_wait_cycles":1408,"thread_start_us":221812,"threads_started":2}]]}
I20260709 13:08:42.626869 22358 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.642302 22358 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:42.649156 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:42.649781 16631 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.650682 16603 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:42.652294 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.652913 17181 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:42.656529 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.659569 17183 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:42.657133 16558 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:42.661031 22234 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:42.667950 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.669389 17181 raft_consensus.cc:2393] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 17: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:42.676774 16605 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.677592 22276 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:42.677986 22276 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.678369 22276 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.679301 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:42.694003 22485 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:42.701098 16562 raft_consensus.cc:2468] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:42.702219 22250 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.702702 22250 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:42.705328 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:42.705557 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:42.706115 16633 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 20.
I20260709 13:08:42.707185 16455 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.707224 16635 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:42.707926 22250 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:42.708372 22411 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:42.708758 22411 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.709115 22411 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:42.723261 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:42.726342 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.727032 16558 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 20.
I20260709 13:08:42.730234 22352 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.733999 16632 raft_consensus.cc:2368] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17.
I20260709 13:08:42.732059 22422 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.735643 22422 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:42.736001 22422 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.740538 16483 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:42.742314 22425 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:42.745189 22352 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.747452 22425 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:42.752638 22425 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:42.753721 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:42.755704 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:42.758062 22512 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:42.758483 16562 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.755930 22485 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:42.766052 22485 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.757477 16530 leader_election.cc:400] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17.
I20260709 13:08:42.758157 17184 raft_consensus.cc:3060] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.769588 22425 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.770706 22425 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.771901 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.772635 17181 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:42.773578 16631 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:42.774374 16635 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:42.733279 22361 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.779876 16530 leader_election.cc:403] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:42.782451 17184 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:42.777853 22422 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:42.786285 17152 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.787577 22358 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:42.788070 22358 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:42.790695 22358 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.794242 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:42.798447 22422 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:42.763274 22276 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.801931 16635 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:42.785792 22361 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.785872 22411 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:42.768018 22485 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.799996 22378 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:42.824621 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:42.826764 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:42.827924 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:42.848237 16633 raft_consensus.cc:2368] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18.
I20260709 13:08:42.848927 16632 raft_consensus.cc:2393] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 11: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:42.851991 16635 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 9.
I20260709 13:08:42.807463 16562 raft_consensus.cc:2468] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:42.854509 16605 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.833570 22319 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.860250 16389 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.863736 16389 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 10 to 11, term changed from 17 to 19, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.856122 22409 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 16. Current term is 17.
I20260709 13:08:42.874329 16483 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 11.
I20260709 13:08:42.865168 22351 raft_consensus.cc:2804] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:42.867424 16389 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.879297 17184 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:42.881349 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 276) took 4421 ms. Trace:
I20260709 13:08:42.883818 16386 rpcz_store.cc:276] 0709 13:08:38.459780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.459907 (+   127us) service_pool.cc:224] Handling call
0709 13:08:42.881296 (+4421389us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.771865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.772375 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.772407 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:42.772422 (+    15us) tablet.cc:662] Decoding operations
0709 13:08:42.772995 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.773066 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.773094 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:42.773468 (+   374us) tablet.cc:701] Row locks acquired
0709 13:08:42.773494 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:08:42.784776 (+ 11282us) write_op.cc:270] Start()
0709 13:08:42.794885 (+ 10109us) write_op.cc:276] Timestamp: P: 1783602522784724 usec, L: 0
0709 13:08:42.794913 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.795484 (+   571us) log.cc:844] Serialized 1660 byte log entry
0709 13:08:42.797162 (+  1678us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.797590 (+   428us) write_op.cc:301] APPLY: starting
0709 13:08:42.797669 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.808530 (+ 10861us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.808616 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:42.810852 (+  2236us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:42.811039 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:42.811082 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:42.811275 (+   193us) log.cc:844] Serialized 49 byte log entry
0709 13:08:42.812104 (+   829us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.812195 (+    91us) write_op.cc:454] Released schema lock
0709 13:08:42.812236 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:42.812559 (+   323us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.812591 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32721,"reported_tablets":17,"spinlock_wait_cycles":618752,"child_traces":[["op",{"apply.queue_time_us":235,"apply.run_cpu_time_us":5821,"apply.run_wall_time_us":14921,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":126309,"prepare.run_cpu_time_us":2887,"prepare.run_wall_time_us":25246,"replication_time_us":2125,"thread_start_us":77871,"threads_started":1}]]}
I20260709 13:08:42.892588 16389 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 11 to 14, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:42.896749 16389 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 18 to 19, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 19 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.898329 16389 catalog_manager.cc:5697] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 17 to 18, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 18 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:42.866704 22485 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:42.865047 22319 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:42.904215 16489 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.858021 22378 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.901427 22147 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:08:42.899614 16389 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 12 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.909868 16389 catalog_manager.cc:5697] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 12 to 15, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 15 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:42.912492 16389 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: config changed from index 9 to 10, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 14 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.913491 16486 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:42.913931 16389 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 15 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.915362 16389 catalog_manager.cc:5697] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:42.921164 16389 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:42.921734 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:42.922298 16389 catalog_manager.cc:5697] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:42.928093 16558 raft_consensus.cc:2410] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:42.922927 16486 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 21.
I20260709 13:08:42.900050 22358 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.901636 22351 raft_consensus.cc:697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:08:42.931361 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 57361.7us
I20260709 13:08:42.941272 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:42.944790 16566 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:42.928018 22378 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.960886 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:42.964540 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:42.964938 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 104227us
I20260709 13:08:42.965118 16562 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.961486 16566 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 8.
I20260709 13:08:42.975708 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:42.931305 22264 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 13:08:42.985769 22556 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 13:08:42.986732 22351 consensus_queue.cc:237] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.988672 22276 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.989475 22361 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:42.937594 22358 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:42.994068 22358 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:42.996649 17181 raft_consensus.cc:2393] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 21: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:43.001207 16562 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:43.006028 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:43.009209 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:43.009805 16558 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 21.
I20260709 13:08:43.016616 22411 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:43.021070 22327 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:43.021556 22327 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.024583 16483 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.027130 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:43.027519 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:43.027967 16562 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:43.028517 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:43.029093 17187 raft_consensus.cc:3060] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.027132 17183 raft_consensus.cc:1275] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:43.033471 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:43.033921 16635 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 20.
I20260709 13:08:43.034626 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:43.035161 16636 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:43.019577 22567 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:43.034835 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:43.038051 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:43.008105 22437 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.041951 17187 raft_consensus.cc:2468] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:43.039075 16604 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:43.043452 16530 leader_election.cc:400] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18.
I20260709 13:08:43.043756 16530 leader_election.cc:403] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.032424 22352 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:43.045521 16530 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:43.047389 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:43.047678 16603 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:43.049554 16488 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 21.
I20260709 13:08:43.039649 22378 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.031577 22552 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:43.095038 16636 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 21.
I20260709 13:08:43.046620 22485 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18.
I20260709 13:08:43.051378 16562 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 21.
I20260709 13:08:43.052201 22327 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:43.053162 22558 consensus_queue.cc:1059] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:08:43.044498 22437 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.046868 22352 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.063666 22234 raft_consensus.cc:2804] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:43.071918 22378 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.042510 22264 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:43.050501 22276 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:43.053010 22422 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:43.042932 22409 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:43.079995 17187 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:43.080710 22319 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:43.041297 22567 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.109892 22327 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:43.117396 22327 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.118155 22567 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:43.094671 22453 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:43.118877 22453 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.119302 22327 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:43.112480 22352 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.116977 16486 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.122040 22378 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:43.122571 16635 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 21.
I20260709 13:08:43.123976 17182 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 9.
I20260709 13:08:43.109269 22555 consensus_queue.cc:1048] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:08:43.125686 22234 raft_consensus.cc:697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:43.126529 22234 consensus_queue.cc:237] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.128563 16486 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:43.131067 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:43.129868 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:43.131747 17181 raft_consensus.cc:2368] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16.
W20260709 13:08:43.206619 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 92390.1us
I20260709 13:08:43.113503 22264 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:43.222599 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 92800.8us
I20260709 13:08:43.113886 22422 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:43.114183 22276 raft_consensus.cc:493] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:43.254248 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 206430us
I20260709 13:08:43.223320 22264 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:43.225059 22422 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:43.225618 22276 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:43.332933 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 109646us
I20260709 13:08:43.333639 16456 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:43.328050 22409 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:43.328830 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:43.329540 22558 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.330374 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:43.352468 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:43.356683 16562 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 21.
I20260709 13:08:43.402251 22555 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.405423 16566 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 19: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
W20260709 13:08:43.385906 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 336525us
I20260709 13:08:43.402838 22555 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.344012 22327 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.344700 22573 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:43.418785 22573 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.424903 22327 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.425539 22573 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:43.427482 22327 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:43.409435 22558 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.440850 22558 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:43.414280 22575 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:08:43.444516 22560 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:43.444502 22575 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.468344 16562 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:43.472326 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:43.472926 16635 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 19.
I20260709 13:08:43.474210 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:43.475529 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:43.476190 16636 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:43.491355 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:43.525133 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 191561us
I20260709 13:08:43.586813 16636 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:43.586717 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:43.545172 22351 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.564838 22564 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:43.792675 16562 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:43.607008 22234 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:08:43.659734 22564 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.543601 22409 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.689905 22591 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.597347 22579 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:43.889768 22552 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:43.890298 22552 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:43.898213 22422 consensus_meta.cc:287] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.001s
I20260709 13:08:43.898649 22422 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.867311 22564 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:43.684552 22575 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:43.672988 22351 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.918664 22453 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:43.919322 16635 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:43.920653 22147 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:43.921059 22147 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:43.921833 22147 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.922792 22147 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.925582 22580 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:43.926108 22580 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.869164 22445 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:08:43.900198 22591 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.932569 22445 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:43.960445 22555 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:43.960399 22579 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 21 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:43.933022 22445 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:43.910861 22573 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:43.976755 22437 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.046056 22600 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:44.056466 22600 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.058614 22600 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.060168 22579 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.052035 22590 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:44.062055 22590 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.064430 22590 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.052094 22552 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.073143 22573 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 22 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.075145 22580 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.087177 22564 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.111169 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:44.111989 16483 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 22: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:44.127475 22234 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.182835 22564 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.129528 17183 raft_consensus.cc:1275] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:44.183400 22234 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.144253 22351 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.146329 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.152580 22573 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.185596 17187 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:44.186118 22573 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.152784 22422 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:44.158250 16529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.001s	sys 0.004s
I20260709 13:08:44.152511 22445 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.165419 22604 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.188736 22573 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.188666 22604 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.189529 22568 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.190400 22568 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.191176 22604 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:44.167042 22352 consensus_meta.cc:287] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.047s	user 0.012s	sys 0.002s
I20260709 13:08:44.168932 22451 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.193269 22451 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.169690 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.170331 16558 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:08:44.170709 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.171849 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:44.182072 16532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.002s	sys 0.005s
W20260709 13:08:44.166947 16456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.005s
W20260709 13:08:44.199775 16456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.005s	sys 0.006s
W20260709 13:08:44.200209 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 674305us
I20260709 13:08:44.174053 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.201951 16559 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:44.196405 16566 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 9.
I20260709 13:08:44.202901 22352 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.205394 22352 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:44.206065 16529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.005s
I20260709 13:08:44.168797 22437 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.206951 22437 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.208106 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.208884 17188 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:44.168814 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.196681 16558 pending_rounds.cc:85] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Aborting all ops after (but not including) 12
I20260709 13:08:44.209961 16558 pending_rounds.cc:107] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:08:44.210254 16562 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:44.198918 22422 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.198542 22588 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.211362 22422 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.211906 22588 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.213624 22422 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.214215 22588 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.214550 16558 raft_consensus.cc:2889] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.216161 22451 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.212800 22437 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.218348 22234 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.220556 22563 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
W20260709 13:08:44.218252 16532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.002s	sys 0.006s
I20260709 13:08:44.221921 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.227495 22563 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.230297 22563 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.230950 22563 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:08:44.232059 16603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.005s	sys 0.009s
I20260709 13:08:44.231664 22563 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.234282 22563 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.224815 22588 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:44.232506 16603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.005s	sys 0.009s
I20260709 13:08:44.237790 22602 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.238602 22602 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.239672 22588 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:44.241331 22602 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.241815 16631 raft_consensus.cc:1240] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:44.242483 22422 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.241080 22588 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.244233 22606 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.243283 22422 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.244966 22606 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.245926 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:44.246699 16633 raft_consensus.cc:2368] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:08:44.248066 22422 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.248792 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.248952 22602 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.239689 22610 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.258786 16558 raft_consensus.cc:2393] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 16: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:44.262519 22351 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.263365 22351 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.264233 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:44.266459 17188 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 9: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:44.266839 22600 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.267684 22600 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.270399 22600 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.247215 22606 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.289389 22361 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.290180 22361 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:44.293113 16454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.000s	sys 0.005s
W20260709 13:08:44.300143 16454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.000s	sys 0.006s
I20260709 13:08:44.299886 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.305490 16562 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:44.312254 22581 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.312958 22581 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.315079 22581 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.315943 22582 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.316619 22582 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.318663 22582 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.320605 22596 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:44.321303 22596 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.323913 22596 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.327929 22352 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.328667 22352 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.321388 16530 leader_election.cc:400] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:08:44.331099 16530 leader_election.cc:403] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.332685 22565 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.332973 22558 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.333489 22565 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.339704 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:44.340831 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:44.341001 22600 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.341455 22600 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:44.341886 22600 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.342115 22453 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:44.342505 22453 raft_consensus.cc:493] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.342833 22453 raft_consensus.cc:3060] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:44.343936 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 46185.1us
I20260709 13:08:44.345759 22234 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:44.346099 22558 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 9. Current term is 10.
I20260709 13:08:44.347980 22234 consensus_queue.cc:1048] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:44.354683 22351 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.295636 22422 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.363636 17183 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:44.364892 17182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.294840 22610 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.368264 22610 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.369691 22351 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.380610 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40234 (request call id 3040) took 1342 ms. Trace:
I20260709 13:08:44.381075 16486 rpcz_store.cc:276] 0709 13:08:43.038524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.038821 (+   297us) service_pool.cc:224] Handling call
0709 13:08:43.039055 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.128891 (+ 89836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.380142 (+1251251us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b5400178c54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648be01 00007f063648a83e 00007f063b44f419 00007f06349c6bd4 00007f06349c6b62 00007f06349c6a91 00007f06349c6a0c 00007f06349c5cc2 00007f06347c648c 00007f06347c58c6
0709 13:08:44.380431 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178956544}
I20260709 13:08:44.382419 22569 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.383102 22569 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.385422 22569 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.357838 22563 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:08:44.371207 16605 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.013s
W20260709 13:08:44.383095 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.003s
I20260709 13:08:44.380358 22351 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:44.388760 22276 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: Time spent flushing consensus metadata: real 1.004s	user 0.012s	sys 0.003s
W20260709 13:08:44.392477 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.005s	sys 0.004s
I20260709 13:08:44.388760 16483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 3041) took 1254 ms. Trace:
I20260709 13:08:44.380522 22453 raft_consensus.cc:515] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.398645 22576 raft_consensus.cc:493] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.399317 22453 leader_election.cc:290] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.399747 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.359349 22602 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.400890 16635 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:44.403112 22602 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.406045 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.406850 16490 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:44.359589 22565 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.410019 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.410841 16635 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:44.409987 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.417876 22358 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.420806 22611 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.421183 22358 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.422107 17188 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:44.423501 22358 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.423269 22611 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.479323 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:44.399287 22576 raft_consensus.cc:515] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.429404 22351 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.429867 22422 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.430574 22276 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.433634 22567 raft_consensus.cc:493] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:44.435004 22385 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:44.436018 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.437826 22319 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.427505 22361 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.440687 22568 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.441320 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:44.442224 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.442257 22604 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.443277 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.444480 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.444646 16557 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:44.393069 16483 rpcz_store.cc:276] 0709 13:08:43.334802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.352212 (+ 17410us) service_pool.cc:224] Handling call
0709 13:08:44.388501 (+1036289us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54002990d4. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:44.388671 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647857536}
I20260709 13:08:44.447645 22378 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.449285 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:44.449605 22147 consensus_meta.cc:287] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.009s
I20260709 13:08:44.389304 22563 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:44.451480 22264 consensus_meta.cc:287] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: Time spent flushing consensus metadata: real 1.110s	user 0.013s	sys 0.011s
I20260709 13:08:44.455983 22564 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.457340 22591 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.442296 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.459249 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.459767 22352 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.427405 16631 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:44.463846 22602 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.469813 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.470041 22587 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.459932 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.476454 16454 leader_election.cc:400] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16.
I20260709 13:08:44.532506 16454 leader_election.cc:403] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.425686 22588 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.480883 16529 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:44.481927 22611 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.502895 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.543407 17188 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:44.507743 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.544230 16560 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:44.544370 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.518996 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.522256 16559 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:44.523311 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:44.545002 16484 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:44.545199 16561 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:44.545776 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.546370 17184 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:44.547047 22602 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.549052 22602 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.549309 22573 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 15. Current term is 16.
I20260709 13:08:44.549775 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.549935 22573 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:44.550395 22573 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.551055 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.552575 16636 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:44.553284 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.554006 16482 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:44.554895 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.555526 22591 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.530858 16566 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:44.532737 16487 raft_consensus.cc:2393] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:44.556053 22591 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.556159 22378 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.556895 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.557950 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.558044 22591 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.558926 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.532302 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.560068 17183 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:44.534363 16485 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 14: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:44.545475 22579 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:44.561084 22579 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.560205 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.561436 22579 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:44.533949 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.561991 16636 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:44.562232 16633 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:44.564782 22422 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.565511 22599 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:08:44.537390 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:44.567781 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 87047.6us
I20260709 13:08:44.533882 16490 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:44.540983 22576 leader_election.cc:290] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.540817 22587 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:44.542034 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 65805.2us
I20260709 13:08:44.506888 22567 raft_consensus.cc:515] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.560453 22276 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.568279 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.568954 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.500216 22453 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:08:44.571714 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:08:44.578212 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 44893.4us
I20260709 13:08:44.576894 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.580444 17186 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:44.581255 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.581396 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.558239 22378 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.573895 22581 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.591136 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:44.585188 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 105973us
I20260709 13:08:44.507037 22385 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.533151 22264 raft_consensus.cc:515] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.529398 22351 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.613622 16559 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 22.
I20260709 13:08:44.614981 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.616246 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.611343 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.617522 17188 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:44.618498 16633 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:44.595139 22581 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.615597 16632 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:44.567606 22604 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.623123 22588 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:44.627272 22588 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.629312 22588 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.623337 22593 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:44.630110 22593 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.630435 22593 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.618549 22599 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.633603 22599 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.597163 22591 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.646646 22588 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.647325 22588 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.649881 22588 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.580502 22564 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.584635 22319 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.657303 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.661263 17186 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:44.640053 22581 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.658118 16455 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:44.663957 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.663606 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.643530 22573 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.669269 16530 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.678110 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.680486 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.681103 17188 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:44.666005 22610 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:44.684846 22573 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.685910 22319 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.656494 22591 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.678004 22606 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:44.695600 16566 raft_consensus.cc:1275] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:44.704962 22485 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:44.705376 22485 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.705724 22485 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.665484 22351 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:44.708870 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 64048.4us
I20260709 13:08:44.676935 22599 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.713155 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:44.718350 16558 raft_consensus.cc:2468] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 10.
I20260709 13:08:44.673584 22600 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.689497 22610 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.718524 17188 raft_consensus.cc:2368] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 21. Current term is 22.
I20260709 13:08:44.692428 22573 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.724578 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.696740 22606 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.731108 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.737699 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.735040 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.728742 16603 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.736384 17184 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:44.741321 17153 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:44.742350 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.742637 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:44.743322 22619 log.cc:927] Time spent T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:44.743322 16564 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:08:44.729185 22610 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:44.732694 22573 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.763753 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.770151 16632 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:44.739521 22606 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:44.772927 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.776494 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.778144 22581 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.780146 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.780779 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.788085 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.797410 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.797863 22582 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:44.800621 22587 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.801057 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:44.801283 22385 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.801964 16560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
W20260709 13:08:44.804577 22621 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.321s	user 0.004s	sys 0.000s
W20260709 13:08:44.811987 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 84790us
I20260709 13:08:44.811805 16635 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:44.751207 22588 raft_consensus.cc:2804] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:44.816365 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:44.814522 22585 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:44.826848 22585 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.827229 22585 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.834391 22591 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.836632 16603 leader_election.cc:400] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 21. Current term is 22.
I20260709 13:08:44.841795 16603 leader_election.cc:403] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.772145 22378 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:44.739778 22599 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:08:44.844059 16560 raft_consensus.cc:606] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:44.799314 22579 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:44.844463 16560 raft_consensus.cc:614] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:44.854318 22385 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.811323 22563 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.855844 22564 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.875168 22564 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:44.875491 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.876134 16488 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:44.876904 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.877908 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:44.878664 16484 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 22: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:44.879436 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.880431 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:44.875193 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.856057 22600 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.843276 22587 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.857124 22604 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.857707 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.890822 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:44.844147 22378 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:44.853128 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 52142.7us
I20260709 13:08:44.865734 16455 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.868247 22385 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:44.868944 16637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.869553 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.869700 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.870373 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.872962 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.874465 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:44.874539 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 52036.8us
I20260709 13:08:44.886725 16566 raft_consensus.cc:2368] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16.
I20260709 13:08:44.887244 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.824271 22567 leader_election.cc:290] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.858575 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:44.960099 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:44.901824 16562 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 22: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:44.891848 16456 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:44.890965 16635 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:44.957269 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.958264 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.960634 16490 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:44.867555 22588 raft_consensus.cc:697] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:44.970477 16634 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 10: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:44.959415 22378 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.955411 22385 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.978992 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:44.978927 22624 log.cc:927] Time spent T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:08:44.981352 17152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.1:42809 timed out after 1.723s (SENT) [suppressed 1 similar messages]
I20260709 13:08:44.982640 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b235e470ebe04d06993b8dd025e5871b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:44.979135 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.956944 22361 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.982276 22415 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:44.984467 16561 raft_consensus.cc:2393] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 10: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:44.984658 22361 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.984829 22588 consensus_queue.cc:237] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:44.985299 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.986727 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.987304 16640 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 12.
I20260709 13:08:44.896194 22587 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:44.989133 22627 log.cc:927] Time spent T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:08:44.990523 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:44.991338 22361 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.991827 16636 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:44.992317 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:44.993201 22587 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:44.995749 22579 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:44.997782 22581 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:44.999244 16484 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 21.
I20260709 13:08:45.000468 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.001087 16562 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 12.
I20260709 13:08:45.000912 22385 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.002985 22385 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.005029 22415 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.007229 16487 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:45.015720 22415 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:45.016037 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 43829.2us
I20260709 13:08:45.018100 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:44.973659 22264 leader_election.cc:290] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 22 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.020157 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:44.983711 22593 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.022837 22593 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.023029 22585 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.024897 22358 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:45.026625 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:44.999457 22485 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.036743 22564 raft_consensus.cc:2749] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 21. Current term is 22.
I20260709 13:08:45.039161 22351 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:45.044049 22358 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:45.051759 22485 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.061758 16559 raft_consensus.cc:1275] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:45.064563 22378 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.035279 22610 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.068318 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.068982 16557 raft_consensus.cc:2393] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 20: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:45.047633 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.069912 22610 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.071655 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.071928 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.072453 16563 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:45.036868 22218 raft_consensus.cc:493] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:45.067855 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.073419 22610 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.073694 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.074255 16563 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:45.075088 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.075656 16634 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.076448 16631 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:45.077453 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.077963 16640 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.078672 22378 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.082123 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.082422 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.083597 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.083742 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.085772 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.075013 22218 raft_consensus.cc:515] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.089946 22218 leader_election.cc:290] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.038367 22606 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.058851 22579 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.097118 22579 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.097574 22579 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.098145 22606 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:45.058174 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 215586us
I20260709 13:08:45.096294 22610 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.097163 16565 raft_consensus.cc:1240] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Rejecting Update request from peer 16b5b367990f4b5c862484bdec0b9226 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:45.099004 22610 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.099466 22610 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.056093 22567 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:45.100530 22567 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:45.101440 22567 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.095714 16639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:45.056269 22358 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.104091 16639 raft_consensus.cc:606] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:45.107000 22558 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:45.109107 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.096612 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.110484 16631 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:45.110598 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 228678us
I20260709 13:08:45.111295 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:45.055987 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 164228us
I20260709 13:08:45.113781 16640 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:45.114327 16633 raft_consensus.cc:2393] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 17: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.115331 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.116156 16485 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:45.117023 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.117568 16486 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.117789 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.118952 16637 raft_consensus.cc:2393] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 17: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.120213 17153 leader_election.cc:400] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16.
I20260709 13:08:45.120518 17153 leader_election.cc:403] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.124193 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.126199 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.126883 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.128413 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.129441 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.057827 22385 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.129940 16484 raft_consensus.cc:3060] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.130317 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.131850 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.132542 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.134882 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.138270 16634 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:45.141119 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.141701 17186 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:08:45.143476 22593 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:45.143818 17185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.144369 17185 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.123957 22453 raft_consensus.cc:3060] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.146517 22610 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.123045 22264 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.155110 16484 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 20.
I20260709 13:08:45.157665 16486 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:45.158573 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.159193 16562 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 21.
I20260709 13:08:45.159119 22610 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.161273 16603 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.165450 16634 raft_consensus.cc:1240] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:45.165475 16631 raft_consensus.cc:2468] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 20.
I20260709 13:08:45.090595 22568 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:08:45.171685 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.174490 16530 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:45.182322 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.183940 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.185390 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.186837 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.188314 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.191550 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.192811 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.195540 16561 raft_consensus.cc:1240] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:45.199802 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 173224us
I20260709 13:08:45.202275 17152 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.175879 16530 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:45.210587 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.213287 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.213967 16631 raft_consensus.cc:2393] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 22: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.137615 22573 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.199720 22378 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.207813 22593 raft_consensus.cc:2804] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:45.156849 22385 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.163673 22600 consensus_queue.cc:1059] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:08:45.211845 22596 raft_consensus.cc:2804] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:45.216023 22588 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.231300 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.232033 16485 raft_consensus.cc:3060] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.233176 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.236824 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.238765 16639 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:45.220135 22378 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.240056 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.240379 22378 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.242054 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.244640 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:45.247045 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 51335.7us
I20260709 13:08:45.248235 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836ce75918dd4690b2a75522b473f405" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.249948 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.251350 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.252215 16633 raft_consensus.cc:2368] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 19. Current term is 20.
I20260709 13:08:45.247071 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.254050 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.254992 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.255570 16488 raft_consensus.cc:2368] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16.
I20260709 13:08:45.256579 16640 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:45.257056 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.258082 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.258311 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.259240 22453 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16.
I20260709 13:08:45.259387 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f64e4c7b2a4c3c92b69f1d3cbd9737" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.260407 16489 raft_consensus.cc:3060] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:45.264698 16491 raft_consensus.cc:1275] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:45.265652 22385 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.266732 22585 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.267549 22573 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.290885 16489 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 22.
W20260709 13:08:45.291697 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58591us
I20260709 13:08:45.292214 16529 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:45.292812 17185 raft_consensus.cc:2468] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:45.295084 16638 raft_consensus.cc:2468] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 22.
I20260709 13:08:45.294128 16529 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.300694 16529 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.303399 22147 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:45.304908 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.307802 16605 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:45.233686 22588 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.312005 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.291152 22596 raft_consensus.cc:697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:45.239986 22234 consensus_queue.cc:1048] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:08:45.314924 16529 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.301715 22585 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.301798 22606 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.306219 22581 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.317014 16529 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.317579 22147 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:45.292521 22358 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.334064 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.312644 22588 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.346639 16640 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:45.348803 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.349480 16557 raft_consensus.cc:2368] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17.
I20260709 13:08:45.320986 22585 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.317945 22593 raft_consensus.cc:697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 20 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:45.342581 22351 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.342782 22218 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:45.363509 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 55798us
I20260709 13:08:45.323868 22606 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.366842 16456 leader_election.cc:400] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17.
I20260709 13:08:45.367717 16456 leader_election.cc:403] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.366895 16605 leader_election.cc:304] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:45.374660 22378 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.377708 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.378259 22564 raft_consensus.cc:2749] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:45.379638 22564 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:45.380434 22564 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.380784 22564 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.385399 16605 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.388669 16605 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.355726 22385 consensus_queue.cc:1059] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:45.386777 22606 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.389897 22351 consensus_queue.cc:1048] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:08:45.401081 22351 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.401503 22351 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.401897 22351 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.404261 22587 raft_consensus.cc:993] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:45.404780 22587 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.405105 22587 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.405462 22587 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.416754 22653 raft_consensus.cc:1081] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
W20260709 13:08:45.418298 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 170595us
I20260709 13:08:45.426755 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:45.411298 22606 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:45.429886 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 227689us
I20260709 13:08:45.430296 22593 consensus_queue.cc:237] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.430761 22649 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:45.431275 22649 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.431699 22649 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.431082 17152 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.358503 22585 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.433130 17152 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.433837 22650 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.434233 22650 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.434602 22650 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.423594 22351 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.448088 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eda6987d51b45e0a0672ec78b798b0f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.448823 16640 raft_consensus.cc:2368] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17.
I20260709 13:08:45.459324 16557 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:45.459988 16485 raft_consensus.cc:2468] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:45.460779 22582 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:45.463589 22351 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.467355 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.379694 22579 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.471156 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da035835f764425db56e9649db0a0bcc" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.470803 22600 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.472507 22600 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:45.472842 22600 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.473327 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.394683 22596 consensus_queue.cc:237] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.481792 22415 raft_consensus.cc:3055] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:45.482223 22415 raft_consensus.cc:740] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:45.483068 22415 consensus_queue.cc:260] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.518858 22646 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.519054 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.519425 22646 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.522433 22606 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.515076 16603 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.525162 22599 raft_consensus.cc:2804] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:45.527593 22599 raft_consensus.cc:697] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:45.528575 22599 consensus_queue.cc:237] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.510362 22378 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.532769 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.533720 22646 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.535471 22415 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:45.538332 22558 consensus_queue.cc:1048] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:45.490571 22600 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.495021 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a8884f986b4b43beecab72a521a3eb" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.541088 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.501268 22358 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.470979 22485 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.465302 22573 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17.
I20260709 13:08:45.509766 22579 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.510321 16483 raft_consensus.cc:2368] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:45.441701 22564 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.511076 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.511852 22582 consensus_queue.cc:1059] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:45.512188 22644 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:45.512432 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:45.471907 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 45233.4us
I20260709 13:08:45.541810 16634 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.550639 16562 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.552428 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.554226 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.557291 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.557405 16604 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.558975 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.559572 16631 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:45.562166 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.560905 16530 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.565656 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.566232 17187 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.570323 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.572409 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.572914 22653 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:45.573194 22637 log.cc:927] Time spent T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
I20260709 13:08:45.573642 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.573446 22650 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.576661 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 285) took 3174 ms. Trace:
W20260709 13:08:45.572326 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 59958.5us
I20260709 13:08:45.574409 22579 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.578919 22588 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.579850 16385 catalog_manager.cc:5697] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.581480 16455 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.581605 22588 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.581991 22319 raft_consensus.cc:3055] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:45.582346 22319 raft_consensus.cc:740] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:45.582517 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:45.583088 22147 raft_consensus.cc:2804] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:45.583547 22147 raft_consensus.cc:697] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:45.584527 17184 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:45.588393 16530 leader_election.cc:304] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.576792 22650 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.594000 22602 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:45.567430 22485 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.595523 22582 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.596483 22485 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.597790 16604 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.599059 22358 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.570621 22378 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:45.600852 22587 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.603466 22587 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.643266 16558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:45.642052 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.606488 22147 consensus_queue.cc:237] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.645514 17181 raft_consensus.cc:2468] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
W20260709 13:08:45.594269 22641 log.cc:927] Time spent T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:08:45.608274 22567 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:45.609544 22602 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:45.607484 22319 consensus_queue.cc:260] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.556308 17182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48050
I20260709 13:08:45.612768 22646 raft_consensus.cc:2749] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.625401 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.577020 16389 rpcz_store.cc:276] 0709 13:08:42.401709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.401857 (+   148us) service_pool.cc:224] Handling call
0709 13:08:45.576451 (+3174594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.992877 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.993410 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.993444 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:42.993460 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:42.994547 (+  1087us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.994613 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.994640 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:08:42.995611 (+   971us) tablet.cc:701] Row locks acquired
0709 13:08:42.995629 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:42.995766 (+   137us) write_op.cc:270] Start()
0709 13:08:43.007723 (+ 11957us) write_op.cc:276] Timestamp: P: 1783602522995723 usec, L: 0
0709 13:08:43.007751 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.019621 (+ 11870us) log.cc:844] Serialized 5096 byte log entry
0709 13:08:43.021890 (+  2269us) op_driver.cc:464] REPLICATION: finished
0709 13:08:43.022291 (+   401us) write_op.cc:301] APPLY: starting
0709 13:08:43.022362 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:43.869053 (+846691us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:43.874237 (+  5184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:44.311223 (+436986us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:44.311603 (+   380us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:08:44.311685 (+    82us) write_op.cc:312] APPLY: finished
0709 13:08:44.312305 (+   620us) log.cc:844] Serialized 121 byte log entry
0709 13:08:44.667638 (+355333us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.712824 (+ 45186us) write_op.cc:454] Released schema lock
0709 13:08:44.726391 (+ 13567us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:44.832436 (+106045us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.832477 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":78819,"apply.run_wall_time_us":1810036,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54340,"num_ops":13,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":4045,"prepare.run_wall_time_us":54298,"replication_time_us":14037,"thread_start_us":285993,"threads_started":1,"wal-append.queue_time_us":349355}]]}
I20260709 13:08:45.625403 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.627825 16484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.628530 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.632004 22609 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:45.663635 17179 raft_consensus.cc:2393] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 17: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:45.627842 22352 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.636119 22633 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:45.637648 22564 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:45.640718 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:45.640911 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.636147 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:45.642535 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 223193us
I20260709 13:08:45.643828 16558 raft_consensus.cc:606] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:45.678110 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.646720 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66755c5c9714ae1858e6df5473a5cd6" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.654212 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet ca9e6e3a4a404a9893a40afed3d0179f with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:55922
I20260709 13:08:45.507642 22649 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.656409 17182 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.683383 17182 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.654633 16562 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:45.671066 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:45.672125 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.679308 16605 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:45.680387 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 97854.9us
I20260709 13:08:45.680871 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.649022 22485 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.686616 22585 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.682265 22596 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.648464 22567 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:45.676414 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
W20260709 13:08:45.688913 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 136554us
I20260709 13:08:45.682345 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.696362 17152 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.685758 16455 leader_election.cc:304] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.696602 17188 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:45.689525 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.697090 17187 raft_consensus.cc:2468] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:45.699594 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.700858 16455 leader_election.cc:400] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 19. Current term is 20.
I20260709 13:08:45.701223 16455 leader_election.cc:403] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.698836 16530 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.698047 16603 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.702720 16638 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:45.705360 22661 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.705511 16530 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.707855 16605 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:45.712116 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f67e2620d84985a37dbf9b77909370" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.713376 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:45.716197 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.694823 22361 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.740013 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:45.740376 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.738137 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.703848 22351 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:45.743387 17186 raft_consensus.cc:2410] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:45.747928 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.715626 22606 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.705466 22663 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:45.735810 22352 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.741466 22378 raft_consensus.cc:2804] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:45.701772 22596 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.688126 22633 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:45.749238 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 44823.1us
I20260709 13:08:45.766462 16562 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 15: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:45.759496 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.767241 17188 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.741993 22600 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.770831 16563 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:45.716272 22599 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.744189 22587 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:45.776991 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.755882 22660 raft_consensus.cc:2749] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.758232 22585 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.761152 22652 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.780391 22633 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.759846 22649 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:45.760600 22579 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 19. Current term is 20.
I20260709 13:08:45.758810 22567 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.782168 22378 raft_consensus.cc:697] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:45.765919 22663 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:45.792965 22620 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:45.777866 22568 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:45.777884 22587 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.742973 22602 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:45.809605 17182 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.807279 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.822304 22661 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.823203 22567 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.812688 22663 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.829093 22596 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.829255 16557 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.814165 22587 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:45.814026 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 113293us
W20260709 13:08:45.834777 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 94469.8us
I20260709 13:08:45.832628 22378 consensus_queue.cc:237] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.841599 16529 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.843066 17182 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:45.847731 22579 consensus_queue.cc:1059] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:45.848991 22563 raft_consensus.cc:3055] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:45.849320 22563 raft_consensus.cc:740] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:45.850077 22563 consensus_queue.cc:260] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.850862 22663 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.852268 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.851941 16455 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.854414 17188 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:45.855810 17152 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.856880 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.857621 22600 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.858287 22661 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.859367 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:45.860206 22661 raft_consensus.cc:2749] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.861225 17152 leader_election.cc:400] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 15. Current term is 16.
W20260709 13:08:45.858671 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 115172us
I20260709 13:08:45.851697 22563 raft_consensus.cc:3060] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.862640 17152 leader_election.cc:304] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:45.864328 16455 leader_election.cc:400] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17.
I20260709 13:08:45.863852 16530 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.865738 22658 raft_consensus.cc:2764] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:45.870311 16640 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:45.868637 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.886703 16634 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.899284 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.899931 17186 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.867592 22667 tablet_replica.cc:333] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:08:45.867337 22663 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:45.878355 22661 raft_consensus.cc:2804] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:45.910610 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.910548 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.913880 16631 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.876748 22585 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:45.867719 22670 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.915253 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.919302 16560 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:45.919715 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.909358 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80ac0ca5c24b45831f9f1d02066656" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.917490 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.867489 22664 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:08:45.921494 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:45.906001 22610 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.922291 16559 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:45.929220 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.918288 22661 raft_consensus.cc:697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:45.930485 17179 raft_consensus.cc:1240] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:45.930775 22661 consensus_queue.cc:237] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.932776 22669 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.933790 17183 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:45.929873 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.929883 17188 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.931429 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.938060 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.940910 17180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318a7033cb194c3f8c635e0e36d5dc53" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.941846 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.942523 16635 raft_consensus.cc:2368] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:45.943225 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.943692 16635 raft_consensus.cc:3055] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:45.943960 16635 raft_consensus.cc:740] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:45.944617 16635 consensus_queue.cc:260] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.945618 16635 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:45.940564 17152 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.947836 22415 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.920576 22264 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:08:45.949262 16530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.950909 16637 raft_consensus.cc:1275] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:45.952744 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.953797 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c30518dd74380871bcf169099e049" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.954366 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.955044 16639 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.956080 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:45.954770 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.956756 17188 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
W20260709 13:08:45.956916 22643 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.496s	user 0.004s	sys 0.000s
I20260709 13:08:45.957473 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755c5be0c60f44e5a3df52484c5c934f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.957819 17152 leader_election.cc:400] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:45.948038 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:45.961006 16632 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:45.962268 17186 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:45.963444 16530 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.954011 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:45.965274 17152 leader_election.cc:400] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:45.965552 17152 leader_election.cc:403] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.957269 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.966228 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cad9c33f0b4530881909502ebdc720" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:45.970170 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:45.970875 17188 raft_consensus.cc:1240] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:45.970803 16559 raft_consensus.cc:2368] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 18. Current term is 19.
I20260709 13:08:45.976271 17153 leader_election.cc:400] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 18. Current term is 19.
I20260709 13:08:45.976727 17153 leader_election.cc:403] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.919252 22606 consensus_queue.cc:1059] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:08:45.976251 17152 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.985270 17152 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:45.981163 22650 raft_consensus.cc:2749] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 18. Current term is 19.
I20260709 13:08:45.970032 22600 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431) with higher term. Message: Invalid argument: T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:45.919730 22585 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:45.994951 16529 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:45.974793 22264 consensus_queue.cc:1048] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:46.007450 16631 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:45.989900 22588 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.995893 22650 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.012104 17187 raft_consensus.cc:1240] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:46.003444 22581 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:08:46.021047 17154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.038064 16603 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.049551 16635 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:46.035542 22581 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:46.081805 22610 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:46.104892 22676 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:46.106894 22581 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.090039 22587 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:46.110081 16638 raft_consensus.cc:1240] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:46.114836 22587 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:46.119215 17181 raft_consensus.cc:1240] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:46.120679 17185 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:08:46.124706 16456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.126112 22485 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:46.126526 22485 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:46.126995 22585 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:46.127640 22563 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:46.134735 17181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:46.142500 22485 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:46.143579 22485 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.159691 17181 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:46.161820 22358 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:46.162317 22358 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:46.162781 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.171762 16454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.173600 16604 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.187096 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.189620 16604 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.193006 16604 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.194691 16604 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.194888 17181 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:46.188561 22585 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:46.194129 22587 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.193962 22378 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.193954 22664 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:46.201643 22568 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.197221 22352 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.198690 22660 consensus_queue.cc:1059] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:08:46.198868 22218 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.222985 16631 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:46.223811 22218 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:46.225807 22218 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:46.240456 16531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.241470 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 44898.4us
I20260709 13:08:46.242430 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.243140 16640 raft_consensus.cc:1240] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:46.244263 22385 consensus_queue.cc:1059] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:46.246392 22385 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:46.246868 22385 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:46.247617 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.248128 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.248482 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.248795 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.247924 22660 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:46.249665 22660 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.251507 22660 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:46.253912 22385 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:46.220949 22664 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.249079 16485 raft_consensus.cc:2368] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:46.257819 22573 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:46.249331 16490 raft_consensus.cc:3060] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:46.249203 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.261147 22573 consensus_queue.cc:1059] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.262414 22675 raft_consensus.cc:3055] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:46.262753 22675 raft_consensus.cc:740] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:46.263499 22675 consensus_queue.cc:260] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.264635 22675 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.244633 22358 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.267107 16385 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 193) took 7278 ms. Trace:
I20260709 13:08:46.256601 16454 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.269832 22573 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.270473 22573 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:46.271413 22582 consensus_queue.cc:1059] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:46.272380 22582 raft_consensus.cc:3055] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:46.272701 22582 raft_consensus.cc:740] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:46.273517 22582 consensus_queue.cc:260] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:46.276026 16638 raft_consensus.cc:1240] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:46.276729 16454 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.277797 16454 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.278321 22591 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:46.280503 17152 leader_election.cc:400] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for earlier term 14. Current term is 15.
I20260709 13:08:46.281219 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:46.283417 22358 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:46.283572 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.269269 22664 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:46.284176 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:46.284364 22358 raft_consensus.cc:2749] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.286386 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.286794 16454 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.287532 22567 raft_consensus.cc:3055] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.287906 22567 raft_consensus.cc:740] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:46.293045 22567 consensus_queue.cc:260] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.294303 22567 raft_consensus.cc:3060] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.295254 22660 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:46.287876 16454 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.299156 16454 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.300171 22667 raft_consensus.cc:2243] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:46.301023 22667 raft_consensus.cc:2272] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:46.304527 22385 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.305220 22385 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.308954 22579 consensus_queue.cc:1059] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.309674 22579 consensus_queue.cc:1059] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:46.310547 22579 raft_consensus.cc:3055] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:46.310871 22579 raft_consensus.cc:740] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:46.311067 16634 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:46.311355 22670 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.311724 22670 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:46.312469 22670 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.313210 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:46.313596 22670 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.312902 16636 raft_consensus.cc:1240] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:46.316038 22667 ts_tablet_manager.cc:1916] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:46.317287 16454 leader_election.cc:304] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.318377 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.319392 16454 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.291755 22675 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.321041 22675 raft_consensus.cc:2749] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.321660 22675 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:46.322284 22675 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.323032 22319 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.326779 16490 raft_consensus.cc:2468] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 14.
I20260709 13:08:46.337558 17152 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:46.339103 22358 raft_consensus.cc:2804] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:46.339581 22358 raft_consensus.cc:697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:46.340397 22358 consensus_queue.cc:237] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.267477 16385 rpcz_store.cc:276] 0709 13:08:38.989406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.993572 (+  4166us) service_pool.cc:224] Handling call
0709 13:08:46.267040 (+7273468us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.672785 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.673467 (+   682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.673518 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:08:45.673538 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:45.673912 (+   374us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.674017 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.674049 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:45.674341 (+   292us) tablet.cc:701] Row locks acquired
0709 13:08:45.674635 (+   294us) write_op.cc:260] PREPARE: finished
0709 13:08:45.674811 (+   176us) write_op.cc:270] Start()
0709 13:08:45.674963 (+   152us) write_op.cc:276] Timestamp: P: 1783602525674745 usec, L: 0
0709 13:08:45.674986 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.675729 (+   743us) log.cc:844] Serialized 527 byte log entry
0709 13:08:45.968732 (+293003us) op_driver.cc:464] REPLICATION: finished
0709 13:08:46.115031 (+146299us) write_op.cc:301] APPLY: starting
0709 13:08:46.115119 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:46.116363 (+  1244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:46.116482 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:46.117245 (+   763us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:46.117410 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:46.117450 (+    40us) write_op.cc:312] APPLY: finished
0709 13:08:46.117608 (+   158us) log.cc:844] Serialized 25 byte log entry
0709 13:08:46.117758 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:46.117835 (+    77us) write_op.cc:454] Released schema lock
0709 13:08:46.117871 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:46.147984 (+ 30113us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:46.148018 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":392588,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":142509,"apply.run_cpu_time_us":3242,"apply.run_wall_time_us":21654,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":89907,"prepare.run_cpu_time_us":3125,"prepare.run_wall_time_us":25154,"replication_time_us":289144,"thread_start_us":157694,"threads_started":2}]]}
I20260709 13:08:46.331626 16562 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:46.333530 16631 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:46.333439 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:46.347891 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea00d3379945fd9f9d98c82429c8d5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:46.349817 22684 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.338261 22669 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:46.350780 22669 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:46.352679 22669 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:46.353931 22218 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.354980 22581 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:46.367573 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:46.373452 22579 consensus_queue.cc:260] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:46.374730 22579 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:46.346655 22596 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:08:46.389366 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 58053.7us
I20260709 13:08:46.392851 17183 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:46.393903 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.394654 16482 raft_consensus.cc:2393] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:46.395399 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.396112 22665 raft_consensus.cc:993] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:46.396539 22665 raft_consensus.cc:1081] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:46.396694 16486 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:46.398175 17188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48054
I20260709 13:08:46.398664 17188 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.398995 17188 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.399207 22563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40216 (request call id 93) took 3516 ms. Trace:
I20260709 13:08:46.393925 16559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:46.402066 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 58348.3us
I20260709 13:08:46.399587 22563 rpcz_store.cc:276] 0709 13:08:42.883109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.883235 (+   126us) service_pool.cc:224] Handling call
0709 13:08:42.918471 (+ 35236us) log.cc:844] Serialized 480 byte log entry
0709 13:08:43.588103 (+669632us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d93a0a 00007f0634d93693 00007f0634d93631 00007f06364c7b52 00007f06364c7cf5 00007f0636404691 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69
0709 13:08:44.355785 (+767682us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b180032afc0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f06364c7d01 00007f0636404691 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69 00007f06363ebc31 00007f06363eadfd 000000000038f354 000000000038f199
0709 13:08:46.399097 (+2043312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15931,"raft.queue_time_us":73730,"raft.run_cpu_time_us":53424,"raft.run_wall_time_us":2006965,"spinlock_wait_cycles":1273000064,"thread_start_us":410938,"threads_started":2,"wal-append.queue_time_us":197101,"wal-append.run_cpu_time_us":11425,"wal-append.run_wall_time_us":1316063}
I20260709 13:08:46.403113 22573 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:46.403672 16456 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.405158 16486 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:46.405882 22563 raft_consensus.cc:3055] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:46.406242 22563 raft_consensus.cc:740] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:46.408089 22563 consensus_queue.cc:260] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.408563 22582 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.409508 22650 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:46.410799 17188 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.411430 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.412978 16489 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:46.412853 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:46.435179 16487 raft_consensus.cc:606] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.411460 16490 raft_consensus.cc:1275] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:46.426590 16631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:46.419828 22147 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:08:46.434012 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:46.428100 16632 raft_consensus.cc:1275] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:46.416113 16561 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:46.438017 16374 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8c27c31776b4e60afb061384a2ea62e with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:46.438274 17188 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:46.430526 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:46.440549 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:46.441183 16482 raft_consensus.cc:2393] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 15: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:46.441869 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:46.443056 16482 raft_consensus.cc:1275] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:46.445027 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:46.445534 16557 raft_consensus.cc:3055] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:46.445839 16604 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.445817 16557 raft_consensus.cc:740] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:46.449576 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:46.434100 16389 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 20 to 22, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 22 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.450397 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:46.450824 16490 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.451079 16389 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 19 to 21, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 21 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.452543 16389 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:46.453460 16482 raft_consensus.cc:1275] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:46.432999 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.455703 16604 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:46.465049 16454 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.429816 22675 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:46.468621 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.471192 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.454111 16389 catalog_manager.cc:5697] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 15 to 16, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:46.476034 17181 raft_consensus.cc:1240] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:46.477002 22665 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:46.470302 22591 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.478595 17188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:46.481227 16389 catalog_manager.cc:5697] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 11, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 11 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:46.483238 16482 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:46.486717 16389 catalog_manager.cc:5697] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 16, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:46.489867 16605 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:46.466922 22653 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:46.490722 16389 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 16 to 18, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 18 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:46.462116 22563 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.487483 16557 consensus_queue.cc:260] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.478893 22567 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:46.513279 17184 raft_consensus.cc:1275] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 13:08:46.494269 16605 raft_consensus.cc:2686] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:46.480695 22679 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.515681 16490 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:46.516454 16486 raft_consensus.cc:1240] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:46.517684 17152 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:46.521724 16557 raft_consensus.cc:3060] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.489684 22587 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.526010 16491 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:46.524004 16560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:46.526902 16560 raft_consensus.cc:606] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.525066 16631 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:46.486824 22596 consensus_queue.cc:1048] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:46.492054 22593 consensus_queue.cc:1048] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:46.499858 22352 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:46.554405 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.545912 22358 raft_consensus.cc:2804] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:46.532481 22378 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:08:46.590163 16639 raft_consensus.cc:1275] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:46.568730 22668 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:46.570959 22588 consensus_queue.cc:1048] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
W20260709 13:08:46.620398 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 66072.5us
I20260709 13:08:46.592478 22425 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:08:46.641021 16454 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.645392 22147 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:46.593839 22264 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.600140 22587 consensus_queue.cc:1048] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:08:46.607612 22585 consensus_queue.cc:1048] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:08:46.646833 22620 log.cc:927] Time spent T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:08:46.663604 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 90744.4us
I20260709 13:08:46.666224 22609 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:46.686947 16632 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:46.656225 22663 consensus_queue.cc:1048] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:08:46.696377 22701 log.cc:927] Time spent T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:08:46.706851 22579 raft_consensus.cc:993] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:46.707319 22579 raft_consensus.cc:1081] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
W20260709 13:08:46.697054 22700 log.cc:927] Time spent T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:46.697517 22696 log.cc:927] Time spent T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:08:46.685341 22694 log.cc:927] Time spent T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:08:46.722544 22706 log.cc:927] Time spent T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.058s	user 0.000s	sys 0.003s
I20260709 13:08:46.724375 16485 raft_consensus.cc:2410] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:08:46.729316 16557 raft_consensus.cc:2468] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:46.734059 16488 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:46.765096 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40234 (request call id 3067) took 1140 ms. Trace:
I20260709 13:08:46.765486 16488 rpcz_store.cc:276] 0709 13:08:45.624706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.635919 (+ 11213us) service_pool.cc:224] Handling call
0709 13:08:46.764943 (+1129024us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400289e54. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063648f2fa 00007f063b450b17 00007f06349cb6d4 00007f06349cb662 00007f06349cb591 00007f06349cb50c 00007f06349ca7c2 00007f06347c648c 00007f06347c58c6 00007f06347c526f
0709 13:08:46.765041 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429318400}
W20260709 13:08:46.766217 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 121336us
W20260709 13:08:46.775317 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 121525us
I20260709 13:08:46.776278 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:46.766451 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 155851us
I20260709 13:08:46.780666 17183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:08:46.781221 17183 raft_consensus.cc:493] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.781878 17183 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.781214 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:46.763622 22358 raft_consensus.cc:697] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:46.768694 22711 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.811923 22711 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.814097 22711 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:46.816963 22679 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.818332 16636 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:46.818054 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:46.818162 22713 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:46.802135 22599 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:46.824776 16560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da035835f764425db56e9649db0a0bcc"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:46.825640 16560 raft_consensus.cc:606] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:46.826035 16560 raft_consensus.cc:614] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:46.827821 22667 ts_tablet_manager.cc:1929] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 13:08:46.828382 22667 log.cc:1199] T ca9e6e3a4a404a9893a40afed3d0179f P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/ca9e6e3a4a404a9893a40afed3d0179f
I20260709 13:08:46.825448 22599 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:46.830026 22599 raft_consensus.cc:3060] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.830626 22667 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55922 (request call id 8) took 1178 ms. Trace:
I20260709 13:08:46.831764 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:46.833490 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:46.830983 22667 rpcz_store.cc:276] 0709 13:08:45.651869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.653918 (+  2049us) service_pool.cc:224] Handling call
0709 13:08:45.867074 (+213156us) ts_tablet_manager.cc:1151] Deleting tablet ca9e6e3a4a404a9893a40afed3d0179f
0709 13:08:45.867160 (+    86us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:46.453532 (+586372us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:46.827666 (+374134us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:46.830552 (+  2886us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391783,"tablet-delete.queue_time_us":174267,"thread_start_us":141465,"threads_started":1}
I20260709 13:08:46.835318 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet ca9e6e3a4a404a9893a40afed3d0179f (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
W20260709 13:08:46.835945 22695 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.277s	user 0.000s	sys 0.003s
I20260709 13:08:46.847229 22588 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:46.848623 22358 consensus_queue.cc:237] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.853531 17183 raft_consensus.cc:515] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:46.882404 16485 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:46.878929 22596 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:08:46.921406 22652 raft_consensus.cc:3055] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:46.957933 22652 raft_consensus.cc:740] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:46.953100 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:46.962584 16560 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 18.
I20260709 13:08:46.890358 22703 consensus_queue.cc:1059] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:08:47.018972 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 98053.1us
I20260709 13:08:47.029495 17183 leader_election.cc:290] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.038431 22599 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.043141 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:47.052346 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:47.052924 16490 raft_consensus.cc:3055] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:47.053241 16490 raft_consensus.cc:740] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:47.053995 16490 consensus_queue.cc:260] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.061386 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:47.061517 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:47.062096 16639 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.062107 16560 raft_consensus.cc:2393] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 15: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:47.066159 22599 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:47.066756 16483 raft_consensus.cc:2468] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:47.066942 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:47.067780 22727 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:47.067900 16604 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:47.068210 22727 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.068557 22727 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:47.071770 17187 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:47.076077 22727 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.078655 22727 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.078285 17187 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:47.080958 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:47.087152 16455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.124755 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82af48cecc58434e959547ec318fa4c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:47.125384 16560 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.124099 16633 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:47.120085 22653 raft_consensus.cc:2804] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:47.177843 16560 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:47.200220 17185 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:47.206545 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 118560us
I20260709 13:08:47.211813 16558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:47.212384 16558 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:47.183529 22606 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:08:47.234701 22599 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:47.236148 22587 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:47.236517 22587 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:47.188913 22653 raft_consensus.cc:697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:47.237291 22587 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.238142 22653 consensus_queue.cc:237] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.238658 22587 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:47.240698 22730 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:08:47.252118 16558 raft_consensus.cc:2468] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 19.
I20260709 13:08:46.975220 22485 raft_consensus.cc:2955] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 11 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:47.254316 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 46062.3us
I20260709 13:08:47.262413 17153 leader_election.cc:304] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:47.280426 16639 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:47.281126 16634 raft_consensus.cc:1240] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:47.283771 17152 leader_election.cc:304] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:47.293633 22652 consensus_queue.cc:260] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.294886 22652 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.271656 22721 raft_consensus.cc:2804] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:47.304513 16489 raft_consensus.cc:1275] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:47.307397 16486 raft_consensus.cc:1240] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer f842280ae2ac4c68b0b7f6c093e27357 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:47.323412 16490 raft_consensus.cc:3060] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.309290 22319 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:47.312680 22606 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:47.323602 22358 raft_consensus.cc:2804] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:47.325687 22721 raft_consensus.cc:697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 19 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:47.345466 22358 raft_consensus.cc:697] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:47.346341 22358 consensus_queue.cc:237] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.349841 16490 raft_consensus.cc:2468] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 13.
I20260709 13:08:47.333122 22319 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.361562 22319 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.365029 22721 consensus_queue.cc:237] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.327296 22728 consensus_queue.cc:1048] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:08:47.338284 22606 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.377887 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:47.379001 22606 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.384893 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.385229 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:47.385917 16487 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 22.
I20260709 13:08:47.405782 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:47.406692 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.412626 16635 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 22: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:47.411549 22665 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:47.419876 22485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41626 (request call id 12) took 1826 ms. Trace:
I20260709 13:08:47.432089 22485 rpcz_store.cc:276] 0709 13:08:45.586777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.586894 (+   117us) service_pool.cc:224] Handling call
0709 13:08:45.828456 (+241562us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b58007f70d0. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f06363e70aa 00007f0636469447 00007f063648670a 00007f063648776a 00007f063648691b 00007f063649203c 00007f06364916b3 00007f06364899fa 00007f063b4514c9 00007f06349cdc54
0709 13:08:45.832526 (+  4070us) log.cc:844] Serialized 480 byte log entry
0709 13:08:46.191524 (+358998us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b180023ba80. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f063c266de1 00007f063c2735b1 00007f063336c2a6 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063640bb26 00007f063640549a 00007f0636404714
0709 13:08:46.315906 (+124382us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b54003cc420. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f0636404142 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69 00007f06363ebc31 00007f06363eadfd 000000000038f354 000000000038f199 00007f063339e475
0709 13:08:46.391067 (+ 75161us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b54003cc420. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f063640bb26 00007f063640549a 00007f0636404714 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69 00007f06363ebc31 00007f06363eadfd 000000000038f354
0709 13:08:47.411723 (+1020656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50228,"raft.queue_time_us":56630,"raft.run_cpu_time_us":12866,"raft.run_wall_time_us":757133,"spinlock_wait_cycles":39723648,"thread_start_us":85691,"threads_started":1,"wal-append.queue_time_us":159456,"wal-append.run_cpu_time_us":2215,"wal-append.run_wall_time_us":1114164}
W20260709 13:08:47.434626 22738 log.cc:927] Time spent T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:47.448227 16636 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:47.429652 22665 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:47.454912 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f61b94df305e465c9e3aae1bf4931b69 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:47.459916 22665 raft_consensus.cc:3060] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:47.452468 22652 raft_consensus.cc:493] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:47.465127 22652 raft_consensus.cc:515] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.467132 22652 leader_election.cc:290] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.473745 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:47.477372 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e83e5333143e393eb71aac8666e63" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:47.477986 16562 raft_consensus.cc:2368] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19.
I20260709 13:08:47.478914 16605 leader_election.cc:400] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19.
I20260709 13:08:47.479202 16605 leader_election.cc:403] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.482103 22652 raft_consensus.cc:3060] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:47.504436 22679 raft_consensus.cc:993] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:47.516877 22581 raft_consensus.cc:1081] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Signalling peer f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:47.518563 16634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:35430
I20260709 13:08:47.519109 16634 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.519431 16634 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.525982 16634 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.533869 16634 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:47.536103 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:47.536664 16557 raft_consensus.cc:3055] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:47.536958 16557 raft_consensus.cc:740] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:47.537623 16557 consensus_queue.cc:260] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.535228 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:47.539320 16487 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.549887 22714 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.550396 22714 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.562919 16639 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:47.565656 16487 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:47.567116 16604 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:47.568035 22378 raft_consensus.cc:2804] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:47.568506 22378 raft_consensus.cc:697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:47.569285 22378 consensus_queue.cc:237] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.569424 22665 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.571367 22665 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 22 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.577170 16491 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:47.583302 22728 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:47.602119 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:47.602821 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:47.601406 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:47.603622 16635 raft_consensus.cc:2393] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 22: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:47.610527 22758 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:47.610910 22758 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:47.611248 22758 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.614205 22714 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.618098 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:47.618701 17183 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:47.618710 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:47.624459 16454 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:47.626035 22691 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:47.626411 22691 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.626776 22691 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.641110 16488 raft_consensus.cc:1240] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Rejecting Update request from peer 035eaa2f12374a81a4df7868a5453d3c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:47.619125 22652 raft_consensus.cc:2749] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19.
I20260709 13:08:47.649454 22264 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.649940 22264 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.653213 22264 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.655164 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:47.656018 16488 raft_consensus.cc:2410] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:08:47.656761 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.657330 16635 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:47.663271 22691 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.669998 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:47.670467 22758 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.673671 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:47.674319 17183 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 17: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:47.674574 22747 consensus_queue.cc:1059] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:47.677572 22747 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.678013 22747 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.679893 22747 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.682008 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:47.693104 16557 raft_consensus.cc:3060] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.693910 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:47.694491 16560 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:47.696827 16560 raft_consensus.cc:1275] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:47.695587 22758 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:47.700901 22761 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
I20260709 13:08:47.788458 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.789256 16636 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 12.
I20260709 13:08:47.793929 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 277) took 1925 ms. Trace:
I20260709 13:08:47.794379 16389 rpcz_store.cc:276] 0709 13:08:45.868123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.868278 (+   155us) service_pool.cc:224] Handling call
0709 13:08:47.793840 (+1925562us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:46.534257 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:46.534818 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:46.534852 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:46.534869 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:46.535672 (+   803us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:46.535742 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:46.535778 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:08:46.536394 (+   616us) tablet.cc:701] Row locks acquired
0709 13:08:46.536415 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:46.536548 (+   133us) write_op.cc:270] Start()
0709 13:08:46.536656 (+   108us) write_op.cc:276] Timestamp: P: 1783602526536497 usec, L: 0
0709 13:08:46.536676 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:46.537347 (+   671us) log.cc:844] Serialized 2792 byte log entry
0709 13:08:47.056075 (+518728us) op_driver.cc:464] REPLICATION: finished
0709 13:08:47.160032 (+103957us) write_op.cc:301] APPLY: starting
0709 13:08:47.160112 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:47.163912 (+  3800us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:47.164001 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:47.235627 (+ 71626us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:47.258451 (+ 22824us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:08:47.258505 (+    54us) write_op.cc:312] APPLY: finished
0709 13:08:47.303891 (+ 45386us) log.cc:844] Serialized 73 byte log entry
0709 13:08:47.312918 (+  9027us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:47.321337 (+  8419us) write_op.cc:454] Released schema lock
0709 13:08:47.323050 (+  1713us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:47.342948 (+ 19898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:47.344072 (+  1124us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72997,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":103700,"apply.run_cpu_time_us":10108,"apply.run_wall_time_us":175949,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":21570,"prepare.run_cpu_time_us":6713,"prepare.run_wall_time_us":14114,"replication_time_us":453609,"thread_start_us":79691,"threads_started":2}]]}
I20260709 13:08:47.800061 22581 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.800647 22581 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.801764 16488 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:47.803133 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:47.803280 22581 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.805064 22691 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.805819 22691 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.806344 22691 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.806958 16557 raft_consensus.cc:2468] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:47.851661 22691 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.853729 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.854322 16636 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:47.854899 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.857512 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:47.859185 22579 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:47.859582 22579 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.859962 22579 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.807962 22378 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:47.812819 16386 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.813793 16560 raft_consensus.cc:1275] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:47.863083 22581 raft_consensus.cc:493] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.863529 22581 raft_consensus.cc:515] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.865144 16386 catalog_manager.cc:5697] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.821451 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:47.866914 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45536.8us
I20260709 13:08:47.867151 16386 catalog_manager.cc:5697] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.868448 22558 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:47.868891 22558 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.869282 22558 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.869506 16386 catalog_manager.cc:5697] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.871224 16386 catalog_manager.cc:5697] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 12, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 12 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:47.872938 16487 raft_consensus.cc:2468] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 22.
I20260709 13:08:47.837529 16633 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:47.847857 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:47.882113 17183 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.881927 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:47.882094 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:47.884256 17184 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:47.883484 16485 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:47.849804 16635 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:47.873373 16386 catalog_manager.cc:5697] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.876150 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.828236 17153 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:47.891841 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:47.891757 16634 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:47.880676 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
W20260709 13:08:47.896070 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 67911.2us
I20260709 13:08:47.898815 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:47.901961 17183 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:47.903275 22710 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:47.903749 22710 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.904112 22710 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.894981 22385 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:47.907474 22385 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 17 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:47.899374 17184 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:47.908286 22385 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.883886 22652 consensus_queue.cc:1048] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:08:47.925755 16454 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:47.933485 22579 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.937316 22579 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.937830 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:47.943760 16530 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:47.940444 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:47.944308 16634 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.931726 22758 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:47.949993 22758 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:47.950839 22758 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.952730 22715 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.953047 22610 raft_consensus.cc:2804] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:47.953557 22610 raft_consensus.cc:697] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 22 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:47.954579 22715 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.952809 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:47.956579 22715 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.954317 22610 consensus_queue.cc:237] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.959393 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:47.959992 16557 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:47.961506 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:47.962332 22679 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:47.962723 22679 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.963028 22679 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.964509 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df4eab2c270411ebedb43bc97966c7f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.964902 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.965474 16639 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:47.966856 22715 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:47.967253 22715 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.928025 22670 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:47.967926 22218 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:47.968183 22670 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.968442 22218 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:47.970023 22714 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:47.970768 22670 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.929817 22721 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:08:47.970489 22714 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:47.971272 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.944465 17184 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.972827 22714 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.973742 16530 leader_election.cc:304] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:47.974081 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:47.974110 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:47.976217 16639 raft_consensus.cc:2393] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 12: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:47.977068 16454 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:47.976989 16561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:47.977891 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:47.981024 16634 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:47.982108 16455 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:47.982874 17184 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:47.929090 22581 leader_election.cc:290] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:47.967653 22715 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.989971 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:47.970377 22218 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:47.991780 22670 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:47.988776 22675 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:47.991453 22717 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.990589 22679 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:48.008716 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 89239us
I20260709 13:08:48.000993 22665 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:48.000664 22385 raft_consensus.cc:493] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.017120 16557 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:48.008248 22670 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:48.001997 22710 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:48.026784 16485 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:48.021538 22747 raft_consensus.cc:2749] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.029753 22721 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:48.014741 22665 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.008154 22717 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.037228 22717 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:48.036899 22670 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:48.041155 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:48.041837 16639 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 13.
I20260709 13:08:48.041157 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:48.043138 16557 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 12.
I20260709 13:08:48.045673 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:48.048069 22579 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:48.048436 22579 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.048738 22579 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:48.055053 22558 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.011232 22264 consensus_queue.cc:1048] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:08:48.061316 16562 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:48.072364 16561 raft_consensus.cc:2368] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13.
I20260709 13:08:48.079412 22710 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:48.071065 22378 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:08:48.083382 16456 leader_election.cc:400] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13.
I20260709 13:08:48.083738 16456 leader_election.cc:403] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:48.084746 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:48.085697 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:48.086247 16633 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.089123 22714 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:48.100734 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:48.132448 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:48.133240 17184 raft_consensus.cc:2368] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:48.134946 16633 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:48.017499 22385 raft_consensus.cc:515] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:48.137816 22768 log.cc:927] Time spent T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:08:48.156764 16487 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.117846 22715 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.172681 16487 raft_consensus.cc:2410] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:08:48.159540 22774 log.cc:927] Time spent T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:48.176810 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:48.180894 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:48.181442 16557 raft_consensus.cc:3060] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.190292 16529 leader_election.cc:400] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
I20260709 13:08:48.190619 16529 leader_election.cc:403] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:48.192415 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:48.193045 16483 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.202507 16557 raft_consensus.cc:2468] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:48.212549 16633 raft_consensus.cc:1275] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:48.216572 22665 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:48.227519 22679 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:48.195911 22218 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:08:48.240571 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 44890.5us
I20260709 13:08:48.244303 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:48.244853 17184 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.244994 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:48.245563 16557 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.249213 17184 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:48.251104 16483 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
W20260709 13:08:48.251853 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 54322.5us
I20260709 13:08:48.189538 22579 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.251521 16557 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:48.272282 16490 raft_consensus.cc:1275] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:48.273519 16485 raft_consensus.cc:2368] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:48.254464 22558 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:48.241815 22588 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:08:48.289321 22385 leader_election.cc:290] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:48.312875 22579 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:48.314159 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:48.314733 16557 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:08:48.318246 22777 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 13:08:48.320043 22653 consensus_queue.cc:1048] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:48.322466 16557 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:48.328346 16456 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:48.334381 16456 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:48.341264 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:48.341987 16633 raft_consensus.cc:2393] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 13: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:08:48.342468 17153 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:48.347245 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:48.347882 16633 raft_consensus.cc:3060] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.331979 22691 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.347548 22579 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:48.365724 16633 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:48.356045 22358 raft_consensus.cc:2804] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.379348 16563 raft_consensus.cc:1275] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:48.387368 16530 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:48.388434 16530 leader_election.cc:400] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:48.388743 16530 leader_election.cc:403] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:48.358022 22691 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:48.361604 22714 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831) with higher term. Message: Invalid argument: T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 for earlier term 12. Current term is 13.
I20260709 13:08:48.378584 22579 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:48.378480 22715 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:48.404348 22778 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 13:08:48.394400 22679 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 13. Current term is 14.
I20260709 13:08:48.395422 22688 raft_consensus.cc:2804] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:48.410363 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 156181us
I20260709 13:08:48.413379 22671 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.448866 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:48.449515 16639 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.407400 22358 raft_consensus.cc:697] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:48.452591 22691 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.460945 16639 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 16.
I20260709 13:08:48.472576 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:48.482205 16633 raft_consensus.cc:2393] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 359213375db14f3d874c121993f90d76 in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:48.484792 22568 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.485299 22568 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.489519 22218 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223) with higher term. Message: Invalid argument: T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c for earlier term 15. Current term is 16.
W20260709 13:08:48.492228 22786 log.cc:927] Time spent T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:08:48.493376 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:48.493134 22579 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:48.493932 16635 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:48.494495 22358 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:48.473563 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34e55d2ce67443aaecb395469a9c7ce" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:48.443967 22688 raft_consensus.cc:697] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:48.498224 16563 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:48.499190 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:48.500185 16633 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:48.522828 16635 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:48.531802 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:48.532366 16635 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:48.536437 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 63413.7us
I20260709 13:08:48.539990 16483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a943513f89492ba24cbf67180d01f3" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:48.540766 16483 raft_consensus.cc:2410] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:08:48.541071 16635 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
I20260709 13:08:48.506327 22568 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:48.545214 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 149230us
I20260709 13:08:48.497865 22688 consensus_queue.cc:237] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:48.446502 22671 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:48.529135 22675 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:08:48.544766 22728 consensus_queue.cc:1048] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:08:48.686852 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 135234us
W20260709 13:08:48.696972 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 153192us
I20260709 13:08:48.710536 17181 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:48.714802 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 163572us
I20260709 13:08:48.712551 22588 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.733969 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:48.766587 16491 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 13.
W20260709 13:08:48.768050 22790 log.cc:927] Time spent T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:08:48.772022 22781 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:48.772353 22799 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:48.773566 22671 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:48.756832 22588 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:48.778236 22588 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:48.786976 22781 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:48.787925 22781 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:48.803084 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45045.8us
W20260709 13:08:48.807502 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 118565us
I20260709 13:08:48.808739 16604 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:08:48.841686 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 293909us
I20260709 13:08:48.829842 22568 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:48.852965 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 99470.4us
I20260709 13:08:48.854077 16455 leader_election.cc:304] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:48.854959 16635 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:08:48.855859 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 306543us
I20260709 13:08:48.859112 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:48.859572 16634 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:48.867240 22812 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:48.864295 22785 consensus_queue.cc:1048] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:48.858130 22799 raft_consensus.cc:2749] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.879829 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:48.930699 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:48.931555 17187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:48.933904 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:48.935500 17187 raft_consensus.cc:2393] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 16: Already voted for candidate 359213375db14f3d874c121993f90d76 in this term.
I20260709 13:08:48.939548 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:48.940075 16557 raft_consensus.cc:1813] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Handling vote request from an unknown peer f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:48.940495 16557 raft_consensus.cc:2410] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:08:48.947672 16488 raft_consensus.cc:1275] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:08:48.938009 22802 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:48.972224 22746 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:48.984531 16603 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:48.956465 22802 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.996605 22802 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.005265 16638 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:48.998287 22794 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:49.025606 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 73392.4us
W20260709 13:08:49.062278 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 126423us
I20260709 13:08:49.079217 17187 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:49.086313 17183 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:49.069947 22804 consensus_queue.cc:1048] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:08:49.025501 22801 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
W20260709 13:08:49.108476 22822 log.cc:927] Time spent T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:49.140448 16565 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:49.141901 22823 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:49.180208 16564 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:49.000766 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.148478 22802 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:49.190763 16491 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:08:49.191146 16491 pending_rounds.cc:85] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Aborting all ops after (but not including) 10
I20260709 13:08:49.191359 16491 pending_rounds.cc:107] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 14.11
I20260709 13:08:49.191779 16633 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:49.213280 16491 raft_consensus.cc:2917] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Aborting config change with OpId 14.11: Aborted: Op aborted by new leader
I20260709 13:08:49.213778 16491 raft_consensus.cc:2889] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:49.221269 17186 raft_consensus.cc:1240] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Rejecting Update request from peer 359213375db14f3d874c121993f90d76 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:08:49.215675 22758 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:08:49.242395 22802 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:49.189744 22579 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:08:49.192962 22385 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:49.251132 16491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40216 (request call id 92) took 6373 ms. Trace:
I20260709 13:08:49.252940 16633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:49.254551 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:49.322062 22794 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:49.267575 22787 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:08:49.329625 22835 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:08:49.336434 16634 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:49.337693 17183 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:49.341084 22485 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:49.346881 16633 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:49.347152 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 132083us
I20260709 13:08:49.254932 16491 rpcz_store.cc:276] 0709 13:08:42.880288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.880402 (+   114us) service_pool.cc:224] Handling call
0709 13:08:43.011023 (+130621us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d93a0a 00007f0634d93693 00007f0634d93631 00007f06364c6902 00007f06364c66dd 00007f0636491f3f 00007f06364916b3 00007f06364899fa 00007f063b4514c9 00007f06349cdc54
0709 13:08:43.039782 (+ 28759us) log.cc:844] Serialized 480 byte log entry
0709 13:08:43.972658 (+932876us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d93a0a 00007f0634d93693 00007f0634d93631 00007f06364c7b52 00007f06364c7cf5 00007f0636404691 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69
0709 13:08:44.260207 (+287549us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b2c000014c8. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f0634d84a11 00007f0634d93a0a 00007f0634d93693 00007f0634d93631 00007f06364c7b52 00007f06364c7cf5 00007f0636404691 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69
0709 13:08:44.260758 (+   551us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b18002e2480. stack: 00007f063336c343 00007f063336c240 00007f0632cfb1d4 00007f063ca39304 00007f063ca39299 00007f06363f4571 00007f06364c7d01 00007f0636404691 00007f06363e4eaa 00007f06363ebd53 00007f06363ebcd9 00007f06363ebc69 00007f06363ebc31 00007f06363eadfd 000000000038f354 000000000038f199
0709 13:08:49.248144 (+4987386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18782,"raft.queue_time_us":256320,"raft.run_cpu_time_us":9931,"raft.run_wall_time_us":1619014,"spinlock_wait_cycles":1369716736,"thread_start_us":213937,"threads_started":1,"wal-append.queue_time_us":382468,"wal-append.run_cpu_time_us":1555,"wal-append.run_wall_time_us":1001810}
W20260709 13:08:49.370632 22837 log.cc:927] Time spent T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.153s	user 0.007s	sys 0.008s
I20260709 13:08:49.370855 22782 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:49.374749 16491 raft_consensus.cc:1275] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:49.375931 22828 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.315s	user 0.009s	sys 0.003s
W20260709 13:08:49.376302 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d34e55d2ce67443aaecb395469a9c7ce with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:08:49.378834 16486 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:49.383682 22834 log.cc:927] Time spent T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.159s	user 0.005s	sys 0.006s
I20260709 13:08:49.384867 22758 consensus_queue.cc:1059] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:49.385737 22758 raft_consensus.cc:3055] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:49.386157 22758 raft_consensus.cc:740] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:49.386988 22758 consensus_queue.cc:260] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:49.388259 22758 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.393545 22781 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:49.413033 22688 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:49.416275 16385 catalog_manager.cc:5697] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.424078 22658 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.424625 22658 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:49.441617 16635 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:49.442673 22658 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:49.443148 16634 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:49.427222 22688 consensus_queue.cc:1048] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:49.443181 22812 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:49.453445 16385 catalog_manager.cc:5697] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 18 to 20, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 20 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.455716 16385 catalog_manager.cc:5697] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.457541 16385 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.444921 22670 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:08:49.464293 16386 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52658 (request call id 290) took 3836 ms. Trace:
I20260709 13:08:49.472424 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:49.473482 16385 catalog_manager.cc:5697] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 15 to 17, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.480113 22588 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:49.486078 16385 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.491683 16564 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:49.499675 22812 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:49.521335 16565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:49.534217 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:49.537835 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:49.538446 16632 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:49.472276 16386 rpcz_store.cc:276] 0709 13:08:45.628370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.628674 (+   304us) service_pool.cc:224] Handling call
0709 13:08:49.464236 (+3835562us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:48.114678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:48.127269 (+ 12591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:48.127302 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:08:48.127319 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:48.127979 (+   660us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:48.128027 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:48.128051 (+    24us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:48.128589 (+   538us) tablet.cc:701] Row locks acquired
0709 13:08:48.128608 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:48.128732 (+   124us) write_op.cc:270] Start()
0709 13:08:48.128834 (+   102us) write_op.cc:276] Timestamp: P: 1783602528128691 usec, L: 0
0709 13:08:48.128854 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:48.129408 (+   554us) log.cc:844] Serialized 2390 byte log entry
0709 13:08:48.512733 (+383325us) op_driver.cc:464] REPLICATION: finished
0709 13:08:48.907997 (+395264us) write_op.cc:301] APPLY: starting
0709 13:08:48.908071 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:48.911626 (+  3555us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:48.911722 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:48.917591 (+  5869us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:48.917812 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:48.917853 (+    41us) write_op.cc:312] APPLY: finished
0709 13:08:48.918097 (+   244us) log.cc:844] Serialized 65 byte log entry
0709 13:08:48.918255 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.918905 (+   650us) write_op.cc:454] Released schema lock
0709 13:08:48.918958 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:48.929238 (+ 10280us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.934236 (+  4998us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121079,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":380392,"apply.run_cpu_time_us":8578,"apply.run_wall_time_us":16622,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":155360,"prepare.run_cpu_time_us":2990,"prepare.run_wall_time_us":30826,"replication_time_us":342368,"thread_start_us":371700,"threads_started":2}]]}
I20260709 13:08:49.563745 22721 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:49.571414 16491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:49.572000 16491 raft_consensus.cc:606] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:49.572340 16491 raft_consensus.cc:614] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.574054 17152 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:49.574851 16564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:49.575403 16564 raft_consensus.cc:606] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:49.578589 16639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:08:49.579084 16639 raft_consensus.cc:606] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:49.579388 16639 raft_consensus.cc:614] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.592660 16491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:49.593214 16491 raft_consensus.cc:606] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Received request to transfer leadership to TS 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:49.618799 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 44815.6us
I20260709 13:08:49.632804 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecb26c2b33364a6583c0073862883947"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:49.633391 16488 raft_consensus.cc:606] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Received request to transfer leadership to TS f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:49.635484 17183 raft_consensus.cc:2955] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:49.692124 22849 log.cc:927] Time spent T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:08:49.696034 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec"
dest_uuid: "359213375db14f3d874c121993f90d76"
mode: GRACEFUL
new_leader_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:08:49.696699 16487 raft_consensus.cc:606] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 LEADER]: Received request to transfer leadership to TS 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:08:49.716287 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:49.720168 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:49.737790 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 101699us
W20260709 13:08:49.764153 22852 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:49.775810 22776 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:49.788275 22846 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:08:49.805434 22851 log.cc:927] Time spent T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:08:49.790084 22853 log.cc:927] Time spent T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:08:49.905172 22861 log.cc:927] Time spent T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:08:49.937884 22803 raft_consensus.cc:993] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: : Instructing follower 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:49.938344 22803 raft_consensus.cc:1081] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 LEADER]: Signalling peer 035eaa2f12374a81a4df7868a5453d3c to start an election
I20260709 13:08:49.950088 16557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
 from {username='slave'} at 127.0.0.1:55186
I20260709 13:08:49.950587 16557 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:49.950923 16557 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:49.964800 16557 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:49.984998 22807 raft_consensus.cc:993] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:49.985468 22807 raft_consensus.cc:1081] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:49.997777 16557 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 23 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:50.008498 22670 raft_consensus.cc:993] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: : Instructing follower f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:50.009004 22670 raft_consensus.cc:1081] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Signalling peer f842280ae2ac4c68b0b7f6c093e27357 to start an election
I20260709 13:08:50.016021 16635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecb26c2b33364a6583c0073862883947"
dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
 from {username='slave'} at 127.0.0.1:35424
I20260709 13:08:50.016570 16635 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.016928 16635 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.032779 17184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48048
I20260709 13:08:50.040287 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:50.040848 16485 raft_consensus.cc:3055] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:50.041119 16485 raft_consensus.cc:740] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:50.043668 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f595b7864d413a8f05d3b5e1f50aec" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:50.044212 16639 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:50.044251 16635 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:50.048485 16485 consensus_queue.cc:260] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:50.067970 16485 raft_consensus.cc:3060] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:50.081766 16485 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 23.
I20260709 13:08:50.086061 16635 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:50.087119 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 45278.8us
I20260709 13:08:50.089305 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:50.089922 16491 raft_consensus.cc:3055] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:50.090209 16491 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:50.096802 22218 raft_consensus.cc:993] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:50.098004 22688 raft_consensus.cc:1081] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Signalling peer 16b5b367990f4b5c862484bdec0b9226 to start an election
I20260709 13:08:50.100889 16491 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:50.102128 16491 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.093116 16639 raft_consensus.cc:2468] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 23.
I20260709 13:08:50.111491 16530 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:50.112840 22558 raft_consensus.cc:2804] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:50.115615 22558 raft_consensus.cc:697] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 23 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:50.116451 22558 consensus_queue.cc:237] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:50.126163 16491 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:50.127477 16604 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:50.129899 17184 raft_consensus.cc:493] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.130326 17184 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:50.132406 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 45134.9us
I20260709 13:08:50.137884 17184 raft_consensus.cc:515] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.144948 17184 leader_election.cc:290] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:50.136129 22783 raft_consensus.cc:2804] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:50.147306 22783 raft_consensus.cc:697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:50.148176 22783 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:50.159993 17184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
 from {username='slave'} at 127.0.0.1:48054
I20260709 13:08:50.160542 17184 raft_consensus.cc:493] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.160935 17184 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.162158 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:50.162708 16557 raft_consensus.cc:3060] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.163036 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "359213375db14f3d874c121993f90d76"
I20260709 13:08:50.164413 16635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0cddf61354438cac7dda825626e2c5" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:50.164969 16635 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:50.163609 16485 raft_consensus.cc:3055] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:50.165635 16485 raft_consensus.cc:740] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:50.166458 16485 consensus_queue.cc:260] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.171610 16557 raft_consensus.cc:2468] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:50.182430 22800 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:50.182916 22800 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.185503 22800 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:50.187354 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:50.189941 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:50.191586 16454 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:50.192396 22800 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:50.196689 16485 raft_consensus.cc:3060] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:50.209730 16485 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 19.
I20260709 13:08:50.216202 17152 leader_election.cc:304] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:50.216955 22728 raft_consensus.cc:2804] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:50.217427 22728 raft_consensus.cc:697] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 19 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:50.218226 22728 consensus_queue.cc:237] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.221769 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:50.232508 17184 raft_consensus.cc:515] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.235544 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:50.236166 16557 raft_consensus.cc:3055] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:50.236485 16557 raft_consensus.cc:740] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:50.237223 16557 consensus_queue.cc:260] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.238268 16557 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.242748 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d7c9def9a84db7a3a3e5199a328236" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:50.243286 16639 raft_consensus.cc:3060] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.248127 17184 leader_election.cc:290] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:50.247633 16557 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 20.
I20260709 13:08:50.249680 16639 raft_consensus.cc:2468] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 20.
I20260709 13:08:50.250428 17153 leader_election.cc:304] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:50.251142 22358 raft_consensus.cc:2804] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:50.251606 22358 raft_consensus.cc:697] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 20 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:50.252403 22358 consensus_queue.cc:237] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.262346 16635 raft_consensus.cc:2468] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 19.
I20260709 13:08:50.273538 16385 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 286) took 3839 ms. Trace:
I20260709 13:08:50.289060 16385 rpcz_store.cc:276] 0709 13:08:46.433749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.453761 (+ 20012us) service_pool.cc:224] Handling call
0709 13:08:50.273478 (+3819717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.670412 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.774536 (+104124us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.775989 (+  1453us) write_op.cc:435] Acquired schema lock
0709 13:08:49.777939 (+  1950us) tablet.cc:662] Decoding operations
0709 13:08:49.831234 (+ 53295us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.831291 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.831318 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:49.854904 (+ 23586us) tablet.cc:701] Row locks acquired
0709 13:08:49.855724 (+   820us) write_op.cc:260] PREPARE: finished
0709 13:08:49.872689 (+ 16965us) write_op.cc:270] Start()
0709 13:08:49.876564 (+  3875us) write_op.cc:276] Timestamp: P: 1783602529870384 usec, L: 0
0709 13:08:49.876582 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.901948 (+ 25366us) log.cc:844] Serialized 2413 byte log entry
0709 13:08:50.045288 (+143340us) op_driver.cc:464] REPLICATION: finished
0709 13:08:50.145824 (+100536us) write_op.cc:301] APPLY: starting
0709 13:08:50.145904 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:50.150091 (+  4187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:50.150184 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:50.210521 (+ 60337us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:50.210719 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:50.210761 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:50.210984 (+   223us) log.cc:844] Serialized 65 byte log entry
0709 13:08:50.211162 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.211315 (+   153us) write_op.cc:454] Released schema lock
0709 13:08:50.211361 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:50.275872 (+ 64511us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.275908 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":169753,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":100306,"apply.run_cpu_time_us":8426,"apply.run_wall_time_us":114329,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":124354,"prepare.run_cpu_time_us":4384,"prepare.run_wall_time_us":276800,"replication_time_us":167999,"thread_start_us":194028,"threads_started":2}]]}
I20260709 13:08:50.274003 16389 catalog_manager.cc:5697] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 20 to 22, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 22 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.293083 16389 catalog_manager.cc:5697] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 17 to 18, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 18 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.294489 16389 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 10 to 11, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 11 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:50.314903 16389 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 11 to 12, term changed from 14 to 16, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to <none>, VOTER f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) evicted. New cstate: current_term: 16 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.316948 16389 catalog_manager.cc:5697] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 14, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 14 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.318260 16389 catalog_manager.cc:5697] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 17 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.319698 16389 catalog_manager.cc:5697] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 17 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:50.390120 16374 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d34e55d2ce67443aaecb395469a9c7ce with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 359213375db14f3d874c121993f90d76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.458459 16625 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c27c31776b4e60afb061384a2ea62e with delete_type TABLET_DATA_TOMBSTONED (TS f842280ae2ac4c68b0b7f6c093e27357 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:55922
I20260709 13:08:50.481464 16389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52646 (request call id 278) took 2557 ms. Trace:
I20260709 13:08:50.483026 16389 rpcz_store.cc:276] 0709 13:08:47.924240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.924430 (+   190us) service_pool.cc:224] Handling call
0709 13:08:50.481402 (+2556972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:50.323591 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:50.328075 (+  4484us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:50.328108 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:08:50.328121 (+    13us) tablet.cc:662] Decoding operations
0709 13:08:50.328837 (+   716us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:50.328888 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:50.328914 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:08:50.329475 (+   561us) tablet.cc:701] Row locks acquired
0709 13:08:50.329490 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:08:50.329622 (+   132us) write_op.cc:270] Start()
0709 13:08:50.329739 (+   117us) write_op.cc:276] Timestamp: P: 1783602530329578 usec, L: 0
0709 13:08:50.329757 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:50.331020 (+  1263us) log.cc:844] Serialized 2743 byte log entry
0709 13:08:50.333301 (+  2281us) op_driver.cc:464] REPLICATION: finished
0709 13:08:50.333558 (+   257us) write_op.cc:301] APPLY: starting
0709 13:08:50.333635 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:50.337355 (+  3720us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:50.337420 (+    65us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:50.341152 (+  3732us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:50.341619 (+   467us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:08:50.341662 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:50.348932 (+  7270us) log.cc:844] Serialized 73 byte log entry
0709 13:08:50.349095 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.349197 (+   102us) write_op.cc:454] Released schema lock
0709 13:08:50.349239 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:50.349559 (+   320us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.349586 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4157,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":83,"apply.run_cpu_time_us":8152,"apply.run_wall_time_us":15953,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29260,"num_ops":7,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":3247,"prepare.run_wall_time_us":7688,"replication_time_us":3421}]]}
I20260709 13:08:50.494181 16388 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 11 to 13, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 19 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.499092 22876 tablet_replica.cc:333] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:08:50.500131 22876 raft_consensus.cc:2243] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.500907 22876 raft_consensus.cc:2272] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.517328 16388 catalog_manager.cc:5697] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 16 to 19, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 19 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.526463 16388 catalog_manager.cc:5697] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 8 to 10, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 10 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.556144 22876 ts_tablet_manager.cc:1916] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.570694 16386 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 16 to 17, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 17 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.573165 16386 catalog_manager.cc:5697] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 21 to 22, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 22 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:50.577867 16388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59724 (request call id 194) took 2878 ms. Trace:
I20260709 13:08:50.578323 16479 tablet_service.cc:1558] Processing DeleteTablet for tablet f61b94df305e465c9e3aae1bf4931b69 with delete_type TABLET_DATA_TOMBSTONED (TS 359213375db14f3d874c121993f90d76 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:40216
I20260709 13:08:50.578601 16386 catalog_manager.cc:5697] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.589512 16485 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:50.590971 22783 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:50.605151 16386 catalog_manager.cc:5697] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 15, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.608511 22877 tablet_replica.cc:333] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:50.579301 16388 rpcz_store.cc:276] 0709 13:08:47.699255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.699480 (+   225us) service_pool.cc:224] Handling call
0709 13:08:50.577819 (+2878339us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:50.539347 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:50.539832 (+   485us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:50.539862 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:08:50.539877 (+    15us) tablet.cc:662] Decoding operations
0709 13:08:50.540362 (+   485us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:50.540412 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:50.540437 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:50.540750 (+   313us) tablet.cc:701] Row locks acquired
0709 13:08:50.540768 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:50.540892 (+   124us) write_op.cc:270] Start()
0709 13:08:50.540990 (+    98us) write_op.cc:276] Timestamp: P: 1783602530540851 usec, L: 0
0709 13:08:50.541009 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:50.541577 (+   568us) log.cc:844] Serialized 1275 byte log entry
0709 13:08:50.543485 (+  1908us) op_driver.cc:464] REPLICATION: finished
0709 13:08:50.543939 (+   454us) write_op.cc:301] APPLY: starting
0709 13:08:50.544006 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:50.545784 (+  1778us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:50.545862 (+    78us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:50.547691 (+  1829us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:50.547877 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:50.547919 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:50.548108 (+   189us) log.cc:844] Serialized 41 byte log entry
0709 13:08:50.549570 (+  1462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.549653 (+    83us) write_op.cc:454] Released schema lock
0709 13:08:50.549696 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:50.550026 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:50.550051 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":188,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":262,"apply.run_cpu_time_us":4749,"apply.run_wall_time_us":6046,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":2474,"prepare.run_wall_time_us":2474,"replication_time_us":2371}]]}
I20260709 13:08:50.607748 16386 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:50.609684 22877 raft_consensus.cc:2243] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.613298 22877 raft_consensus.cc:2272] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.630853 16565 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:50.634655 22881 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:50.638510 22877 ts_tablet_manager.cc:1916] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.613812 16386 catalog_manager.cc:5697] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:50.642673 16386 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.644224 16386 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:50.646234 16386 catalog_manager.cc:5697] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 12 to 13, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 13 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.655383 16386 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 16, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 16 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.658690 16386 catalog_manager.cc:5697] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 13 to 16, leader changed from f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:50.680483 22877 ts_tablet_manager.cc:1929] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 13:08:50.682765 22877 log.cc:1199] T f61b94df305e465c9e3aae1bf4931b69 P 359213375db14f3d874c121993f90d76: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/wals/f61b94df305e465c9e3aae1bf4931b69
I20260709 13:08:50.687350 22876 ts_tablet_manager.cc:1929] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:08:50.687769 22876 log.cc:1199] T a8c27c31776b4e60afb061384a2ea62e P f842280ae2ac4c68b0b7f6c093e27357: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/wals/a8c27c31776b4e60afb061384a2ea62e
I20260709 13:08:50.689788 16374 catalog_manager.cc:5028] TS f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): tablet a8c27c31776b4e60afb061384a2ea62e (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:50.692186 16485 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 23 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:50.693599 22218 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:50.704870 16635 raft_consensus.cc:1275] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:50.706478 22747 consensus_queue.cc:1048] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:50.708781 16491 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:50.711661 22358 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:50.711874 16565 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:50.721561 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:50.714097 16374 catalog_manager.cc:5028] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): tablet f61b94df305e465c9e3aae1bf4931b69 (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:50.725577 16389 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 reported cstate change: leader changed from <none> to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 16 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.729352 22728 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:50.801594 16635 raft_consensus.cc:1275] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:50.807456 22358 consensus_queue.cc:1048] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:50.815339 22800 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.815882 22800 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:50.818066 22885 log.cc:927] Time spent T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:50.831729 22783 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:50.832267 22783 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.836078 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:50.836777 17184 raft_consensus.cc:2393] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 in current term 18: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:50.836098 16638 raft_consensus.cc:1275] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:50.840011 22264 consensus_queue.cc:1048] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:50.862988 16634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:50.863621 16634 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 17.
I20260709 13:08:50.845332 22783 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:50.876442 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:50.878816 22800 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:50.901568 22812 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:50.901980 22812 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.902323 22812 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:50.902624 22886 log.cc:927] Time spent T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
W20260709 13:08:50.904232 22887 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 13:08:50.951287 22812 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:50.966416 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 74943.6us
I20260709 13:08:50.971236 17184 consensus_queue.cc:237] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:50.984093 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:50.984741 16639 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:50.984205 16485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "359213375db14f3d874c121993f90d76" is_pre_election: true
I20260709 13:08:50.987428 16485 raft_consensus.cc:2368] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19.
I20260709 13:08:50.990386 16604 leader_election.cc:400] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19.
I20260709 13:08:50.994954 16604 leader_election.cc:403] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:50.995740 16386 catalog_manager.cc:5697] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 22 to 23, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 23 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } }
I20260709 13:08:51.006184 16386 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 17 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.019600 16639 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 19.
I20260709 13:08:51.020716 16455 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:51.020318 22881 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809) with higher term. Message: Invalid argument: T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f842280ae2ac4c68b0b7f6c093e27357 for earlier term 18. Current term is 19.
I20260709 13:08:51.061185 22812 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Requested vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:51.068427 22800 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:51.093299 22800 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:51.113570 22800 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:51.124639 22902 log.cc:927] Time spent T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:08:51.140581 16389 catalog_manager.cc:5697] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 18 to 19, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 19 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:51.206688 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 240029us
W20260709 13:08:51.210045 16456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 146888us
I20260709 13:08:51.217837 16638 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:51.219760 16491 raft_consensus.cc:1275] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:51.228250 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:51.228864 17184 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:51.231655 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:51.233790 17183 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.255507 22358 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:51.268071 17183 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 19.
W20260709 13:08:51.273739 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 58793.4us
I20260709 13:08:51.310943 16387 catalog_manager.cc:5697] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 19 to 20, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 20 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:51.314154 16389 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.346719 16385 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52648 (request call id 287) took 1002 ms. Trace:
I20260709 13:08:51.347009 16385 rpcz_store.cc:276] 0709 13:08:50.343874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.343980 (+   106us) service_pool.cc:224] Handling call
0709 13:08:51.346669 (+1002689us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110033,"reported_tablets":25}
W20260709 13:08:51.358325 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 104082us
I20260709 13:08:51.378866 22914 consensus_queue.cc:1048] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:51.423213 16488 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:51.417912 22358 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 10 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:51.453428 16632 raft_consensus.cc:2955] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:51.456616 16373 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d34e55d2ce67443aaecb395469a9c7ce with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:08:51.451606 16388 catalog_manager.cc:5697] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 reported cstate change: config changed from index 10 to 12, VOTER 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) evicted. New cstate: current_term: 16 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:51.495877 16549 tablet_service.cc:1558] Processing DeleteTablet for tablet d34e55d2ce67443aaecb395469a9c7ce with delete_type TABLET_DATA_TOMBSTONED (TS 035eaa2f12374a81a4df7868a5453d3c not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41626
I20260709 13:08:51.504546 22919 tablet_replica.cc:333] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:08:51.505295 22919 raft_consensus.cc:2243] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.506131 22919 raft_consensus.cc:2272] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.518548 22919 ts_tablet_manager.cc:1916] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:51.537463 22919 ts_tablet_manager.cc:1929] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:08:51.537863 22919 log.cc:1199] T d34e55d2ce67443aaecb395469a9c7ce P 035eaa2f12374a81a4df7868a5453d3c: Deleting WAL directory at /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/wals/d34e55d2ce67443aaecb395469a9c7ce
I20260709 13:08:51.539569 16375 catalog_manager.cc:5028] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): tablet d34e55d2ce67443aaecb395469a9c7ce (table test-workload [id=4dcd57a6d2864650a857de4e00c52b15]) successfully deleted
I20260709 13:08:51.638230 16636 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:51.639813 22800 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:51.702190 17184 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:51.705636 22812 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:51.824849 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.941602 16564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:51.942186 16564 raft_consensus.cc:606] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:51.952639 22912 raft_consensus.cc:993] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:51.953080 22912 raft_consensus.cc:1081] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:51.954840 16488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:40220
I20260709 13:08:51.954867 16564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:51.955475 16488 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.955516 16564 raft_consensus.cc:606] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:51.955989 16488 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.961371 16488 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:51.963652 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:51.964200 16564 raft_consensus.cc:3055] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:51.964502 16564 raft_consensus.cc:740] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:51.964772 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:51.965318 16636 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.965510 16564 consensus_queue.cc:260] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:51.968135 16564 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.977797 16636 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:51.979645 17184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623"
dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:08:51.979737 16455 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:51.980203 17184 raft_consensus.cc:606] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:51.980600 22892 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:51.981154 22892 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:51.982002 22892 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:51.980226 16564 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 18.
I20260709 13:08:51.987972 16557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:51.988694 16557 raft_consensus.cc:606] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:51.991226 16557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f"
dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
mode: GRACEFUL
new_leader_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:51.991691 16557 raft_consensus.cc:606] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Received request to transfer leadership to TS 359213375db14f3d874c121993f90d76
I20260709 13:08:51.993250 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:51.994879 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:51.995635 16488 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:52.014372 16385 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 17 to 18, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 18 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.069978 22218 raft_consensus.cc:993] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.070411 22218 raft_consensus.cc:1081] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.071844 16488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:40220
I20260709 13:08:52.072410 16488 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:52.072763 16488 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:52.078936 16488 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:52.089284 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:52.089815 16557 raft_consensus.cc:3055] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:52.090123 16557 raft_consensus.cc:740] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:52.090349 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:52.090902 17184 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:52.090837 16557 consensus_queue.cc:260] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:52.092095 16557 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:52.097422 17184 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:52.099572 16488 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:52.099471 16454 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:52.098948 16557 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 15.
I20260709 13:08:52.101498 22892 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:52.102006 22892 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:52.102787 22892 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:52.159970 16385 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 14 to 15, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 15 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.331005 22264 raft_consensus.cc:993] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.331445 22728 raft_consensus.cc:1081] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.333086 16488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:50636
I20260709 13:08:52.333593 16488 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:52.333895 16488 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.336354 22905 raft_consensus.cc:993] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.336840 22905 raft_consensus.cc:1081] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.338348 16491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:40220
I20260709 13:08:52.338868 16491 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:52.339180 16491 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:52.340478 16488 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:52.342799 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:52.343336 16564 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.348096 16491 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:52.349874 16564 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 19.
I20260709 13:08:52.350931 16456 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:52.351004 16488 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:52.352022 22897 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:52.352347 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:52.352726 22897 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 19 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:52.353066 17184 raft_consensus.cc:3055] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:52.353384 17184 raft_consensus.cc:740] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:52.354086 17184 consensus_queue.cc:260] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:52.353940 22897 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:52.355566 17184 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.357419 16491 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:52.364616 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:52.365147 16636 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:52.365902 17184 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 19.
I20260709 13:08:52.369213 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:52.370121 16564 raft_consensus.cc:3055] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:52.370448 16564 raft_consensus.cc:740] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:52.371304 16564 consensus_queue.cc:260] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:52.372476 16564 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:52.375336 16636 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:52.376582 16455 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:52.378187 22892 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:52.378647 22892 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:52.379477 22892 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:52.381335 16564 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 14.
I20260709 13:08:52.391276 16385 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 18 to 19, leader changed from 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 19 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.408501 16564 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:52.409762 22897 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:52.416991 22912 raft_consensus.cc:993] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: : Instructing follower 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.417457 22912 raft_consensus.cc:1081] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Signalling peer 359213375db14f3d874c121993f90d76 to start an election
I20260709 13:08:52.419132 16491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d"
dest_uuid: "359213375db14f3d874c121993f90d76"
 from {username='slave'} at 127.0.0.1:40220
I20260709 13:08:52.421036 16491 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:52.421525 16491 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:52.435344 16491 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:52.440666 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:52.441188 16564 raft_consensus.cc:3055] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:52.441486 16564 raft_consensus.cc:740] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:52.442155 16564 consensus_queue.cc:260] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:52.443099 16564 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:52.446283 16385 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 13 to 14, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 14 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.455674 16564 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 20.
I20260709 13:08:52.456837 16456 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76; no voters: 
I20260709 13:08:52.458374 22897 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:52.458861 22897 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 20 LEADER]: Becoming Leader. State: Replica: 359213375db14f3d874c121993f90d76, State: Running, Role: LEADER
I20260709 13:08:52.459622 22897 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:52.475680 16636 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:52.487417 22812 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:08:52.533618 16491 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 20 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:52.542222 16385 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 reported cstate change: term changed from 19 to 20, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 359213375db14f3d874c121993f90d76 (127.15.6.1). New cstate: current_term: 20 leader_uuid: "359213375db14f3d874c121993f90d76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.543152 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
W20260709 13:08:52.544219 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 54801.6us
I20260709 13:08:52.543732 16636 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:52.564118 16560 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:52.565441 22897 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:52.584820 16636 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 359213375db14f3d874c121993f90d76 in term 20.
I20260709 13:08:52.642769 17184 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:52.670542 22892 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:08:52.713595 16454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 44791.4us
I20260709 13:08:52.762426 16557 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:52.768982 16635 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:52.771560 22946 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:52.793329 16603 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecb26c2b33364a6583c0073862883947. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.799897 16565 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:52.807931 22881 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:52.811916 16565 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:52.816516 22942 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:52.823477 16491 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:52.827406 22948 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:52.847302 17186 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:52.858848 22946 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:52.876889 16635 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:52.878373 22812 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:52.883623 22881 raft_consensus.cc:2955] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:52.889308 16565 raft_consensus.cc:2955] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:52.947173 16560 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:52.954674 22942 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:52.973004 16560 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:52.987164 16385 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 17 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.995765 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:53.009672 16488 raft_consensus.cc:2955] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:53.050235 16488 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:53.055873 16636 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:53.058996 22912 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.065469 22912 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.075157 16635 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Refusing update from remote peer 359213375db14f3d874c121993f90d76: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:53.077020 22942 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:53.106273 16529 consensus_peers.cc:597] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a35bf299a154270b54e15fd1cbb505c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.130897 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
W20260709 13:08:53.166185 17152 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:53.162312 16636 raft_consensus.cc:2955] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:53.156924 22960 raft_consensus.cc:2955] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:08:53.223929 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 55447.8us
W20260709 13:08:53.239755 17152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 73600.7us
W20260709 13:08:53.273645 16604 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.274893 16604 consensus_peers.cc:597] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.272616 16387 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 11, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:08:53.277964 16604 consensus_peers.cc:597] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.279650 16604 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.280263 16604 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.292138 16557 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
W20260709 13:08:53.315254 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 47105.6us
W20260709 13:08:53.319105 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.328181 17152 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.338270 16636 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:53.359866 16604 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.364353 22934 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:53.370532 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.392198 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 69650.3us
W20260709 13:08:53.392949 16530 consensus_peers.cc:597] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.394869 16530 consensus_peers.cc:597] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.396405 16529 consensus_peers.cc:597] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c -> Peer 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): Couldn't send request to peer 16b5b367990f4b5c862484bdec0b9226. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9de9d7206ba42568149f95eb24f22ef. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.399487 16530 consensus_peers.cc:597] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.400166 16530 consensus_peers.cc:597] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.401587 16530 consensus_peers.cc:597] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.403600 16530 consensus_peers.cc:597] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.413269 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.413525 16604 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.416079 16530 consensus_peers.cc:597] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.426795 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.428208 22975 ts_tablet_manager.cc:933] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:53.433022 16530 consensus_peers.cc:597] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.433588 16530 consensus_peers.cc:597] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.434131 16530 consensus_peers.cc:597] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.427311 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.451675 16604 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.455780 22934 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:53.478631 16632 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
W20260709 13:08:53.487901 17152 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.499967 17152 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.502413 16604 consensus_peers.cc:597] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.504894 22975 tablet_copy_client.cc:323] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.3:45431
I20260709 13:08:53.507766 16650 tablet_copy_service.cc:140] P f842280ae2ac4c68b0b7f6c093e27357: Received BeginTabletCopySession request for tablet ecb26c2b33364a6583c0073862883947 from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:51944)
I20260709 13:08:53.508301 16650 tablet_copy_service.cc:161] P f842280ae2ac4c68b0b7f6c093e27357: Beginning new tablet copy session on tablet ecb26c2b33364a6583c0073862883947 from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:51944: session id = 16b5b367990f4b5c862484bdec0b9226-ecb26c2b33364a6583c0073862883947
I20260709 13:08:53.510231 22977 ts_tablet_manager.cc:933] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:53.512590 16387 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index -1 to 9, NON_VOTER 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) added. New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } }
I20260709 13:08:53.520352 16650 tablet_copy_source_session.cc:215] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:53.525861 16437 auto_rebalancer.cc:629] Failed to schedule move for tablet 7dd7d3c7e92b43ee946d2d4505a17c43: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:53.529474 22975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb26c2b33364a6583c0073862883947. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:53.533707 16530 consensus_peers.cc:597] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.545276 22975 tablet_copy_client.cc:806] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:53.545919 22975 tablet_copy_client.cc:670] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:53.553629 22975 tablet_copy_client.cc:538] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:53.562876 22975 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:53.564347 22977 tablet_copy_client.cc:323] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
W20260709 13:08:53.567392 16604 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.579470 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.592001 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet 5a35bf299a154270b54e15fd1cbb505c from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:08:53.592587 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet 5a35bf299a154270b54e15fd1cbb505c from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-5a35bf299a154270b54e15fd1cbb505c
W20260709 13:08:53.594467 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.592475 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:53.597959 15384 tablet_replica.cc:333] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.598907 15384 raft_consensus.cc:2243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.600674 15384 raft_consensus.cc:2272] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.606302 15384 tablet_replica.cc:333] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.607121 15384 raft_consensus.cc:2243] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.607923 15384 raft_consensus.cc:2272] T 755c5be0c60f44e5a3df52484c5c934f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.611562 15384 tablet_replica.cc:333] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.612273 15384 raft_consensus.cc:2243] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:53.613143 15384 raft_consensus.cc:2272] T d4a969bf0b354736bf91615b8648cf36 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.613759 16576 tablet_copy_source_session.cc:215] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:53.616935 22977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a35bf299a154270b54e15fd1cbb505c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.620457 15384 tablet_replica.cc:333] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.623687 15384 raft_consensus.cc:2243] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:53.624696 15384 raft_consensus.cc:2272] T a8c27c31776b4e60afb061384a2ea62e P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.646864 15384 tablet_replica.cc:333] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.647704 15384 raft_consensus.cc:2243] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:53.648722 15384 raft_consensus.cc:2272] T 26d0f0e748bb4817a08afec4338c216a P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:53.656478 16530 consensus_peers.cc:597] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.660625 15384 tablet_replica.cc:333] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.661510 15384 raft_consensus.cc:2243] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:53.672484 15384 raft_consensus.cc:2272] T 3b22e951e8c745fd96de0226683aff04 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.674825 15384 tablet_replica.cc:333] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.675602 15384 raft_consensus.cc:2243] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:53.676534 15384 raft_consensus.cc:2272] T 5f89989988c641f59bbc5b03e885656b P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.686529 22977 tablet_copy_client.cc:806] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:53.687148 22977 tablet_copy_client.cc:670] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:53.686533 15384 tablet_replica.cc:333] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.691778 15384 raft_consensus.cc:2243] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:53.692564 15384 raft_consensus.cc:2272] T c489b078811a4d66b4a4c4cacb1dbf2d P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.700932 22977 tablet_copy_client.cc:538] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:53.701581 15384 tablet_replica.cc:333] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.702378 15384 raft_consensus.cc:2243] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.702896 15384 raft_consensus.cc:2272] T 1eda6987d51b45e0a0672ec78b798b0f P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.721972 15384 tablet_replica.cc:333] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.722739 15384 raft_consensus.cc:2243] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.723284 15384 raft_consensus.cc:2272] T 836ce75918dd4690b2a75522b473f405 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.730655 15384 tablet_replica.cc:333] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.731382 15384 raft_consensus.cc:2243] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.731886 15384 raft_consensus.cc:2272] T 08a8884f986b4b43beecab72a521a3eb P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.746172 22977 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:53.765563 15384 tablet_replica.cc:333] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.766426 15384 raft_consensus.cc:2243] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.767023 15384 raft_consensus.cc:2272] T 8a89d28915e9486ba50f8fdafb99a037 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.778045 15384 tablet_replica.cc:333] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.778815 15384 raft_consensus.cc:2243] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.779371 15384 raft_consensus.cc:2272] T e9a943513f89492ba24cbf67180d01f3 P 359213375db14f3d874c121993f90d76 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.796772 15384 tablet_replica.cc:333] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.797519 15384 raft_consensus.cc:2243] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.798024 15384 raft_consensus.cc:2272] T 82af48cecc58434e959547ec318fa4c5 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.800422 15384 tablet_replica.cc:333] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.801113 15384 raft_consensus.cc:2243] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:53.802342 22975 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:53.812265 22975 tablet_bootstrap.cc:492] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:53.813295 15384 raft_consensus.cc:2272] T ca9e6e3a4a404a9893a40afed3d0179f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.818369 15384 tablet_replica.cc:333] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.818785 22975 ts_tablet_manager.cc:1403] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.256s	user 0.028s	sys 0.014s
I20260709 13:08:53.819147 15384 raft_consensus.cc:2243] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.824226 15384 raft_consensus.cc:2272] T d34e55d2ce67443aaecb395469a9c7ce P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.876334 15384 tablet_replica.cc:333] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.878844 15384 raft_consensus.cc:2243] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.879379 15384 raft_consensus.cc:2272] T f66755c5c9714ae1858e6df5473a5cd6 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.889533 22975 raft_consensus.cc:359] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:53.890470 22975 raft_consensus.cc:740] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:53.891177 22975 consensus_queue.cc:260] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:53.883730 15384 tablet_replica.cc:333] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.911371 15384 raft_consensus.cc:2243] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.915645 15384 raft_consensus.cc:2272] T a22c30518dd74380871bcf169099e049 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.926613 15384 tablet_replica.cc:333] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.927326 15384 raft_consensus.cc:2243] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.945214 15384 pending_rounds.cc:70] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Trying to abort 1 pending ops.
I20260709 13:08:53.948541 22975 ts_tablet_manager.cc:1434] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.000s
I20260709 13:08:53.945498 15384 pending_rounds.cc:77] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76: Aborting op as it isn't in flight: id { term: 16 index: 11 } timestamp: 7305635975052660736 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "5a35bf299a154270b54e15fd1cbb505c" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } } new_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } } } }
I20260709 13:08:53.958817 15384 raft_consensus.cc:2917] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Aborting config change with OpId 16.11: Aborted: Op aborted
I20260709 13:08:53.959499 15384 raft_consensus.cc:2889] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:53.964424 15384 raft_consensus.cc:2272] T 5a35bf299a154270b54e15fd1cbb505c P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.960963 16650 tablet_copy_service.cc:342] P f842280ae2ac4c68b0b7f6c093e27357: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-ecb26c2b33364a6583c0073862883947 received from {username='slave'} at 127.0.0.1:51944
I20260709 13:08:53.969515 16650 tablet_copy_service.cc:434] P f842280ae2ac4c68b0b7f6c093e27357: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-ecb26c2b33364a6583c0073862883947 on tablet ecb26c2b33364a6583c0073862883947 with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:53.977874 22985 ts_tablet_manager.cc:933] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: Initiating tablet copy from peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:53.985357 15384 tablet_replica.cc:333] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:53.986210 15384 raft_consensus.cc:2243] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.988149 15384 raft_consensus.cc:2272] T da035835f764425db56e9649db0a0bcc P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.021221 15384 tablet_replica.cc:333] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.023240 15384 raft_consensus.cc:2243] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.024207 15384 raft_consensus.cc:2272] T a8f74647bc1e4de09af86d4c90a3dc13 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.029577 15384 tablet_replica.cc:333] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.030303 15384 raft_consensus.cc:2243] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.033309 15384 raft_consensus.cc:2272] T f7f595b7864d413a8f05d3b5e1f50aec P 359213375db14f3d874c121993f90d76 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.037968 15384 tablet_replica.cc:333] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.038638 15384 raft_consensus.cc:2243] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.039227 15384 raft_consensus.cc:2272] T faea00d3379945fd9f9d98c82429c8d5 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.041639 15384 tablet_replica.cc:333] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.042341 15384 raft_consensus.cc:2243] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.055176 15384 raft_consensus.cc:2272] T 71cad9c33f0b4530881909502ebdc720 P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.068801 22985 tablet_copy_client.cc:323] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Beginning tablet copy session from remote peer at address 127.15.6.2:34831
I20260709 13:08:54.070582 16576 tablet_copy_service.cc:140] P 035eaa2f12374a81a4df7868a5453d3c: Received BeginTabletCopySession request for tablet b9de9d7206ba42568149f95eb24f22ef from peer 16b5b367990f4b5c862484bdec0b9226 ({username='slave'} at 127.0.0.1:49162)
I20260709 13:08:54.071071 16576 tablet_copy_service.cc:161] P 035eaa2f12374a81a4df7868a5453d3c: Beginning new tablet copy session on tablet b9de9d7206ba42568149f95eb24f22ef from peer 16b5b367990f4b5c862484bdec0b9226 at {username='slave'} at 127.0.0.1:49162: session id = 16b5b367990f4b5c862484bdec0b9226-b9de9d7206ba42568149f95eb24f22ef
I20260709 13:08:54.064307 22942 raft_consensus.cc:493] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:54.082836 15384 tablet_replica.cc:333] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.080406 22942 raft_consensus.cc:515] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.085675 22942 leader_election.cc:290] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.086469 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.088279 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac4e93cad76428c81439a9c5471f994" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.089634 16454 leader_election.cc:304] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.090332 22942 raft_consensus.cc:2749] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.108911 16576 tablet_copy_source_session.cc:215] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:54.083622 15384 raft_consensus.cc:2243] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.111049 15384 raft_consensus.cc:2272] T cd0cddf61354438cac7dda825626e2c5 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.115077 15384 tablet_replica.cc:333] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.115674 15384 raft_consensus.cc:2243] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.116129 15384 raft_consensus.cc:2272] T b9de9d7206ba42568149f95eb24f22ef P 359213375db14f3d874c121993f90d76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.136734 22942 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:54.137241 22942 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.139249 22942 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.139439 22977 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.139775 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.140676 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6d2553f797441c910fb72d81b1049f" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.142103 15384 tablet_replica.cc:333] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.142467 16454 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:54.142889 15384 raft_consensus.cc:2243] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.149024 22977 tablet_bootstrap.cc:492] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:54.141077 22985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9de9d7206ba42568149f95eb24f22ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.164002 22977 ts_tablet_manager.cc:1403] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.418s	user 0.043s	sys 0.004s
I20260709 13:08:54.169961 22977 raft_consensus.cc:359] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:54.174242 22942 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:54.174873 22942 raft_consensus.cc:493] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:54.175315 22942 raft_consensus.cc:515] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.177315 22942 leader_election.cc:290] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.177889 15384 raft_consensus.cc:2272] T 4df4eab2c270411ebedb43bc97966c7f P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.178685 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.181340 15384 tablet_replica.cc:333] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.182126 15384 raft_consensus.cc:2243] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.182667 15384 raft_consensus.cc:2272] T 318a7033cb194c3f8c635e0e36d5dc53 P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.188447 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7270021514f3c83a70987981f65cf" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.191632 16454 leader_election.cc:304] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:54.194608 22942 raft_consensus.cc:2749] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:54.170717 22977 raft_consensus.cc:740] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:54.208788 15384 tablet_replica.cc:333] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.209578 15384 raft_consensus.cc:2243] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.210218 15384 raft_consensus.cc:2272] T f1d7270021514f3c83a70987981f65cf P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.212262 22977 consensus_queue.cc:260] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:54.246627 22985 tablet_copy_client.cc:806] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:54.247264 22985 tablet_copy_client.cc:670] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:54.249568 22977 ts_tablet_manager.cc:1434] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 13:08:54.280126 15384 tablet_replica.cc:333] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.292434 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-5a35bf299a154270b54e15fd1cbb505c received from {username='slave'} at 127.0.0.1:49162
I20260709 13:08:54.296434 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-5a35bf299a154270b54e15fd1cbb505c on tablet 5a35bf299a154270b54e15fd1cbb505c with peer 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:54.297849 15384 raft_consensus.cc:2243] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.310372 22942 raft_consensus.cc:493] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:54.313321 22942 raft_consensus.cc:515] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:54.324841 22973 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:54.325868 22973 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.326479 22942 leader_election.cc:290] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:54.329123 15384 raft_consensus.cc:2272] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.333662 22985 tablet_copy_client.cc:538] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:54.338667 15384 tablet_replica.cc:333] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.356986 15384 raft_consensus.cc:2243] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.358412 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.382107 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45b7d1fd3cc4d48b36627737b07663c" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.384465 16455 leader_election.cc:304] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.388537 22973 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.389122 22973 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:08:54.389801 22973 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:54.361594 15384 raft_consensus.cc:2272] T ddfb4b0791d74c589434dee63459ca4f P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.427471 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.434938 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.355515 22812 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:54.398973 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.391750 22973 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:54.449738 22942 raft_consensus.cc:2749] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:54.449946 16455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 59401.1us
I20260709 13:08:54.494750 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6d2ae2d1794655a3e58da8d53b412a" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.495090 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.493750 22942 raft_consensus.cc:493] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:54.510852 22990 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:54.512084 16456 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:54.511647 22990 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:54.503424 22942 raft_consensus.cc:515] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.515965 22942 leader_election.cc:290] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.516677 22990 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:54.519451 22990 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:54.521982 17183 raft_consensus.cc:1217] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:08:54.499672 22812 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.531780 22812 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.533368 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.535223 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.540740 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.553439 22973 raft_consensus.cc:493] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:54.554067 22973 raft_consensus.cc:515] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.556200 22973 leader_election.cc:290] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.558219 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f95c63e093b4ba3b6fa7c2c62b717c9" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.575358 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb26c2b33364a6583c0073862883947" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.562407 22991 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:08:54.584973 15384 tablet_replica.cc:333] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.586577 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.592962 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4151437571420aa297eb389f8c35af" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.593505 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d40aa6b369461bb9f13d568e8450e7" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.595841 16455 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.597548 22812 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:54.588125 22991 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.605566 22991 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.607308 17186 raft_consensus.cc:1217] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:08:54.607784 22985 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: Bootstrap starting.
I20260709 13:08:54.612589 15384 raft_consensus.cc:2243] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.613420 15384 raft_consensus.cc:2272] T aa6d2ae2d1794655a3e58da8d53b412a P 359213375db14f3d874c121993f90d76 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.626996 22973 raft_consensus.cc:493] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 16b5b367990f4b5c862484bdec0b9226)
I20260709 13:08:54.627565 22973 raft_consensus.cc:515] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.629662 22973 leader_election.cc:290] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.631372 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.633736 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.648250 16455 leader_election.cc:304] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.649323 22991 raft_consensus.cc:2749] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:54.649904 16455 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.651141 22991 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.651891 16455 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.652614 22991 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:54.652943 16455 leader_election.cc:304] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.653669 22991 raft_consensus.cc:2749] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:54.654675 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441a1d437e7b4eff9f56f88ce7d935e5" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.664215 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4deba3ef5feb443b8e28599a079603bd" candidate_uuid: "359213375db14f3d874c121993f90d76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.664324 16454 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.665130 22973 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.672483 15384 tablet_replica.cc:333] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.673550 16454 leader_election.cc:304] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 359213375db14f3d874c121993f90d76; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
I20260709 13:08:54.674554 22973 raft_consensus.cc:2749] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:54.675216 15384 raft_consensus.cc:2243] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.677420 15384 raft_consensus.cc:2272] T 6f3eed6f88504d69aad570d8cc480623 P 359213375db14f3d874c121993f90d76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.680509 15384 tablet_replica.cc:333] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.681452 15384 raft_consensus.cc:2243] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.682749 15384 raft_consensus.cc:2272] T 08c3cde3ed474891aeea9ff365ee8a9d P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.713783 15384 tablet_replica.cc:333] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.714658 15384 raft_consensus.cc:2243] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.715445 15384 raft_consensus.cc:2272] T 9ac4e93cad76428c81439a9c5471f994 P 359213375db14f3d874c121993f90d76 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.725626 22989 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.726308 22989 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.730113 22989 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.734994 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:54.737995 16530 leader_election.cc:336] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.741394 16529 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:54.742384 22989 raft_consensus.cc:2749] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:54.742545 15384 tablet_replica.cc:333] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.764750 15384 raft_consensus.cc:2243] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.759734 22985 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.773517 15384 raft_consensus.cc:2272] T 441a1d437e7b4eff9f56f88ce7d935e5 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.773967 22985 tablet_bootstrap.cc:492] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: Bootstrap complete.
I20260709 13:08:54.774817 22985 ts_tablet_manager.cc:1403] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: Time spent bootstrapping tablet: real 0.167s	user 0.032s	sys 0.008s
I20260709 13:08:54.777036 22264 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.777616 22264 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.778154 15384 tablet_replica.cc:333] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.778970 15384 raft_consensus.cc:2243] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.781687 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:54.782644 17152 leader_election.cc:336] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.783631 15384 raft_consensus.cc:2272] T cc4151437571420aa297eb389f8c35af P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.784334 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.779609 22264 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:54.785439 22982 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:54.787014 15384 tablet_replica.cc:333] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.787856 15384 raft_consensus.cc:2243] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.788409 15384 raft_consensus.cc:2272] T 4deba3ef5feb443b8e28599a079603bd P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.791285 15384 tablet_replica.cc:333] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.791978 15384 raft_consensus.cc:2243] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.792702 15384 raft_consensus.cc:2272] T d45b7d1fd3cc4d48b36627737b07663c P 359213375db14f3d874c121993f90d76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.794840 22985 raft_consensus.cc:359] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:54.795665 22985 raft_consensus.cc:740] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Initialized, Role: LEARNER
I20260709 13:08:54.796343 22985 consensus_queue.cc:260] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: NON_VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: true } }
I20260709 13:08:54.798648 15384 tablet_replica.cc:333] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.799335 22985 ts_tablet_manager.cc:1434] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.004s
I20260709 13:08:54.799510 15384 raft_consensus.cc:2243] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.800171 15384 raft_consensus.cc:2272] T a6d40aa6b369461bb9f13d568e8450e7 P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.803866 15384 tablet_replica.cc:333] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.804591 15384 raft_consensus.cc:2243] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.805545 22264 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.806069 22264 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.807878 22264 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:54.808938 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.809511 16557 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:54.810708 17153 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:54.812647 16576 tablet_copy_service.cc:342] P 035eaa2f12374a81a4df7868a5453d3c: Request end of tablet copy session 16b5b367990f4b5c862484bdec0b9226-b9de9d7206ba42568149f95eb24f22ef received from {username='slave'} at 127.0.0.1:49162
I20260709 13:08:54.813053 16576 tablet_copy_service.cc:434] P 035eaa2f12374a81a4df7868a5453d3c: ending tablet copy session 16b5b367990f4b5c862484bdec0b9226-b9de9d7206ba42568149f95eb24f22ef on tablet b9de9d7206ba42568149f95eb24f22ef with peer 16b5b367990f4b5c862484bdec0b9226
W20260709 13:08:54.813851 17152 leader_election.cc:336] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.818886 22264 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:54.819284 22264 raft_consensus.cc:493] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.819664 22264 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:54.820478 15384 raft_consensus.cc:2272] T e5369c1ed0fb429bab44a33761ca4553 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.827801 15384 tablet_replica.cc:333] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.828540 15384 raft_consensus.cc:2243] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.829561 15384 raft_consensus.cc:2272] T 09733d7b0f3c42c3b742542d81067fe0 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.832408 15384 tablet_replica.cc:333] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.837487 22264 raft_consensus.cc:515] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.854440 22264 leader_election.cc:290] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:54.857594 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c27c31776b4e60afb061384a2ea62e" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:54.858161 16557 raft_consensus.cc:3060] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:54.866853 17152 leader_election.cc:336] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.870040 22983 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.870658 22983 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:54.872706 22983 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:54.876645 16604 leader_election.cc:336] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.877975 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.880097 16605 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:54.883216 22983 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:54.884107 16557 raft_consensus.cc:2468] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:54.885267 17153 leader_election.cc:304] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:54.885910 22264 raft_consensus.cc:2804] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:54.886338 22264 raft_consensus.cc:697] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:54.841252 15384 raft_consensus.cc:2243] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.887290 22264 consensus_queue.cc:237] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.888186 15384 raft_consensus.cc:2272] T ecb26c2b33364a6583c0073862883947 P 359213375db14f3d874c121993f90d76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.895381 22989 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.896027 22989 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:54.897943 22989 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:54.899729 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:08:54.906687 16530 leader_election.cc:336] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.906839 15384 tablet_replica.cc:333] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.907119 16530 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.908357 22989 raft_consensus.cc:2749] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:54.907605 15384 raft_consensus.cc:2243] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.922741 22980 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.923322 22980 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:54.925625 15384 raft_consensus.cc:2272] T cd6d2553f797441c910fb72d81b1049f P 359213375db14f3d874c121993f90d76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.928035 22980 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:54.928675 22989 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.929251 22989 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:54.929731 16604 leader_election.cc:336] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.930480 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:54.931023 16557 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:08:54.931954 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:54.933838 16387 catalog_manager.cc:5697] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 17 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.935233 22980 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:54.935616 22980 raft_consensus.cc:493] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.936021 22980 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.938016 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.934664 22989 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:54.943142 16530 leader_election.cc:336] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.943534 16530 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:54.944178 22989 raft_consensus.cc:2749] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.944900 15384 tablet_replica.cc:333] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.945725 15384 raft_consensus.cc:2243] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.946065 22890 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.946923 15384 raft_consensus.cc:2272] T f9f76c206fdf425385a859d72331f02b P 359213375db14f3d874c121993f90d76 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.946691 22890 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.948876 22890 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:54.949713 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:54.950246 17186 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 19.
I20260709 13:08:54.951366 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:54.952085 22890 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:54.952425 22890 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:54.952750 22890 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.962656 22981 raft_consensus.cc:1064] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:54.966158 15384 tablet_replica.cc:333] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:54.965687 22981 consensus_queue.cc:237] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.966933 15384 raft_consensus.cc:2243] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.973315 22890 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:54.981161 22966 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
W20260709 13:08:54.980914 16604 leader_election.cc:336] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.994060 22966 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:54.996131 22966 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:54.997605 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:54.994007 22980 raft_consensus.cc:515] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:54.993417 17186 raft_consensus.cc:1217] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:08:55.002745 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a969bf0b354736bf91615b8648cf36" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:55.003896 17183 raft_consensus.cc:3060] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:55.015179 16530 leader_election.cc:336] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.015591 16530 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:08:55.015661 17183 raft_consensus.cc:2468] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 20.
I20260709 13:08:55.016280 22966 raft_consensus.cc:2749] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:55.017423 16604 leader_election.cc:336] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.017920 16603 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:54.967712 15384 raft_consensus.cc:2272] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 359213375db14f3d874c121993f90d76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.023979 22890 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:55.035965 15384 tablet_replica.cc:333] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76: stopping tablet replica
I20260709 13:08:55.037662 15384 raft_consensus.cc:2243] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.039528 15384 raft_consensus.cc:2272] T 9b8d067430b24267b8a20f78d68ac412 P 359213375db14f3d874c121993f90d76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.040490 22980 leader_election.cc:290] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:55.041975 22980 raft_consensus.cc:2804] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:55.046058 22980 raft_consensus.cc:697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:55.051095 22980 consensus_queue.cc:237] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:55.054054 16604 leader_election.cc:336] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.055302 17183 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEARNER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:55.058826 22890 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:55.087080 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 89254.9us
I20260709 13:08:55.090240 16557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f89989988c641f59bbc5b03e885656b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:55.090764 16557 raft_consensus.cc:3060] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:55.103422 16557 raft_consensus.cc:2468] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:08:55.138180 16564 raft_consensus.cc:1275] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:08:55.141067 16604 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.152586 22997 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.153210 22997 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.155308 22997 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:55.158849 16604 leader_election.cc:336] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.168053 16605 leader_election.cc:304] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:55.168926 22997 raft_consensus.cc:2804] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:55.169641 22997 raft_consensus.cc:697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:55.170642 22997 consensus_queue.cc:237] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.180933 22980 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.184145 22980 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.201426 22980 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:55.179864 22989 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.202152 22989 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.204100 22989 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:55.207439 16604 leader_election.cc:336] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.215277 22972 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.215899 22972 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.231271 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:55.180912 22981 consensus_queue.cc:1048] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:55.236690 16388 catalog_manager.cc:5697] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 19 to 20, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 20 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.233525 16636 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
W20260709 13:08:55.254541 17152 leader_election.cc:336] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:55.256253 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 105741us
I20260709 13:08:55.259105 22997 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.259665 22997 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.263088 22997 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:55.268006 16604 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.251751 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:55.260715 22972 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:55.288875 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:55.289224 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:55.289790 16560 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 17.
I20260709 13:08:55.291657 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:55.292959 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:55.293045 16564 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 20.
I20260709 13:08:55.296171 22890 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:55.296283 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:55.296561 22890 raft_consensus.cc:493] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.296875 22989 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:55.297359 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:55.297957 23003 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.298388 22980 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:55.299841 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 53518.2us
W20260709 13:08:55.300585 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 48910.1us
I20260709 13:08:55.298820 22980 raft_consensus.cc:493] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.304576 22980 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:55.296940 22890 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.297305 22989 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.316449 22989 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:55.314220 22980 raft_consensus.cc:515] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.299077 22996 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.340221 22996 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.342304 22996 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:55.342955 23007 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.343159 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
W20260709 13:08:55.345240 16604 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.345647 16604 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:55.346608 22996 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.349066 23006 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.349678 23006 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.352571 23005 raft_consensus.cc:1064] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:55.347204 22890 raft_consensus.cc:515] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:55.304567 16530 leader_election.cc:336] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:55.355865 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 51320.8us
I20260709 13:08:55.364259 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:55.343508 23007 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.365286 16562 raft_consensus.cc:1275] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:55.366475 23007 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:55.366967 16563 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 15.
I20260709 13:08:55.369302 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:55.369890 17183 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:55.370994 16529 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
I20260709 13:08:55.358971 23005 consensus_queue.cc:237] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.375945 23008 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:55.376317 23008 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.376538 22890 leader_election.cc:290] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:55.378014 16604 leader_election.cc:336] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.378638 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b22e951e8c745fd96de0226683aff04" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:55.379194 16563 raft_consensus.cc:3060] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.387895 23008 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:55.390307 17152 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.402999 22982 consensus_queue.cc:1048] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:55.406121 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c489b078811a4d66b4a4c4cacb1dbf2d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:55.406502 22980 leader_election.cc:290] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:55.406708 16562 raft_consensus.cc:3060] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:55.407914 23006 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:55.409422 22989 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.403187 23008 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.417469 16562 raft_consensus.cc:2468] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 21.
I20260709 13:08:55.418483 16605 leader_election.cc:304] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:55.420228 22996 raft_consensus.cc:2804] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:55.420706 22996 raft_consensus.cc:697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 21 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:55.421597 22996 consensus_queue.cc:237] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.417742 17153 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:55.411327 22989 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:55.432323 16604 leader_election.cc:336] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.427937 22982 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:55.440255 16563 raft_consensus.cc:2468] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 18.
I20260709 13:08:55.435900 22982 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.444175 22989 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.454790 22989 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.444473 17183 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:55.451900 22982 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:55.457302 23006 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:55.453161 23008 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:55.454061 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:08:55.460989 16605 leader_election.cc:304] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:55.461989 22996 raft_consensus.cc:2804] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:55.456640 22989 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:55.463127 22996 raft_consensus.cc:697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:55.464097 22996 consensus_queue.cc:237] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.465353 22982 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.466492 17179 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 035eaa2f12374a81a4df7868a5453d3c in current term 16: Already voted for candidate 16b5b367990f4b5c862484bdec0b9226 in this term.
I20260709 13:08:55.472525 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:55.473083 16638 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
W20260709 13:08:55.475589 17152 leader_election.cc:336] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.477483 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d0f0e748bb4817a08afec4338c216a" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:55.477994 16638 raft_consensus.cc:3060] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:55.477015 22981 raft_consensus.cc:2955] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:55.481860 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:55.482415 16632 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:55.481705 16565 raft_consensus.cc:2955] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:55.488500 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:55.494939 16638 raft_consensus.cc:2468] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
I20260709 13:08:55.494872 23008 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:55.500007 23008 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.500176 22989 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.500387 23008 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.500705 22989 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.502677 22989 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:08:55.512884 23008 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.514420 23007 raft_consensus.cc:1064] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: attempting to promote NON_VOTER 16b5b367990f4b5c862484bdec0b9226 to VOTER
I20260709 13:08:55.514763 23008 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:55.489980 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:55.517233 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:08:55.518302 16562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:55.519037 16562 raft_consensus.cc:2393] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 16: Already voted for candidate 035eaa2f12374a81a4df7868a5453d3c in this term.
I20260709 13:08:55.518458 23007 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.520943 22960 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:55.521314 22960 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.521668 22960 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.474844 22982 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:55.529196 16638 raft_consensus.cc:1275] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:55.532828 22960 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.534644 22960 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:55.536748 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd7d3c7e92b43ee946d2d4505a17c43" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:55.537307 16636 raft_consensus.cc:3060] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:55.540887 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:55.547237 16636 raft_consensus.cc:2468] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:55.554244 16562 raft_consensus.cc:1275] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:55.555508 22996 consensus_queue.cc:1048] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:55.552182 16388 catalog_manager.cc:5697] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.597528 16388 catalog_manager.cc:5697] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 20 to 21, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 21 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.595482 17186 raft_consensus.cc:2955] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:55.624800 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:55.640201 16530 leader_election.cc:336] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:55.658280 16604 consensus_peers.cc:597] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.641065 16388 catalog_manager.cc:5697] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 17 to 18, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 18 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.659533 16387 catalog_manager.cc:5697] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 10 to 11, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:55.665273 17186 raft_consensus.cc:1275] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:08:55.669011 16530 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:55.669756 23007 raft_consensus.cc:2804] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:55.674686 22989 consensus_queue.cc:1048] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:08:55.684522 16604 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.690578 23007 raft_consensus.cc:697] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:55.693015 22980 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.693661 22980 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.698071 22980 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:55.700300 23007 consensus_queue.cc:237] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:55.709411 16604 leader_election.cc:336] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.730669 22264 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.731238 22264 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.733206 22264 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:55.738080 17152 leader_election.cc:336] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.754773 23003 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.755379 23003 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.757479 23003 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:55.764415 16604 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:55.769083 16604 consensus_peers.cc:597] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:55.771358 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 107984us
W20260709 13:08:55.772257 16529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 100947us
W20260709 13:08:55.776000 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 105654us
I20260709 13:08:55.776861 16530 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:55.781414 23005 raft_consensus.cc:2804] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:55.781883 23005 raft_consensus.cc:697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:55.782773 23005 consensus_queue.cc:237] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.788530 23021 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.789113 23021 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:55.791113 23021 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:08:55.792564 16604 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:55.794646 17183 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEARNER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:55.796039 22996 consensus_queue.cc:1048] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:08:55.797504 17152 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:55.801116 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:55.808727 17153 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:55.809470 22264 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:55.811730 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f74647bc1e4de09af86d4c90a3dc13" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:55.812083 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:55.812409 16636 raft_consensus.cc:3060] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:55.822404 16604 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.833519 16636 raft_consensus.cc:2468] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:55.837281 16638 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:55.860122 23006 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:55.860132 17179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
W20260709 13:08:55.867980 16604 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:55.868561 16604 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:55.871515 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:55.880709 16605 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:08:55.881739 22996 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:55.882846 22996 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:55.884176 23021 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.884732 23021 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.885874 16563 raft_consensus.cc:1275] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:55.886543 23021 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:55.900400 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:55.901055 16564 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:55.897416 23020 consensus_queue.cc:1048] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:08:55.897469 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:55.905326 17152 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:55.928207 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:55.928788 16638 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 18.
I20260709 13:08:55.932912 16530 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:55.940557 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:55.957660 16532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.970247 16604 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.950114 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:55.973079 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 46493.2us
I20260709 13:08:55.938328 22966 raft_consensus.cc:2804] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:55.977085 16530 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.940318 23006 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:55.984717 23005 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:55.986159 23005 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:55.986549 23005 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:55.988263 22966 raft_consensus.cc:697] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:55.989284 22966 consensus_queue.cc:237] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:55.994010 23005 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:55.984874 16530 leader_election.cc:336] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:55.996745 16530 leader_election.cc:336] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:55.997119 16530 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:55.997777 23024 raft_consensus.cc:2749] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:55.998930 16530 consensus_peers.cc:597] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.999436 16530 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.012912 16530 consensus_peers.cc:597] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.019366 16530 leader_election.cc:336] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.019574 23005 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:56.020466 16530 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
W20260709 13:08:56.028635 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 54585us
W20260709 13:08:56.033239 16530 consensus_peers.cc:597] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.046181 16530 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.045720 23005 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.049712 23005 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.051574 23005 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:56.036258 23024 raft_consensus.cc:2749] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:56.077208 17153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 47721.9us
I20260709 13:08:56.079036 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c3cde3ed474891aeea9ff365ee8a9d" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:56.084906 16632 raft_consensus.cc:3060] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.079932 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:56.085880 16639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:56.086428 16562 raft_consensus.cc:1275] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:56.086463 16639 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 16.
W20260709 13:08:56.088865 16530 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.090101 16530 consensus_peers.cc:597] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.090361 23020 consensus_queue.cc:1048] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:56.090631 16530 consensus_peers.cc:597] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.091735 16530 consensus_peers.cc:597] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.092464 16530 consensus_peers.cc:597] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.092983 16530 leader_election.cc:336] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.093353 16530 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:08:56.100106 23040 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:56.100606 23040 raft_consensus.cc:493] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.100993 23040 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:56.108657 16530 leader_election.cc:336] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.112259 22960 raft_consensus.cc:2749] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:56.116011 16632 raft_consensus.cc:2468] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 19.
I20260709 13:08:56.115541 16387 catalog_manager.cc:5697] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 15 to 16, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.117337 16387 catalog_manager.cc:5697] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:56.122933 16604 consensus_peers.cc:597] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.123443 16604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:42809, user_credentials={real_user=slave}} blocked reactor thread for 151280us
I20260709 13:08:56.128893 23006 raft_consensus.cc:2955] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.124347 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:56.145939 23024 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:56.146324 23024 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.146662 23024 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.150693 16530 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
W20260709 13:08:56.154489 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.163462 16632 raft_consensus.cc:2955] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:56.193092 16604 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.192853 23024 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:56.194438 16604 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.197449 23038 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.197983 23038 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:56.198932 23040 raft_consensus.cc:515] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:56.162956 23021 raft_consensus.cc:2804] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:56.201390 23038 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:56.212637 16604 consensus_peers.cc:597] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.238082 22989 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.238528 23021 raft_consensus.cc:697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:56.238869 22989 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.240837 22989 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:08:56.238890 16604 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.242069 23021 consensus_queue.cc:237] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.251396 23040 leader_election.cc:290] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:56.248015 17152 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.258360 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.267977 17152 leader_election.cc:336] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.269166 16388 catalog_manager.cc:5697] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.272107 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:56.291250 23022 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.291847 23022 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.293794 23022 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:56.309535 23024 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:56.310884 23022 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:56.320119 16530 leader_election.cc:336] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.320984 16530 leader_election.cc:336] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.331183 17179 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:56.354518 17152 connection.cc:769] client connection to 127.15.6.1:42809 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:08:56.358023 16638 raft_consensus.cc:1275] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:08:56.361249 16530 connection.cc:769] client connection to 127.15.6.1:42809 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:08:56.363809 17179 raft_consensus.cc:2955] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
W20260709 13:08:56.360704 17152 leader_election.cc:336] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:08:56.388069 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:08:56.388681 16636 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 14.
I20260709 13:08:56.387562 16632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09733d7b0f3c42c3b742542d81067fe0" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:56.389801 16632 raft_consensus.cc:3060] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.389425 16638 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.391209 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:56.391765 16564 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 19.
I20260709 13:08:56.396109 16564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfb4b0791d74c589434dee63459ca4f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:56.396564 16564 raft_consensus.cc:3060] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.397411 16632 raft_consensus.cc:2468] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 17.
I20260709 13:08:56.402519 16564 raft_consensus.cc:2468] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
I20260709 13:08:56.407773 16388 catalog_manager.cc:5697] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.410133 16388 catalog_manager.cc:5697] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 18 to 19, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 19 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:56.408321 16530 leader_election.cc:336] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:56.412516 16530 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:08:56.413430 16530 consensus_peers.cc:597] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.413832 16530 consensus_peers.cc:597] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.414201 16530 consensus_peers.cc:597] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.414271 23022 raft_consensus.cc:2749] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:56.415045 16530 consensus_peers.cc:597] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.417275 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:56.418073 23047 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:56.418460 23047 raft_consensus.cc:493] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.418987 23047 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:56.422721 17153 leader_election.cc:304] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:56.423677 23041 raft_consensus.cc:2804] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:56.424194 23041 raft_consensus.cc:697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:56.424984 23041 consensus_queue.cc:237] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:56.427192 23047 raft_consensus.cc:515] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:56.429453 23047 leader_election.cc:290] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:56.432497 23024 consensus_queue.cc:1048] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:56.435153 23027 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.435729 23027 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.437747 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:56.437703 23027 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:56.438900 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:56.439466 16563 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 10.
I20260709 13:08:56.440968 23024 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:56.441334 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:56.442293 23024 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.442903 23024 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:56.442930 22997 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:56.444146 22997 raft_consensus.cc:493] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 359213375db14f3d874c121993f90d76)
I20260709 13:08:56.444483 22997 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.441779 16530 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:56.452811 22997 raft_consensus.cc:515] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.453832 23024 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.454854 22997 leader_election.cc:290] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:08:56.464200 23022 raft_consensus.cc:2804] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:56.464702 23022 raft_consensus.cc:697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:56.465764 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f76c206fdf425385a859d72331f02b" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:56.465534 23022 consensus_queue.cc:237] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.466266 16563 raft_consensus.cc:3060] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.469699 23024 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:08:56.473193 16563 raft_consensus.cc:2468] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 11.
I20260709 13:08:56.474093 16605 leader_election.cc:304] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:08:56.475812 23027 raft_consensus.cc:2804] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:56.476279 23027 raft_consensus.cc:697] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:08:56.477149 23027 consensus_queue.cc:237] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:08:56.479453 16530 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:56.479861 16563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3eed6f88504d69aad570d8cc480623" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
W20260709 13:08:56.480183 16530 consensus_peers.cc:597] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.480669 16530 leader_election.cc:336] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:56.481115 16563 raft_consensus.cc:3060] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:56.480085 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5369c1ed0fb429bab44a33761ca4553" candidate_uuid: "035eaa2f12374a81a4df7868a5453d3c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:08:56.482808 16636 raft_consensus.cc:3060] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:56.481366 16530 consensus_peers.cc:597] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.485975 16604 leader_election.cc:336] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:08:56.485908 16530 consensus_peers.cc:597] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.490875 16639 raft_consensus.cc:1275] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:56.490926 16563 raft_consensus.cc:2468] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 20.
I20260709 13:08:56.499300 16388 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: config changed from index 9 to 10, 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } attrs { replace: true } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.504338 17153 leader_election.cc:304] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 
W20260709 13:08:56.505467 16530 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:56.521584 23022 consensus_queue.cc:1048] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:56.524561 16387 catalog_manager.cc:5697] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 17 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.508234 16636 raft_consensus.cc:2468] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035eaa2f12374a81a4df7868a5453d3c in term 15.
I20260709 13:08:56.511936 23040 raft_consensus.cc:2804] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:08:56.514864 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.526224 23040 raft_consensus.cc:697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 20 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:56.527102 23040 consensus_queue.cc:237] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:56.529045 16530 consensus_peers.cc:597] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.529709 17152 leader_election.cc:336] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:56.537360 16385 catalog_manager.cc:5697] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 16 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 17 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.550347 16530 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:56.551357 23008 raft_consensus.cc:2804] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:56.551829 23008 raft_consensus.cc:697] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Becoming Leader. State: Replica: 035eaa2f12374a81a4df7868a5453d3c, State: Running, Role: LEADER
I20260709 13:08:56.552630 23008 consensus_queue.cc:237] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:08:56.555277 16563 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:56.568495 16604 leader_election.cc:336] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:56.571424 16636 raft_consensus.cc:1275] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:56.575992 23024 consensus_queue.cc:1048] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:56.588442 17179 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:56.592401 23021 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:56.594871 16636 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:56.599804 23021 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:56.591029 16388 catalog_manager.cc:5697] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 19 to 20, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 20 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.609964 22966 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.620508 16387 catalog_manager.cc:5697] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c reported cstate change: term changed from 14 to 15, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2). New cstate: current_term: 15 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.625828 17179 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.635883 16636 raft_consensus.cc:2955] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.648131 16375 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9de9d7206ba42568149f95eb24f22ef with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:56.675909 16387 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: config changed from index 10 to 11, VOTER 359213375db14f3d874c121993f90d76 (127.15.6.1) evicted. New cstate: current_term: 13 leader_uuid: "035eaa2f12374a81a4df7868a5453d3c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } } }
I20260709 13:08:56.694607 16638 raft_consensus.cc:1275] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:56.696115 23050 consensus_queue.cc:1048] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:56.697098 16385 catalog_manager.cc:5697] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 10 to 11, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 11 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:56.739382 16530 consensus_peers.cc:597] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.825055 16563 raft_consensus.cc:1275] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:56.829720 23047 consensus_queue.cc:1048] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:56.835829 16374 catalog_manager.cc:4755] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b9de9d7206ba42568149f95eb24f22ef: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:56.860576 16638 raft_consensus.cc:1275] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:56.863055 23022 consensus_queue.cc:1048] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:56.893517 16604 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.897823 17152 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.948340 16530 consensus_peers.cc:597] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.971557 16530 consensus_peers.cc:597] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.076054 16563 raft_consensus.cc:1275] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:57.077623 23027 consensus_queue.cc:1048] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:57.115934 16638 raft_consensus.cc:1275] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Refusing update from remote peer 035eaa2f12374a81a4df7868a5453d3c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:57.124374 23050 consensus_queue.cc:1048] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:08:57.148432 17152 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.171613 16563 raft_consensus.cc:1275] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:57.175734 23040 consensus_queue.cc:1048] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:57.337090 15384 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16512)
W20260709 13:08:57.901027 16604 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.002137 23047 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.002648 23047 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:08:58.004745 23047 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:58.011454 17152 leader_election.cc:336] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:58.011861 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c" is_pre_election: true
I20260709 13:08:58.012475 16560 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:08:58.016875 17153 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:58.018873 23047 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:58.019239 23047 raft_consensus.cc:493] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.019599 23047 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:58.096930 23047 raft_consensus.cc:515] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:58.103175 17152 leader_election.cc:336] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:08:58.111828 16530 consensus_peers.cc:597] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:58.116530 23047 leader_election.cc:290] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Requested vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:08:58.117440 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:58.125221 16560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9e6e3a4a404a9893a40afed3d0179f" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "035eaa2f12374a81a4df7868a5453d3c"
I20260709 13:08:58.125826 16560 raft_consensus.cc:3060] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:58.150104 16604 consensus_peers.cc:597] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.168473 17152 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.175870 16560 raft_consensus.cc:2468] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 17.
W20260709 13:08:58.179132 16604 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111) [suppressed 422 similar messages]
W20260709 13:08:58.183535 16604 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.186571 16604 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.199180 16374 catalog_manager.cc:4755] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b9de9d7206ba42568149f95eb24f22ef: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:08:58.204232 17153 leader_election.cc:304] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76
I20260709 13:08:58.205340 23075 raft_consensus.cc:2804] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:58.205824 23075 raft_consensus.cc:697] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:08:58.206591 23075 consensus_queue.cc:237] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:08:58.227840 16604 consensus_peers.cc:597] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:58.229086 16385 catalog_manager.cc:5697] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 15 to 17, leader changed from 359213375db14f3d874c121993f90d76 (127.15.6.1) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 17 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:58.238873 16604 consensus_peers.cc:597] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.239487 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.251946 17152 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.278923 16530 consensus_peers.cc:597] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.286165 16604 consensus_peers.cc:597] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.288972 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.323549 16604 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.331990 16530 consensus_peers.cc:597] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.337589 15384 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16512)
W20260709 13:08:58.363669 16604 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.389916 16604 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.431245 16530 consensus_peers.cc:597] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.465487 16604 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.467103 16530 consensus_peers.cc:597] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.468854 16604 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.518637 16530 consensus_peers.cc:597] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.535292 17152 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.553159 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.560143 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.578367 16604 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.602790 16530 consensus_peers.cc:597] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.662415 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:58.708006 16565 raft_consensus.cc:1275] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:58.709611 23075 consensus_queue.cc:1048] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:58.736887 16604 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.774292 17152 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:58.788079 16530 consensus_peers.cc:597] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.801719 16530 consensus_peers.cc:597] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.803216 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.834656 17152 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.877909 16530 consensus_peers.cc:597] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.911916 16530 consensus_peers.cc:597] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.085917 16530 consensus_peers.cc:597] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.087559 16530 consensus_peers.cc:597] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.172693 16530 consensus_peers.cc:597] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.289222 16374 catalog_manager.cc:4755] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b9de9d7206ba42568149f95eb24f22ef: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:08:59.307998 16530 consensus_peers.cc:597] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.338004 15384 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16512)
W20260709 13:08:59.448186 17152 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.458331 17152 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.511842 16604 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.548048 16530 consensus_peers.cc:597] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.701071 16530 consensus_peers.cc:597] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.053938 16530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:45431, user_credentials={real_user=slave}} blocked reactor thread for 65617.9us
W20260709 13:09:00.338091 16604 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.339186 15384 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 16512)
W20260709 13:09:00.490197 16530 consensus_peers.cc:597] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.515758 16604 consensus_peers.cc:597] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.555476 16604 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.588256 16604 consensus_peers.cc:597] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.594419 16604 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.664124 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.748942 17152 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.764237 16530 consensus_peers.cc:597] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.791321 16604 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.797888 16530 consensus_peers.cc:597] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.828327 16604 consensus_peers.cc:597] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.846016 17152 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.873914 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.876093 16604 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.917380 16604 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.936533 17152 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.940649 16604 consensus_peers.cc:597] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.957897 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.020924 16530 consensus_peers.cc:597] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.067461 16604 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.109055 16530 consensus_peers.cc:597] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.109818 16530 consensus_peers.cc:597] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.113489 16530 consensus_peers.cc:597] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.131349 16604 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.152478 16530 consensus_peers.cc:597] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.168401 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.217015 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.237519 16530 consensus_peers.cc:597] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.240427 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.279907 17152 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.304797 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.339619 15384 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 16512)
W20260709 13:09:01.364524 17152 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.378433 16374 catalog_manager.cc:4755] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b9de9d7206ba42568149f95eb24f22ef: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:01.508567 16530 consensus_peers.cc:597] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.575193 16530 consensus_peers.cc:597] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.576010 16530 consensus_peers.cc:597] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.589630 16530 consensus_peers.cc:597] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.730611 16530 consensus_peers.cc:597] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.731513 16530 consensus_peers.cc:597] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.943082 17152 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.208251 16604 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.212437 17152 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.236538 16604 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.281150 16530 consensus_peers.cc:597] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.293244 16530 consensus_peers.cc:597] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.324820 16604 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:02.363668 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
I20260709 13:09:02.792809 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
W20260709 13:09:02.802248 16605 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.822072 16605 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.839334 17153 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.861352 16605 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.875226 16605 consensus_peers.cc:597] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.889211 17153 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.925482 17153 consensus_peers.cc:597] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:02.941378 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:02.951726 16605 consensus_peers.cc:597] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:02.956120 15384 tablet_replica.cc:333] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:02.957224 15384 raft_consensus.cc:2243] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.959043 15384 raft_consensus.cc:2272] T b1ada08378e34050bfc80a9f6893b014 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.963196 15384 tablet_replica.cc:333] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:02.963997 15384 raft_consensus.cc:2243] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.964497 15384 raft_consensus.cc:2272] T 6f3eed6f88504d69aad570d8cc480623 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.967674 16530 consensus_peers.cc:597] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:02.977794 15384 tablet_replica.cc:333] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:02.980012 15384 raft_consensus.cc:2243] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.981046 15384 raft_consensus.cc:2272] T 1eda6987d51b45e0a0672ec78b798b0f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.983521 15384 tablet_replica.cc:333] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:02.985500 15384 raft_consensus.cc:2243] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.986019 15384 raft_consensus.cc:2272] T 5f89989988c641f59bbc5b03e885656b P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.996090 16605 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.000147 15384 tablet_replica.cc:333] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.001098 15384 raft_consensus.cc:2243] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.001664 15384 raft_consensus.cc:2272] T c489b078811a4d66b4a4c4cacb1dbf2d P 035eaa2f12374a81a4df7868a5453d3c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.008340 15384 tablet_replica.cc:333] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.009114 15384 raft_consensus.cc:2243] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.010179 15384 raft_consensus.cc:2272] T 26d0f0e748bb4817a08afec4338c216a P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.021091 15384 tablet_replica.cc:333] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.021871 15384 raft_consensus.cc:2243] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.026477 15384 raft_consensus.cc:2272] T 1670d7fa8dd74ffb9fc8584e273d75da P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.023998 16605 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.031909 16605 consensus_peers.cc:597] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:02.997677 16530 consensus_peers.cc:597] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:03.038247 15384 tablet_replica.cc:333] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.042518 15384 raft_consensus.cc:2243] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.043097 15384 raft_consensus.cc:2272] T 836ce75918dd4690b2a75522b473f405 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.045715 15384 tablet_replica.cc:333] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.046452 15384 raft_consensus.cc:2243] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.047139 15384 raft_consensus.cc:2272] T 3b22e951e8c745fd96de0226683aff04 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.049497 15384 tablet_replica.cc:333] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.055325 15384 raft_consensus.cc:2243] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.056300 15384 raft_consensus.cc:2272] T 08a8884f986b4b43beecab72a521a3eb P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.058862 15384 tablet_replica.cc:333] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.068368 15384 raft_consensus.cc:2243] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.069113 15384 raft_consensus.cc:2272] T 8a89d28915e9486ba50f8fdafb99a037 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.070525 16605 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.072064 16605 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.077953 17153 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.078763 17153 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.071560 15384 tablet_replica.cc:333] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.080467 15384 raft_consensus.cc:2243] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.081063 15384 raft_consensus.cc:2272] T 16de3b472e2a4b62908fb29412b52f14 P 035eaa2f12374a81a4df7868a5453d3c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.083870 15384 tablet_replica.cc:333] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.084694 15384 raft_consensus.cc:2243] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.085718 15384 raft_consensus.cc:2272] T e9a943513f89492ba24cbf67180d01f3 P 035eaa2f12374a81a4df7868a5453d3c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.088285 15384 tablet_replica.cc:333] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.089036 15384 raft_consensus.cc:2243] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.089591 15384 raft_consensus.cc:2272] T 82af48cecc58434e959547ec318fa4c5 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.097404 16605 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.101713 15384 tablet_replica.cc:333] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.102643 15384 raft_consensus.cc:2243] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.103246 15384 raft_consensus.cc:2272] T ca9e6e3a4a404a9893a40afed3d0179f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.103706 17153 consensus_peers.cc:597] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.109261 15384 tablet_replica.cc:333] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.110102 15384 raft_consensus.cc:2243] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:09:03.110538 17152 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:03.111958 15384 raft_consensus.cc:2272] T a22c30518dd74380871bcf169099e049 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.116564 15384 tablet_replica.cc:333] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.117444 15384 raft_consensus.cc:2243] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.120607 15384 raft_consensus.cc:2272] T 5a35bf299a154270b54e15fd1cbb505c P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.123629 16605 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.124995 15384 tablet_replica.cc:333] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.128384 15384 raft_consensus.cc:2243] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.138280 15384 raft_consensus.cc:2272] T 318a7033cb194c3f8c635e0e36d5dc53 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.140908 15384 tablet_replica.cc:333] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.141558 15384 raft_consensus.cc:2243] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.142169 15384 raft_consensus.cc:2272] T 4df4eab2c270411ebedb43bc97966c7f P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.154558 15384 tablet_replica.cc:333] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.155294 15384 raft_consensus.cc:2243] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.156461 15384 raft_consensus.cc:2272] T 7dd7d3c7e92b43ee946d2d4505a17c43 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.158504 17153 consensus_peers.cc:597] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.161980 15384 tablet_replica.cc:333] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.162577 15384 raft_consensus.cc:2243] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.163138 15384 raft_consensus.cc:2272] T ddfb4b0791d74c589434dee63459ca4f P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.165311 15384 tablet_replica.cc:333] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.179898 15384 raft_consensus.cc:2243] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.180938 15384 raft_consensus.cc:2272] T aa6d2ae2d1794655a3e58da8d53b412a P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.176461 17153 consensus_peers.cc:597] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.182343 17152 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111) [suppressed 457 similar messages]
I20260709 13:09:03.183408 15384 tablet_replica.cc:333] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.184159 15384 raft_consensus.cc:2243] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.185106 15384 raft_consensus.cc:2272] T 71cad9c33f0b4530881909502ebdc720 P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.187402 15384 tablet_replica.cc:333] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.188119 15384 raft_consensus.cc:2243] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.189042 15384 raft_consensus.cc:2272] T e1b4ff396aa14325948460c8a0fcd925 P 035eaa2f12374a81a4df7868a5453d3c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.213299 17153 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.214555 15384 tablet_replica.cc:333] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.216090 15384 raft_consensus.cc:2243] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.217384 15384 raft_consensus.cc:2272] T b9de9d7206ba42568149f95eb24f22ef P 035eaa2f12374a81a4df7868a5453d3c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.219926 15384 tablet_replica.cc:333] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.220724 15384 raft_consensus.cc:2243] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.221289 15384 raft_consensus.cc:2272] T dd80ac0ca5c24b45831f9f1d02066656 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.223945 15384 tablet_replica.cc:333] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.224658 15384 raft_consensus.cc:2243] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.225235 15384 raft_consensus.cc:2272] T f1d7270021514f3c83a70987981f65cf P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.227733 15384 tablet_replica.cc:333] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.228518 15384 raft_consensus.cc:2243] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.229060 15384 raft_consensus.cc:2272] T da035835f764425db56e9649db0a0bcc P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.236989 16605 consensus_peers.cc:597] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.239461 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.242121 16605 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.244791 17153 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.255581 17153 consensus_peers.cc:597] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.256464 15384 tablet_replica.cc:333] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.257263 15384 raft_consensus.cc:2243] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.258262 15384 raft_consensus.cc:2272] T a8f74647bc1e4de09af86d4c90a3dc13 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.260600 15384 tablet_replica.cc:333] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.261317 15384 raft_consensus.cc:2243] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.262249 15384 raft_consensus.cc:2272] T 18244033cce043c69c8f4584b91ddc0d P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.264613 15384 tablet_replica.cc:333] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.265353 15384 raft_consensus.cc:2243] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.266325 15384 raft_consensus.cc:2272] T f7f595b7864d413a8f05d3b5e1f50aec P 035eaa2f12374a81a4df7868a5453d3c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.268805 15384 tablet_replica.cc:333] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.269541 15384 raft_consensus.cc:2243] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.270498 15384 raft_consensus.cc:2272] T faea00d3379945fd9f9d98c82429c8d5 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.272920 15384 tablet_replica.cc:333] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.273646 15384 raft_consensus.cc:2243] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.274611 15384 raft_consensus.cc:2272] T f61b94df305e465c9e3aae1bf4931b69 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.276993 15384 tablet_replica.cc:333] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.277680 15384 raft_consensus.cc:2243] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.278394 15384 raft_consensus.cc:2272] T d64e83e5333143e393eb71aac8666e63 P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.280825 15384 tablet_replica.cc:333] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.286898 15384 raft_consensus.cc:2243] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.287494 15384 raft_consensus.cc:2272] T f9f76c206fdf425385a859d72331f02b P 035eaa2f12374a81a4df7868a5453d3c [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.286923 17153 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.289726 17153 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.293066 15384 tablet_replica.cc:333] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.293849 15384 raft_consensus.cc:2243] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.294625 15384 raft_consensus.cc:2272] T b235e470ebe04d06993b8dd025e5871b P 035eaa2f12374a81a4df7868a5453d3c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.297506 15384 tablet_replica.cc:333] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.298203 15384 raft_consensus.cc:2243] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.299155 15384 raft_consensus.cc:2272] T 08c3cde3ed474891aeea9ff365ee8a9d P 035eaa2f12374a81a4df7868a5453d3c [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.308503 17152 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:03.308169 15384 tablet_replica.cc:333] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.313227 15384 raft_consensus.cc:2243] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.314045 15384 raft_consensus.cc:2272] T a8c27c31776b4e60afb061384a2ea62e P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.316443 15384 tablet_replica.cc:333] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.317118 15384 raft_consensus.cc:2243] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.317831 15384 raft_consensus.cc:2272] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.320266 15384 tablet_replica.cc:333] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.320922 15384 raft_consensus.cc:2243] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.322039 15384 raft_consensus.cc:2272] T e5369c1ed0fb429bab44a33761ca4553 P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.324347 15384 tablet_replica.cc:333] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.325034 15384 raft_consensus.cc:2243] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.326164 15384 raft_consensus.cc:2272] T 09733d7b0f3c42c3b742542d81067fe0 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.337042 15384 tablet_replica.cc:333] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
W20260709 13:09:03.344305 17152 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:03.345715 15384 raft_consensus.cc:2243] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.347582 15384 raft_consensus.cc:2272] T 04f67e2620d84985a37dbf9b77909370 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.350503 16604 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:03.351467 15384 tablet_replica.cc:333] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.352226 15384 raft_consensus.cc:2243] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.352764 15384 raft_consensus.cc:2272] T a2d7c9def9a84db7a3a3e5199a328236 P 035eaa2f12374a81a4df7868a5453d3c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.355501 15384 tablet_replica.cc:333] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.356230 15384 raft_consensus.cc:2243] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.356822 15384 raft_consensus.cc:2272] T d45b7d1fd3cc4d48b36627737b07663c P 035eaa2f12374a81a4df7868a5453d3c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.359427 15384 tablet_replica.cc:333] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.360093 15384 raft_consensus.cc:2243] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.360639 15384 raft_consensus.cc:2272] T 4deba3ef5feb443b8e28599a079603bd P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.371615 15384 tablet_replica.cc:333] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.372329 15384 raft_consensus.cc:2243] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.373752 15384 raft_consensus.cc:2272] T 9b8d067430b24267b8a20f78d68ac412 P 035eaa2f12374a81a4df7868a5453d3c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.376317 15384 tablet_replica.cc:333] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.376933 15384 raft_consensus.cc:2243] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:03.377586 15384 raft_consensus.cc:2272] T ecb26c2b33364a6583c0073862883947 P 035eaa2f12374a81a4df7868a5453d3c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:03.379869 15384 tablet_replica.cc:333] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c: stopping tablet replica
I20260709 13:09:03.380467 15384 raft_consensus.cc:2243] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:03.381461 15384 raft_consensus.cc:2272] T cd6d2553f797441c910fb72d81b1049f P 035eaa2f12374a81a4df7868a5453d3c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:03.430866 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.464495 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.526211 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.535133 16604 consensus_peers.cc:597] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.599050 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.640419 16603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:44223, user_credentials={real_user=slave}} blocked reactor thread for 72147us
W20260709 13:09:03.643265 16604 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.778133 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.780558 16604 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.784564 17152 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.822510 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.913120 16604 consensus_peers.cc:597] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.997200 16604 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.016498 16604 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:04.049250 23105 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.049835 23105 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.051923 23105 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.060334 17153 leader_election.cc:336] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.060808 17152 leader_election.cc:336] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.061198 17152 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.061830 23105 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.127565 23107 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.128088 23107 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.130091 23107 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.131342 16604 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.137614 17152 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.144416 16604 leader_election.cc:336] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:04.148164 16605 leader_election.cc:336] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.150959 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.151633 23107 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:04.170113 16604 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.181425 16604 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.204736 16604 consensus_peers.cc:597] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:04.237919 22981 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.238389 22981 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.240165 22981 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.246878 16604 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:04.250924 16605 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.252242 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.252974 22981 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:04.287101 22981 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.287562 22981 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.289500 22981 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.303679 16605 leader_election.cc:336] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.307471 17152 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.308446 16604 leader_election.cc:336] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.314471 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.315586 23108 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:04.323521 16604 consensus_peers.cc:597] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:04.330677 23108 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.331213 23108 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.334635 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:04.334949 23108 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.343708 23108 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.345492 23108 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.350145 23108 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.350994 16604 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.358832 16604 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 16b5b367990f4b5c862484bdec0b9226, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.401763 23108 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:04.395434 16605 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.418490 16605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:34831, user_credentials={real_user=slave}} blocked reactor thread for 60261.9us
W20260709 13:09:04.432189 16604 leader_election.cc:336] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.432588 22981 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.433321 22981 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.436133 23105 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.437757 22981 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:04.440325 23105 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:04.442088 16605 leader_election.cc:336] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.447181 23113 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.448105 23113 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.442260 22981 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.449940 22981 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.450855 23113 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:04.446534 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.454119 23107 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:04.458328 22981 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:09:04.442826 16604 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.459975 17152 leader_election.cc:336] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:04.466796 16604 leader_election.cc:336] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.469556 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
W20260709 13:09:04.470497 17152 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:04.472697 23113 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.473578 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:04.478791 23113 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.480705 17186 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:09:04.481029 23113 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:04.485891 17153 leader_election.cc:336] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.486361 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:09:04.487143 17153 leader_election.cc:336] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.487234 23113 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.493566 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:09:04.497107 22981 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.497467 22981 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.497817 22981 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.445102 23105 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.499840 17153 leader_election.cc:336] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.507668 17152 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:04.508567 23105 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.525796 16638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:09:04.537312 23107 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.538025 23107 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.541687 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:04.541111 23107 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.555406 23105 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.556093 23105 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.558969 23105 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:04.560276 23113 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.560963 23113 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:04.563012 17153 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.563032 23113 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.568514 16605 leader_election.cc:336] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.569713 17153 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.572615 17152 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.575004 17152 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.576174 23113 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.574551 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:09:04.583977 17152 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.584506 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.585793 23113 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.587215 23115 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:04.592510 23107 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.593288 23107 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.592708 23105 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.594769 23105 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.600101 23116 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.600875 23116 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:09:04.601472 17152 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.602312 23113 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.602983 23113 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:04.606622 17153 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.607041 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.605055 23113 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:04.607918 23114 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.609465 23105 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.577960 16605 leader_election.cc:336] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.615216 23116 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.615857 17153 leader_election.cc:336] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.620441 23107 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:04.626772 23115 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.627434 23115 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.629724 23115 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.633785 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:09:04.634505 16636 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 16.
I20260709 13:09:04.636566 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:04.637140 17183 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:09:04.638765 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:09:04.640151 23115 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:04.640476 23115 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.640798 23115 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:04.641201 16604 leader_election.cc:336] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:04.641774 16604 leader_election.cc:336] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.616755 22981 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.643266 16638 raft_consensus.cc:2393] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 15: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:09:04.646570 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:09:04.648839 23115 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.652505 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b4ff396aa14325948460c8a0fcd925" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:09:04.653088 17183 raft_consensus.cc:3060] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.654357 23115 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.652704 16636 raft_consensus.cc:2393] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16b5b367990f4b5c862484bdec0b9226 in current term 16: Already voted for candidate f842280ae2ac4c68b0b7f6c093e27357 in this term.
I20260709 13:09:04.660306 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18244033cce043c69c8f4584b91ddc0d" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
I20260709 13:09:04.660835 17186 raft_consensus.cc:3060] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:04.668068 23115 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.669776 23115 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.672428 23115 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.675429 17184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:04.676033 17184 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 13.
I20260709 13:09:04.674417 17186 raft_consensus.cc:2468] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:09:04.677063 16603 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:09:04.678136 23115 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:04.678530 23115 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.678941 23115 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.677161 22981 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.684126 16603 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:09:04.669884 17183 raft_consensus.cc:2468] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 15.
I20260709 13:09:04.687763 23115 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.695524 16603 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 
I20260709 13:09:04.696389 23108 raft_consensus.cc:2804] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:04.696885 23108 raft_consensus.cc:697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:09:04.693439 23107 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.697991 23108 consensus_queue.cc:237] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.692596 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:04.698948 23107 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.698010 23115 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.700196 23105 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.701195 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:04.701962 23105 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.699219 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de9d7206ba42568149f95eb24f22ef" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226"
W20260709 13:09:04.694540 16605 leader_election.cc:336] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.704864 17183 raft_consensus.cc:3060] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:04.687945 22981 raft_consensus.cc:2804] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:04.705134 16605 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 16b5b367990f4b5c862484bdec0b9226
W20260709 13:09:04.703122 15384 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16587)
I20260709 13:09:04.704294 23107 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:04.705879 23116 raft_consensus.cc:2749] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:04.708763 16604 leader_election.cc:336] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.705736 22981 raft_consensus.cc:697] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
W20260709 13:09:04.706133 16605 leader_election.cc:336] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.710167 22981 consensus_queue.cc:237] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.710747 16605 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.711540 23116 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:04.713181 16605 leader_election.cc:336] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.713629 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.714680 23115 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:04.718161 23116 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.718840 23116 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.721055 23116 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:04.723104 23107 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.723683 23116 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.723826 23107 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.724296 23116 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:04.726090 23107 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:04.726240 23106 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.726930 23106 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.729401 23106 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:04.734586 17153 leader_election.cc:336] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.735935 16605 leader_election.cc:336] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.736747 16605 leader_election.cc:336] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.737344 16605 leader_election.cc:336] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.737965 16605 leader_election.cc:336] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.742925 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:09:04.743602 16636 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 19.
W20260709 13:09:04.742877 16605 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.749163 17152 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:09:04.749958 23105 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:04.750316 23105 raft_consensus.cc:493] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.750660 23105 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:04.753084 16605 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.753585 16605 leader_election.cc:336] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.755183 16605 leader_election.cc:336] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.755664 16605 leader_election.cc:336] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.756072 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.756824 23107 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:04.746668 16388 catalog_manager.cc:5697] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 14 to 15, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 15 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.761550 23105 raft_consensus.cc:515] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.763702 23105 leader_election.cc:290] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Requested vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:04.726215 23116 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:04.768410 17153 leader_election.cc:336] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:04.771647 16604 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.772660 16604 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.773986 23116 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.775661 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f61b94df305e465c9e3aae1bf4931b69" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357"
I20260709 13:09:04.776219 16636 raft_consensus.cc:3060] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.776682 17183 raft_consensus.cc:2468] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 14.
I20260709 13:09:04.778088 16603 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:09:04.780364 22981 raft_consensus.cc:2804] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:04.782771 16604 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.783250 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.783941 23116 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:04.785456 16604 leader_election.cc:336] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.785857 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.786509 23116 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.797286 22981 raft_consensus.cc:697] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Becoming Leader. State: Replica: f842280ae2ac4c68b0b7f6c093e27357, State: Running, Role: LEADER
I20260709 13:09:04.798292 22981 consensus_queue.cc:237] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.799541 16636 raft_consensus.cc:2468] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16b5b367990f4b5c862484bdec0b9226 in term 20.
I20260709 13:09:04.801693 17152 leader_election.cc:304] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c
I20260709 13:09:04.803221 23113 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.803977 23113 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.807090 23113 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:04.809434 16636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "16b5b367990f4b5c862484bdec0b9226" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f842280ae2ac4c68b0b7f6c093e27357" is_pre_election: true
I20260709 13:09:04.805390 23105 raft_consensus.cc:2804] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:04.810650 17152 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:04.811044 23105 raft_consensus.cc:697] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 20 LEADER]: Becoming Leader. State: Replica: 16b5b367990f4b5c862484bdec0b9226, State: Running, Role: LEADER
I20260709 13:09:04.811916 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
W20260709 13:09:04.812475 17153 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.812999 23114 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.812171 23105 consensus_queue.cc:237] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.854148 22981 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:04.854815 22981 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:04.858976 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:04.859567 17183 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
I20260709 13:09:04.857421 16385 catalog_manager.cc:5697] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 reported cstate change: term changed from 19 to 20, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4). New cstate: current_term: 20 leader_uuid: "16b5b367990f4b5c862484bdec0b9226" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:04.864744 16604 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:04.865592 16605 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:04.865983 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:04.868906 23116 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.872678 22981 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
I20260709 13:09:04.899359 16388 catalog_manager.cc:5697] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 15 to 16, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 16 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.901060 16388 catalog_manager.cc:5697] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 reported cstate change: term changed from 13 to 14, leader changed from 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2) to f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3). New cstate: current_term: 14 leader_uuid: "f842280ae2ac4c68b0b7f6c093e27357" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:04.965516 16604 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.085731 16605 consensus_peers.cc:597] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.133656 16605 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.166788 16604 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:05.175056 16605 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.189778 17186 raft_consensus.cc:1275] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:05.191507 22981 consensus_queue.cc:1048] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:05.206670 17153 consensus_peers.cc:597] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.238279 16605 consensus_peers.cc:597] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.241123 17186 raft_consensus.cc:1275] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:05.251384 23116 consensus_queue.cc:1048] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:05.252365 16605 consensus_peers.cc:597] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.284590 17153 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.305231 17153 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.306787 16605 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.311309 16605 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.316964 17186 raft_consensus.cc:1275] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Refusing update from remote peer f842280ae2ac4c68b0b7f6c093e27357: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:05.319391 23107 consensus_queue.cc:1048] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:05.344833 16605 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.385588 16605 consensus_peers.cc:597] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.447629 17153 consensus_peers.cc:597] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.450487 16636 raft_consensus.cc:1275] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Refusing update from remote peer 16b5b367990f4b5c862484bdec0b9226: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:09:05.459496 23105 consensus_queue.cc:1048] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:05.509694 17153 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.531108 16605 consensus_peers.cc:597] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.559087 17153 consensus_peers.cc:597] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.593170 17153 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.597069 16605 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.615411 16605 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.620764 16374 catalog_manager.cc:4755] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b9de9d7206ba42568149f95eb24f22ef: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:05.627152 17152 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.673099 17153 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.685933 16604 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.692019 17153 consensus_peers.cc:597] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.704140 17153 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.706053 15384 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16587)
W20260709 13:09:05.739724 16605 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.744534 16605 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.760821 23107 raft_consensus.cc:493] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:05.761471 23107 raft_consensus.cc:515] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:05.763468 23107 leader_election.cc:290] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:05.774802 16605 consensus_peers.cc:597] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.784204 16604 leader_election.cc:336] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:05.802804 17153 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.823246 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.830731 17153 consensus_peers.cc:597] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.834321 16605 leader_election.cc:336] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:05.836184 16605 leader_election.cc:304] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:05.836917 23107 raft_consensus.cc:2749] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:05.851687 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.895502 17152 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.896497 16605 consensus_peers.cc:597] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.898020 17153 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.923101 16604 consensus_peers.cc:597] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:05.923981 23107 raft_consensus.cc:493] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:05.924525 23107 raft_consensus.cc:515] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:05.926549 23107 leader_election.cc:290] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:05.933000 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.937949 16605 leader_election.cc:336] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:05.941548 16604 leader_election.cc:336] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:05.942006 16604 leader_election.cc:304] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:05.946753 23107 raft_consensus.cc:2749] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:05.947932 16605 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.975216 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.997174 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.024153 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.082345 17152 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.223249 16604 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:06.231068 23114 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.231673 23114 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:06.240118 17152 leader_election.cc:336] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:06.241159 23114 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:06.248471 23107 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.249053 23107 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:06.252321 23107 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:09:06.263248 16604 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:06.267747 23114 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.268349 23114 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:06.274411 17186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a35bf299a154270b54e15fd1cbb505c" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:06.275532 17186 raft_consensus.cc:2468] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
W20260709 13:09:06.283541 17152 leader_election.cc:336] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.274986 17153 consensus_peers.cc:597] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.289505 23114 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.301115 16604 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.301637 16605 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.305459 16605 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.319774 23107 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:06.321573 16604 consensus_peers.cc:597] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.336915 17153 leader_election.cc:336] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.338721 17153 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.346104 23114 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:06.381198 23132 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.381727 23132 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:06.383597 23132 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.390822 17152 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:06.395587 23107 raft_consensus.cc:493] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.396217 23107 raft_consensus.cc:515] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:06.400058 23107 leader_election.cc:290] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.401463 17153 leader_election.cc:336] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.405164 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.413156 23114 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:06.423453 16604 leader_election.cc:336] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.424180 16604 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.442503 16605 leader_election.cc:336] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.449600 16605 leader_election.cc:304] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.458189 23107 raft_consensus.cc:2749] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:06.466871 17153 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.470134 17153 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.471676 23107 raft_consensus.cc:493] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.472889 23107 raft_consensus.cc:515] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:06.474849 23107 leader_election.cc:290] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:06.477912 23114 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:06.482933 17152 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.487574 16604 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.502556 17152 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.516062 16604 consensus_peers.cc:597] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.522830 16605 leader_election.cc:336] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.524952 16605 leader_election.cc:304] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.529054 23107 raft_consensus.cc:2749] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:06.548171 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:06.592645 23107 raft_consensus.cc:493] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.593128 23107 raft_consensus.cc:515] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:06.595018 23107 leader_election.cc:290] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.600441 16604 leader_election.cc:336] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.609570 16605 leader_election.cc:336] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.610363 16605 leader_election.cc:304] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.611071 23107 raft_consensus.cc:2749] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:06.646863 23107 raft_consensus.cc:493] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.648592 23107 raft_consensus.cc:515] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:06.650760 23107 leader_election.cc:290] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.665688 16604 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.667281 16604 leader_election.cc:336] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.701823 16605 leader_election.cc:336] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.702715 16605 leader_election.cc:304] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.703490 23107 raft_consensus.cc:2749] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:06.706490 15384 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16587)
I20260709 13:09:06.707306 23107 raft_consensus.cc:493] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.707947 23107 raft_consensus.cc:515] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:06.710068 23107 leader_election.cc:290] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:06.716759 22981 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.731966 22981 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:06.734066 22981 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.725952 17152 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.744781 16604 leader_election.cc:336] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.761736 16604 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:06.776062 23132 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.776644 23132 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:06.778553 23132 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.783318 17152 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.787568 16604 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.799239 17153 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.800021 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:09:06.801996 16605 leader_election.cc:336] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.802767 16605 leader_election.cc:304] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.803294 23114 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:06.805176 16605 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.806041 16605 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.805632 23139 raft_consensus.cc:2749] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:06.807116 23107 raft_consensus.cc:2749] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:06.838737 16604 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:06.839629 23139 raft_consensus.cc:493] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.840204 23139 raft_consensus.cc:515] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
W20260709 13:09:06.873741 16605 leader_election.cc:336] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.891891 23139 leader_election.cc:290] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.896162 16604 consensus_peers.cc:597] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.900454 16604 leader_election.cc:336] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:06.900918 16604 leader_election.cc:304] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.901980 23139 raft_consensus.cc:2749] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:06.945654 23139 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:06.946229 23139 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:06.948211 23139 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:06.953976 16605 leader_election.cc:336] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.961805 23139 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
W20260709 13:09:06.962772 16604 leader_election.cc:336] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:06.963212 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.963467 23139 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:06.964866 23107 raft_consensus.cc:2749] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:06.965694 16604 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:06.968602 17183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8d067430b24267b8a20f78d68ac412" candidate_uuid: "f842280ae2ac4c68b0b7f6c093e27357" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "16b5b367990f4b5c862484bdec0b9226" is_pre_election: true
I20260709 13:09:06.969188 17183 raft_consensus.cc:2468] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f842280ae2ac4c68b0b7f6c093e27357 in term 16.
W20260709 13:09:06.972303 16604 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:06.975610 16605 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:06.976015 16605 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226, f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:06.976658 23107 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:06.976867 23139 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223)
W20260709 13:09:06.992506 16604 consensus_peers.cc:597] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:07.026496 23107 raft_consensus.cc:493] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:07.026985 23107 raft_consensus.cc:515] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:07.028906 23107 leader_election.cc:290] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:07.081561 17152 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.084801 16605 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:07.088814 16604 leader_election.cc:336] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:07.089221 16604 leader_election.cc:304] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:07.089848 23107 raft_consensus.cc:2749] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:07.254900 16605 consensus_peers.cc:597] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.535140 16605 consensus_peers.cc:597] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.558602 16605 consensus_peers.cc:597] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.608474 16605 consensus_peers.cc:597] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.636776 16604 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.699165 16605 consensus_peers.cc:597] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.707049 15384 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 16587)
W20260709 13:09:07.750048 16604 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.757893 16605 consensus_peers.cc:597] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.772377 16605 consensus_peers.cc:597] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.823734 16605 consensus_peers.cc:597] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.845942 17153 consensus_peers.cc:597] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.848399 17153 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.871501 16605 consensus_peers.cc:597] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.889564 17153 consensus_peers.cc:597] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.890053 17153 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.892087 17153 consensus_peers.cc:597] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.921564 17153 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.933815 16605 consensus_peers.cc:597] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.952016 16605 consensus_peers.cc:597] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:07.998736 17153 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.078572 17152 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.086503 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.170017 16605 consensus_peers.cc:597] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.184196 17152 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111) [suppressed 656 similar messages]
W20260709 13:09:08.203852 16605 consensus_peers.cc:597] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.206597 16605 consensus_peers.cc:597] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.208303 17153 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.230798 17153 consensus_peers.cc:597] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.269583 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08003da380 after lost signal to thread 15387
W20260709 13:09:08.270682 16661 debug-util.cc:398] Leaking SignalData structure 0x7b080009b640 after lost signal to thread 16423
W20260709 13:09:08.271982 16661 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5080 after lost signal to thread 16664
W20260709 13:09:08.273139 16661 debug-util.cc:398] Leaking SignalData structure 0x7b0800344e80 after lost signal to thread 17212
W20260709 13:09:08.297736 16605 consensus_peers.cc:597] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.298362 17153 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.317834 16605 consensus_peers.cc:597] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.337934 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.361146 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.382746 17152 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.395741 17153 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:08.430435 22981 raft_consensus.cc:493] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:08.431032 22981 raft_consensus.cc:515] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:08.434309 22981 leader_election.cc:290] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:08.445072 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:08.446074 17153 consensus_peers.cc:597] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.448398 16605 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:08.493081 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
I20260709 13:09:08.497591 23114 raft_consensus.cc:493] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:08.498221 23114 raft_consensus.cc:515] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:08.500644 23114 leader_election.cc:290] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:08.514279 22981 raft_consensus.cc:493] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:08.514786 22981 raft_consensus.cc:515] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } }
I20260709 13:09:08.517388 22981 leader_election.cc:290] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:08.525720 16605 leader_election.cc:336] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:08.529654 17152 leader_election.cc:336] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:08.544484 17153 leader_election.cc:336] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:08.546831 17153 leader_election.cc:304] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:08.552925 23114 raft_consensus.cc:2749] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:08.568562 16605 consensus_peers.cc:597] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.589587 17153 consensus_peers.cc:597] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.594501 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:08.636917 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
I20260709 13:09:08.644662 23114 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:08.645176 23114 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:08.654711 23114 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:08.658849 17153 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:08.661170 17152 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:08.661545 17152 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:08.662695 23132 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:08.675060 17152 consensus_peers.cc:597] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:08.676111 17152 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:08.679108 17152 consensus_peers.cc:597] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:08.680294 17152 consensus_peers.cc:597] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.697314 23132 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:08.697870 23132 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:08.699915 23132 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:08.703629 17152 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:08.705081 17153 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:08.705477 17153 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:08.706496 23132 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.725037 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:08.726011 15384 tablet_replica.cc:333] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.726924 15384 raft_consensus.cc:2243] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.727984 15384 raft_consensus.cc:2272] T b1ada08378e34050bfc80a9f6893b014 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.730620 15384 tablet_replica.cc:333] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.734513 15384 raft_consensus.cc:2243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.735414 15384 raft_consensus.cc:2272] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.740520 15384 tablet_replica.cc:333] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.741308 15384 raft_consensus.cc:2243] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.742084 15384 raft_consensus.cc:2272] T 26d0f0e748bb4817a08afec4338c216a P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.742265 17152 consensus_peers.cc:597] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.744628 15384 tablet_replica.cc:333] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.745424 15384 raft_consensus.cc:2243] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.745993 15384 raft_consensus.cc:2272] T 1eda6987d51b45e0a0672ec78b798b0f P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.748643 15384 tablet_replica.cc:333] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.749642 15384 raft_consensus.cc:2243] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.750622 15384 raft_consensus.cc:2272] T 5f89989988c641f59bbc5b03e885656b P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.751513 17152 consensus_peers.cc:597] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.753353 15384 tablet_replica.cc:333] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.754177 15384 raft_consensus.cc:2243] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.754995 15384 raft_consensus.cc:2272] T d4a969bf0b354736bf91615b8648cf36 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.757437 15384 tablet_replica.cc:333] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.758232 15384 raft_consensus.cc:2243] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.760128 15384 raft_consensus.cc:2272] T c489b078811a4d66b4a4c4cacb1dbf2d P f842280ae2ac4c68b0b7f6c093e27357 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.762459 15384 tablet_replica.cc:333] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.763209 15384 raft_consensus.cc:2243] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.763861 15384 raft_consensus.cc:2272] T 1670d7fa8dd74ffb9fc8584e273d75da P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.766723 17152 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:08.766343 15384 tablet_replica.cc:333] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
W20260709 13:09:08.767421 17152 consensus_peers.cc:597] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.769354 15384 raft_consensus.cc:2243] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.770288 15384 raft_consensus.cc:2272] T 836ce75918dd4690b2a75522b473f405 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.772789 15384 tablet_replica.cc:333] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.773454 15384 raft_consensus.cc:2243] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.775338 15384 raft_consensus.cc:2272] T 8a89d28915e9486ba50f8fdafb99a037 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.777572 15384 tablet_replica.cc:333] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.779016 15384 raft_consensus.cc:2243] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.780170 15384 raft_consensus.cc:2272] T 3b22e951e8c745fd96de0226683aff04 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.782725 15384 tablet_replica.cc:333] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.783370 15384 raft_consensus.cc:2243] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.784014 15384 raft_consensus.cc:2272] T 16de3b472e2a4b62908fb29412b52f14 P f842280ae2ac4c68b0b7f6c093e27357 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.786226 15384 tablet_replica.cc:333] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.786892 15384 raft_consensus.cc:2243] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.787707 15384 raft_consensus.cc:2272] T 755c5be0c60f44e5a3df52484c5c934f P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.790055 15384 tablet_replica.cc:333] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.790733 15384 raft_consensus.cc:2243] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.791357 15384 raft_consensus.cc:2272] T 82af48cecc58434e959547ec318fa4c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.793615 15384 tablet_replica.cc:333] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.794325 15384 raft_consensus.cc:2243] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.794939 15384 raft_consensus.cc:2272] T e9a943513f89492ba24cbf67180d01f3 P f842280ae2ac4c68b0b7f6c093e27357 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.797327 15384 tablet_replica.cc:333] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.797986 15384 raft_consensus.cc:2243] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.798954 15384 raft_consensus.cc:2272] T d34e55d2ce67443aaecb395469a9c7ce P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.801177 15384 tablet_replica.cc:333] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.801841 15384 raft_consensus.cc:2243] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.802663 15384 raft_consensus.cc:2272] T f66755c5c9714ae1858e6df5473a5cd6 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.804960 15384 tablet_replica.cc:333] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.805567 15384 raft_consensus.cc:2243] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.806298 15384 raft_consensus.cc:2272] T d64e83e5333143e393eb71aac8666e63 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.808524 15384 tablet_replica.cc:333] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.809163 15384 raft_consensus.cc:2243] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.810124 15384 raft_consensus.cc:2272] T f9f76c206fdf425385a859d72331f02b P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.812580 15384 tablet_replica.cc:333] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.813380 15384 raft_consensus.cc:2243] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.813907 15384 raft_consensus.cc:2272] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.816268 15384 tablet_replica.cc:333] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.816951 15384 raft_consensus.cc:2243] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.817538 15384 raft_consensus.cc:2272] T f7f595b7864d413a8f05d3b5e1f50aec P f842280ae2ac4c68b0b7f6c093e27357 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.819936 15384 tablet_replica.cc:333] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.820577 15384 raft_consensus.cc:2243] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.821790 15384 raft_consensus.cc:2272] T f61b94df305e465c9e3aae1bf4931b69 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.823943 15384 tablet_replica.cc:333] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.824602 15384 raft_consensus.cc:2243] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.825344 15384 raft_consensus.cc:2272] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.827690 15384 tablet_replica.cc:333] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.828342 15384 raft_consensus.cc:2243] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.829193 15384 raft_consensus.cc:2272] T da035835f764425db56e9649db0a0bcc P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.829500 17153 consensus_peers.cc:597] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:08.831620 15384 tablet_replica.cc:333] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.832403 15384 raft_consensus.cc:2243] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.832962 15384 raft_consensus.cc:2272] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.835289 15384 tablet_replica.cc:333] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.835938 15384 raft_consensus.cc:2243] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.836843 15384 raft_consensus.cc:2272] T 18244033cce043c69c8f4584b91ddc0d P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.839042 15384 tablet_replica.cc:333] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.839689 15384 raft_consensus.cc:2243] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.840556 15384 raft_consensus.cc:2272] T 5a35bf299a154270b54e15fd1cbb505c P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.843065 15384 tablet_replica.cc:333] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.843703 15384 raft_consensus.cc:2243] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.844239 15384 raft_consensus.cc:2272] T b235e470ebe04d06993b8dd025e5871b P f842280ae2ac4c68b0b7f6c093e27357 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.846521 15384 tablet_replica.cc:333] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.848183 15384 raft_consensus.cc:2243] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.848763 15384 raft_consensus.cc:2272] T 08c3cde3ed474891aeea9ff365ee8a9d P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.851225 15384 tablet_replica.cc:333] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
W20260709 13:09:08.851586 17152 consensus_peers.cc:597] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.851908 15384 raft_consensus.cc:2243] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.852514 15384 raft_consensus.cc:2272] T 9ac4e93cad76428c81439a9c5471f994 P f842280ae2ac4c68b0b7f6c093e27357 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.854938 15384 tablet_replica.cc:333] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.855600 15384 raft_consensus.cc:2243] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.856541 15384 raft_consensus.cc:2272] T 4df4eab2c270411ebedb43bc97966c7f P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.858584 16605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.858800 15384 tablet_replica.cc:333] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.859558 15384 raft_consensus.cc:2243] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.860332 15384 raft_consensus.cc:2272] T 7dd7d3c7e92b43ee946d2d4505a17c43 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.862707 15384 tablet_replica.cc:333] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.863348 15384 raft_consensus.cc:2243] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.864230 15384 raft_consensus.cc:2272] T aa6d2ae2d1794655a3e58da8d53b412a P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.866652 15384 tablet_replica.cc:333] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
W20260709 13:09:08.867152 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:08.867416 15384 raft_consensus.cc:2243] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.868556 15384 raft_consensus.cc:2272] T e1b4ff396aa14325948460c8a0fcd925 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.870791 15384 tablet_replica.cc:333] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.871426 15384 raft_consensus.cc:2243] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.872090 15384 raft_consensus.cc:2272] T cd0cddf61354438cac7dda825626e2c5 P f842280ae2ac4c68b0b7f6c093e27357 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.874364 15384 tablet_replica.cc:333] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.875016 15384 raft_consensus.cc:2243] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.876531 15384 raft_consensus.cc:2272] T b9de9d7206ba42568149f95eb24f22ef P f842280ae2ac4c68b0b7f6c093e27357 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.878795 15384 tablet_replica.cc:333] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.879431 15384 raft_consensus.cc:2243] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.880510 15384 raft_consensus.cc:2272] T dd80ac0ca5c24b45831f9f1d02066656 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.882730 15384 tablet_replica.cc:333] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.883342 15384 raft_consensus.cc:2243] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.884618 15384 raft_consensus.cc:2272] T ecb26c2b33364a6583c0073862883947 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.886830 15384 tablet_replica.cc:333] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.887434 15384 raft_consensus.cc:2243] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.887969 15384 raft_consensus.cc:2272] T 9b8d067430b24267b8a20f78d68ac412 P f842280ae2ac4c68b0b7f6c093e27357 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.890280 15384 tablet_replica.cc:333] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.890882 15384 raft_consensus.cc:2243] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.891551 15384 raft_consensus.cc:2272] T e5369c1ed0fb429bab44a33761ca4553 P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.893750 15384 tablet_replica.cc:333] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.894371 15384 raft_consensus.cc:2243] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.894902 15384 raft_consensus.cc:2272] T 09733d7b0f3c42c3b742542d81067fe0 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.897272 15384 tablet_replica.cc:333] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.897915 15384 raft_consensus.cc:2243] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.898922 15384 raft_consensus.cc:2272] T 04f67e2620d84985a37dbf9b77909370 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.901261 15384 tablet_replica.cc:333] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.901873 15384 raft_consensus.cc:2243] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.902714 15384 raft_consensus.cc:2272] T cc4151437571420aa297eb389f8c35af P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.905108 15384 tablet_replica.cc:333] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.905740 15384 raft_consensus.cc:2243] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.906629 15384 raft_consensus.cc:2272] T 441a1d437e7b4eff9f56f88ce7d935e5 P f842280ae2ac4c68b0b7f6c093e27357 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.908846 15384 tablet_replica.cc:333] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.909415 15384 raft_consensus.cc:2243] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.910010 15384 raft_consensus.cc:2272] T a6d40aa6b369461bb9f13d568e8450e7 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.912302 15384 tablet_replica.cc:333] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.912915 15384 raft_consensus.cc:2243] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.913833 15384 raft_consensus.cc:2272] T a2d7c9def9a84db7a3a3e5199a328236 P f842280ae2ac4c68b0b7f6c093e27357 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.915450 17152 consensus_peers.cc:597] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:08.915998 15384 tablet_replica.cc:333] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.917527 15384 raft_consensus.cc:2243] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.918330 15384 raft_consensus.cc:2272] T d45b7d1fd3cc4d48b36627737b07663c P f842280ae2ac4c68b0b7f6c093e27357 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.920548 15384 tablet_replica.cc:333] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357: stopping tablet replica
I20260709 13:09:08.921118 15384 raft_consensus.cc:2243] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.922089 15384 raft_consensus.cc:2272] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P f842280ae2ac4c68b0b7f6c093e27357 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:08.942471 16604 leader_election.cc:336] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:08.943653 16604 leader_election.cc:304] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:09:08.944309 16604 raft_consensus.cc:2686] T a8f74647bc1e4de09af86d4c90a3dc13 P f842280ae2ac4c68b0b7f6c093e27357: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:09:08.944919 16604 leader_election.cc:336] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:08.945366 16604 leader_election.cc:304] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f842280ae2ac4c68b0b7f6c093e27357; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
W20260709 13:09:08.946054 16604 raft_consensus.cc:2686] T faea00d3379945fd9f9d98c82429c8d5 P f842280ae2ac4c68b0b7f6c093e27357: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:09:08.964501 17152 consensus_peers.cc:597] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.017588 23132 raft_consensus.cc:493] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:09.018126 23132 raft_consensus.cc:515] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:09.023008 23132 leader_election.cc:290] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:09.028502 17153 leader_election.cc:336] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:09.030248 17152 leader_election.cc:336] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:09.030632 17152 leader_election.cc:304] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:09.031333 23132 raft_consensus.cc:2749] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:09.058216 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.083346 17152 consensus_peers.cc:597] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.094988 17152 consensus_peers.cc:597] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.112505 17152 consensus_peers.cc:597] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.142004 17152 consensus_peers.cc:597] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.168992 17152 consensus_peers.cc:597] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.178285 23147 raft_consensus.cc:493] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:09.179414 23147 raft_consensus.cc:515] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:09.186082 23147 leader_election.cc:290] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:09.186713 17153 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:09.200409 17152 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:09.200807 17152 leader_election.cc:304] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:09.201339 23147 raft_consensus.cc:2749] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:09.201471 17152 leader_election.cc:336] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:09.206162 17152 consensus_peers.cc:597] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.218462 23147 raft_consensus.cc:493] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:09.218884 23147 raft_consensus.cc:515] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:09.221259 23147 leader_election.cc:290] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
W20260709 13:09:09.224869 17153 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:09.227936 17152 leader_election.cc:336] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:09.228348 17152 leader_election.cc:304] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:09.229374 23147 raft_consensus.cc:2749] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:09.235446 17152 consensus_peers.cc:597] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 -> Peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Couldn't send request to peer f842280ae2ac4c68b0b7f6c093e27357. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.578579 17152 consensus_peers.cc:597] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 -> Peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Couldn't send request to peer 359213375db14f3d874c121993f90d76. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:09.776608 23147 raft_consensus.cc:493] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:09.777113 23147 raft_consensus.cc:515] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:09.779055 23147 leader_election.cc:290] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:09.783203 17153 leader_election.cc:336] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:09.784924 17152 leader_election.cc:336] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:09.785230 17152 leader_election.cc:304] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:09.785743 23147 raft_consensus.cc:2749] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:09.788350 23147 raft_consensus.cc:493] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:09.788700 23147 raft_consensus.cc:515] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:09.790329 23147 leader_election.cc:290] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:09.793874 17153 leader_election.cc:336] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:09.795064 17152 leader_election.cc:336] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:09.795358 17152 leader_election.cc:304] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:09.795862 23147 raft_consensus.cc:2749] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:10.043871 23147 raft_consensus.cc:493] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.044301 23147 raft_consensus.cc:515] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.045866 23147 leader_election.cc:290] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.049393 17153 leader_election.cc:336] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:10.050171 17152 leader_election.cc:336] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.050486 17152 leader_election.cc:304] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.051124 23147 raft_consensus.cc:2749] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.081007 23147 raft_consensus.cc:493] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.081540 23147 raft_consensus.cc:515] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:10.091111 17153 consensus_peers.cc:597] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:10.091616 23147 leader_election.cc:290] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.091625 17153 leader_election.cc:336] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:10.096745 17152 leader_election.cc:336] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.097062 17152 leader_election.cc:304] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.097560 23147 raft_consensus.cc:2749] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:10.101657 23147 raft_consensus.cc:493] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.102026 23147 raft_consensus.cc:515] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.103623 23147 leader_election.cc:290] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.107486 17153 leader_election.cc:336] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:10.108019 17152 leader_election.cc:336] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.108451 17152 leader_election.cc:304] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.109115 23147 raft_consensus.cc:2749] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:10.178829 23147 raft_consensus.cc:493] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.179255 23147 raft_consensus.cc:515] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.180970 23147 leader_election.cc:290] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.185031 17152 leader_election.cc:336] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.185086 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
W20260709 13:09:10.185597 17153 leader_election.cc:336] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:10.185956 17153 leader_election.cc:304] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.186605 23147 raft_consensus.cc:2749] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.192533 23147 raft_consensus.cc:493] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.193023 23147 raft_consensus.cc:515] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.195173 23147 leader_election.cc:290] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.201071 17152 leader_election.cc:336] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:10.201920 17152 leader_election.cc:336] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.202283 17152 leader_election.cc:304] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.202944 23147 raft_consensus.cc:2749] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.234452 23147 raft_consensus.cc:493] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.235113 23147 raft_consensus.cc:515] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } attrs { replace: true } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.238458 23147 leader_election.cc:290] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:10.241154 23147 raft_consensus.cc:493] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.241667 23147 raft_consensus.cc:515] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:10.245987 17153 leader_election.cc:336] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:10.247475 17152 leader_election.cc:336] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:10.247928 17152 leader_election.cc:304] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:10.248027 23147 leader_election.cc:290] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:10.248765 23147 raft_consensus.cc:2749] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:10.250886 23147 raft_consensus.cc:493] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:10.251423 23147 raft_consensus.cc:515] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } attrs { replace: true } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:10.253547 17152 leader_election.cc:336] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.260615 23146 raft_consensus.cc:493] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
W20260709 13:09:10.260761 17153 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:10.261240 23146 raft_consensus.cc:515] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.262085 23147 leader_election.cc:290] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.260202 17152 leader_election.cc:336] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.263294 23146 leader_election.cc:290] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.264365 17152 leader_election.cc:336] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:10.264848 17152 leader_election.cc:304] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.265942 23147 raft_consensus.cc:2749] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:10.266781 23132 raft_consensus.cc:493] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 035eaa2f12374a81a4df7868a5453d3c)
I20260709 13:09:10.270118 23132 raft_consensus.cc:515] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
W20260709 13:09:10.270390 17152 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:10.271456 23147 raft_consensus.cc:493] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.272058 23147 raft_consensus.cc:515] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.272080 23132 leader_election.cc:290] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831)
I20260709 13:09:10.274237 23147 leader_election.cc:290] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:10.270929 17152 leader_election.cc:304] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:10.276002 23147 raft_consensus.cc:2749] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:10.286353 17153 consensus_peers.cc:597] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.288353 17152 leader_election.cc:336] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:10.289057 17153 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:10.290982 17152 leader_election.cc:336] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
W20260709 13:09:10.291658 17152 leader_election.cc:336] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.292004 17152 leader_election.cc:304] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.292563 23146 raft_consensus.cc:2749] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:10.295303 17152 leader_election.cc:336] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:10.295640 17152 leader_election.cc:304] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, 359213375db14f3d874c121993f90d76
I20260709 13:09:10.296236 23146 raft_consensus.cc:2749] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:10.296423 17152 leader_election.cc:336] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
I20260709 13:09:10.296671 15384 tablet_server.cc:179] TabletServer@127.15.6.4:0 shutting down...
W20260709 13:09:10.297260 17152 leader_election.cc:336] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.297657 17152 leader_election.cc:304] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.298249 23146 raft_consensus.cc:2749] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:10.338165 17153 consensus_peers.cc:597] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:10.345810 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:10.346549 15384 tablet_replica.cc:333] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.347431 15384 raft_consensus.cc:2243] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.348198 15384 raft_consensus.cc:2272] T 5a35bf299a154270b54e15fd1cbb505c P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.349032 23147 raft_consensus.cc:493] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.349517 23147 raft_consensus.cc:515] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "359213375db14f3d874c121993f90d76" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 42809 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.351349 15384 tablet_replica.cc:333] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.351464 23147 leader_election.cc:290] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 359213375db14f3d874c121993f90d76 (127.15.6.1:42809), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
W20260709 13:09:10.351984 17153 consensus_peers.cc:597] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:10.352420 15384 raft_consensus.cc:2243] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:09:10.352506 17153 consensus_peers.cc:597] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 -> Peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Couldn't send request to peer 035eaa2f12374a81a4df7868a5453d3c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:10.354802 15384 raft_consensus.cc:2272] T a8c27c31776b4e60afb061384a2ea62e P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:10.356547 17152 leader_election.cc:336] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:10.357311 17152 leader_election.cc:336] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.357614 17152 leader_election.cc:304] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 359213375db14f3d874c121993f90d76, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.358143 15384 tablet_replica.cc:333] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.358132 23147 raft_consensus.cc:2749] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:10.359243 15384 raft_consensus.cc:2243] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.360335 15384 raft_consensus.cc:2272] T ca9e6e3a4a404a9893a40afed3d0179f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.363101 15384 tablet_replica.cc:333] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.363876 15384 raft_consensus.cc:2243] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.364651 15384 raft_consensus.cc:2272] T b1ada08378e34050bfc80a9f6893b014 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.367295 15384 tablet_replica.cc:333] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.368057 15384 raft_consensus.cc:2243] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.368852 15384 raft_consensus.cc:2272] T 441a1d437e7b4eff9f56f88ce7d935e5 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.371604 15384 tablet_replica.cc:333] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.372354 15384 raft_consensus.cc:2243] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.373106 15384 raft_consensus.cc:2272] T 9b8d067430b24267b8a20f78d68ac412 P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.375519 15384 tablet_replica.cc:333] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.376230 15384 raft_consensus.cc:2243] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.377207 15384 raft_consensus.cc:2272] T a2d7c9def9a84db7a3a3e5199a328236 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.379853 15384 tablet_replica.cc:333] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.380621 15384 raft_consensus.cc:2243] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.381374 15384 raft_consensus.cc:2272] T cc4151437571420aa297eb389f8c35af P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.383958 15384 tablet_replica.cc:333] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.384703 15384 raft_consensus.cc:2243] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.385313 15384 raft_consensus.cc:2272] T 08a8884f986b4b43beecab72a521a3eb P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.387743 15384 tablet_replica.cc:333] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.388439 15384 raft_consensus.cc:2243] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.389380 15384 raft_consensus.cc:2272] T 16de3b472e2a4b62908fb29412b52f14 P 16b5b367990f4b5c862484bdec0b9226 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.391778 15384 tablet_replica.cc:333] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.392556 15384 raft_consensus.cc:2243] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.393492 15384 raft_consensus.cc:2272] T d64e83e5333143e393eb71aac8666e63 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.395808 15384 tablet_replica.cc:333] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.396504 15384 raft_consensus.cc:2243] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.397455 15384 raft_consensus.cc:2272] T 2f95c63e093b4ba3b6fa7c2c62b717c9 P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.399896 15384 tablet_replica.cc:333] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.400614 15384 raft_consensus.cc:2243] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.401115 15384 raft_consensus.cc:2272] T a22c30518dd74380871bcf169099e049 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.403553 15384 tablet_replica.cc:333] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.404377 15384 raft_consensus.cc:2243] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.404968 15384 raft_consensus.cc:2272] T ecb26c2b33364a6583c0073862883947 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.407691 15384 tablet_replica.cc:333] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.408380 15384 raft_consensus.cc:2243] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.408952 15384 raft_consensus.cc:2272] T 71cad9c33f0b4530881909502ebdc720 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.411366 15384 tablet_replica.cc:333] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.412045 15384 raft_consensus.cc:2243] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.412959 15384 raft_consensus.cc:2272] T 26f64e4c7b2a4c3c92b69f1d3cbd9737 P 16b5b367990f4b5c862484bdec0b9226 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.415331 15384 tablet_replica.cc:333] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.416067 15384 raft_consensus.cc:2243] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.417207 15384 raft_consensus.cc:2272] T f61b94df305e465c9e3aae1bf4931b69 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.417981 23147 raft_consensus.cc:493] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f842280ae2ac4c68b0b7f6c093e27357)
I20260709 13:09:10.418365 23147 raft_consensus.cc:515] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "035eaa2f12374a81a4df7868a5453d3c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 34831 } } peers { permanent_uuid: "f842280ae2ac4c68b0b7f6c093e27357" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 45431 } } peers { permanent_uuid: "16b5b367990f4b5c862484bdec0b9226" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 44223 } attrs { promote: false } }
I20260709 13:09:10.420234 15384 tablet_replica.cc:333] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.420318 23147 leader_election.cc:290] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831), f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431)
I20260709 13:09:10.421092 15384 raft_consensus.cc:2243] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.421736 15384 raft_consensus.cc:2272] T 18244033cce043c69c8f4584b91ddc0d P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.424238 15384 tablet_replica.cc:333] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
W20260709 13:09:10.424909 17152 leader_election.cc:336] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f842280ae2ac4c68b0b7f6c093e27357 (127.15.6.3:45431): Network error: Client connection negotiation failed: client connection to 127.15.6.3:45431: connect: Connection refused (error 111)
I20260709 13:09:10.424949 15384 raft_consensus.cc:2243] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:10.425590 17153 leader_election.cc:336] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
I20260709 13:09:10.425935 15384 raft_consensus.cc:2272] T d4a969bf0b354736bf91615b8648cf36 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.425936 17153 leader_election.cc:304] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16b5b367990f4b5c862484bdec0b9226; no voters: 035eaa2f12374a81a4df7868a5453d3c, f842280ae2ac4c68b0b7f6c093e27357
I20260709 13:09:10.426774 23147 raft_consensus.cc:2749] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:10.428843 15384 tablet_replica.cc:333] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.429638 15384 raft_consensus.cc:2243] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.430311 15384 raft_consensus.cc:2272] T b9de9d7206ba42568149f95eb24f22ef P 16b5b367990f4b5c862484bdec0b9226 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.433029 15384 tablet_replica.cc:333] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.433676 15384 raft_consensus.cc:2243] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.434614 15384 raft_consensus.cc:2272] T 318a7033cb194c3f8c635e0e36d5dc53 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.436995 15384 tablet_replica.cc:333] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.437649 15384 raft_consensus.cc:2243] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.438593 15384 raft_consensus.cc:2272] T f1d7270021514f3c83a70987981f65cf P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.440927 15384 tablet_replica.cc:333] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.441581 15384 raft_consensus.cc:2243] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.442054 15384 raft_consensus.cc:2272] T e1b4ff396aa14325948460c8a0fcd925 P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.444270 15384 tablet_replica.cc:333] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.444911 15384 raft_consensus.cc:2243] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.445554 15384 raft_consensus.cc:2272] T cd6d2553f797441c910fb72d81b1049f P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.447937 15384 tablet_replica.cc:333] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.448589 15384 raft_consensus.cc:2243] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.449131 15384 raft_consensus.cc:2272] T 755c5be0c60f44e5a3df52484c5c934f P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.451426 15384 tablet_replica.cc:333] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.452077 15384 raft_consensus.cc:2243] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.453066 15384 raft_consensus.cc:2272] T 4deba3ef5feb443b8e28599a079603bd P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.455955 15384 tablet_replica.cc:333] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.456589 15384 raft_consensus.cc:2243] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.457547 15384 raft_consensus.cc:2272] T a6d40aa6b369461bb9f13d568e8450e7 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.459931 15384 tablet_replica.cc:333] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.460592 15384 raft_consensus.cc:2243] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.461115 15384 raft_consensus.cc:2272] T dd80ac0ca5c24b45831f9f1d02066656 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.463446 15384 tablet_replica.cc:333] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.464151 15384 raft_consensus.cc:2243] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.465265 15384 raft_consensus.cc:2272] T 82af48cecc58434e959547ec318fa4c5 P 16b5b367990f4b5c862484bdec0b9226 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.467672 15384 tablet_replica.cc:333] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.468322 15384 raft_consensus.cc:2243] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.469251 15384 raft_consensus.cc:2272] T 9ac4e93cad76428c81439a9c5471f994 P 16b5b367990f4b5c862484bdec0b9226 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.471551 15384 tablet_replica.cc:333] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.472210 15384 raft_consensus.cc:2243] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.473152 15384 raft_consensus.cc:2272] T b235e470ebe04d06993b8dd025e5871b P 16b5b367990f4b5c862484bdec0b9226 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.475534 15384 tablet_replica.cc:333] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.476246 15384 raft_consensus.cc:2243] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.476939 15384 raft_consensus.cc:2272] T 04f67e2620d84985a37dbf9b77909370 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.479781 15384 tablet_replica.cc:333] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.480432 15384 raft_consensus.cc:2243] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.481379 15384 raft_consensus.cc:2272] T cd0cddf61354438cac7dda825626e2c5 P 16b5b367990f4b5c862484bdec0b9226 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.483842 15384 tablet_replica.cc:333] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.484454 15384 raft_consensus.cc:2243] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.485483 15384 raft_consensus.cc:2272] T 6f3eed6f88504d69aad570d8cc480623 P 16b5b367990f4b5c862484bdec0b9226 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.487814 15384 tablet_replica.cc:333] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.488441 15384 raft_consensus.cc:2243] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.489300 15384 raft_consensus.cc:2272] T bb5cfc5d25214ed5a2298f98f0b9a0a9 P 16b5b367990f4b5c862484bdec0b9226 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.491714 15384 tablet_replica.cc:333] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.492372 15384 raft_consensus.cc:2243] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.493309 15384 raft_consensus.cc:2272] T 1670d7fa8dd74ffb9fc8584e273d75da P 16b5b367990f4b5c862484bdec0b9226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.495885 15384 tablet_replica.cc:333] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.496516 15384 raft_consensus.cc:2243] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.497435 15384 raft_consensus.cc:2272] T ddfb4b0791d74c589434dee63459ca4f P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.499825 15384 tablet_replica.cc:333] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.500476 15384 raft_consensus.cc:2243] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:10.501389 15384 raft_consensus.cc:2272] T d34e55d2ce67443aaecb395469a9c7ce P 16b5b367990f4b5c862484bdec0b9226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.504052 15384 tablet_replica.cc:333] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226: stopping tablet replica
I20260709 13:09:10.504616 15384 raft_consensus.cc:2243] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.505111 15384 raft_consensus.cc:2272] T f66755c5c9714ae1858e6df5473a5cd6 P 16b5b367990f4b5c862484bdec0b9226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.780221 15384 tablet_server.cc:196] TabletServer@127.15.6.4:0 shutdown complete.
I20260709 13:09:10.850502 15384 master.cc:562] Master@127.15.6.62:43625 shutting down...
W20260709 13:09:10.885138 16437 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:09:10.885376 16437 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:10.885555 16437 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:13.851758 16374 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111) [suppressed 263 similar messages]
W20260709 13:09:13.856825 16374 catalog_manager.cc:4755] TS 359213375db14f3d874c121993f90d76 (127.15.6.1:42809): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b9de9d7206ba42568149f95eb24f22ef: Network error: Client connection negotiation failed: client connection to 127.15.6.1:42809: connect: Connection refused (error 111)
W20260709 13:09:39.896126 16375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:39.899374 16375 catalog_manager.cc:4755] TS 035eaa2f12374a81a4df7868a5453d3c (127.15.6.2:34831): ChangeConfig:REMOVE_PEER RPC failed for tablet 9b8d067430b24267b8a20f78d68ac412: Network error: Client connection negotiation failed: client connection to 127.15.6.2:34831: connect: Connection refused (error 111)
W20260709 13:09:44.762030 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08000954a0 after lost signal to thread 15387
W20260709 13:09:44.762671 16420 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3240 after lost signal to thread 16423
W20260709 13:09:50.392835 16373 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.4:44223: connect: Connection refused (error 111)
W20260709 13:09:50.396101 16373 catalog_manager.cc:4755] TS 16b5b367990f4b5c862484bdec0b9226 (127.15.6.4:44223): ChangeConfig:REMOVE_PEER RPC failed for tablet 82af48cecc58434e959547ec318fa4c5: Network error: Client connection negotiation failed: client connection to 127.15.6.4:44223: connect: Connection refused (error 111)
I20260709 13:09:52.358354 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.359339 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.359710 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P 424acc41090849a586f609f5c6254e5b: stopping tablet replica
I20260709 13:09:52.595019 15384 master.cc:584] Master@127.15.6.62:43625 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (232307 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:52.700245 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:38693
I20260709 13:09:52.701331 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:52.706250 23159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:52.707080 23160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:52.707836 23162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:52.708421 15384 server_base.cc:1061] running on GCE node
I20260709 13:09:52.711175 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:52.711346 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:52.711503 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602592711485 us; error 0 us; skew 500 ppm
I20260709 13:09:52.712118 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:52.714318 15384 webserver.cc:533] Webserver started at http://127.15.6.62:39523/ using document root <none> and password file <none>
I20260709 13:09:52.714775 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:52.714937 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:52.715231 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:52.716440 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "bd1ff099db324951ac10792dbb562230"
format_stamp: "Formatted at 2026-07-09 13:09:52 on dist-test-slave-pqzm"
I20260709 13:09:52.720593 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:52.723872 23167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:52.724521 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:52.724767 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "bd1ff099db324951ac10792dbb562230"
format_stamp: "Formatted at 2026-07-09 13:09:52 on dist-test-slave-pqzm"
I20260709 13:09:52.725021 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:52.743757 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:52.744879 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:52.781309 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:38693
I20260709 13:09:52.781422 23218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:38693 every 8 connection(s)
I20260709 13:09:52.785270 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.795724 23219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230: Bootstrap starting.
I20260709 13:09:52.800299 23219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.804116 23219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230: No bootstrap required, opened a new log
I20260709 13:09:52.806162 23219 raft_consensus.cc:359] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd1ff099db324951ac10792dbb562230" member_type: VOTER }
I20260709 13:09:52.806587 23219 raft_consensus.cc:385] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.806789 23219 raft_consensus.cc:740] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1ff099db324951ac10792dbb562230, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.807351 23219 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd1ff099db324951ac10792dbb562230" member_type: VOTER }
I20260709 13:09:52.807824 23219 raft_consensus.cc:399] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:52.808048 23219 raft_consensus.cc:493] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:52.808301 23219 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.812211 23219 raft_consensus.cc:515] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd1ff099db324951ac10792dbb562230" member_type: VOTER }
I20260709 13:09:52.812726 23219 leader_election.cc:304] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd1ff099db324951ac10792dbb562230; no voters: 
I20260709 13:09:52.813894 23219 leader_election.cc:290] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:52.814263 23222 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.815467 23222 raft_consensus.cc:697] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 1 LEADER]: Becoming Leader. State: Replica: bd1ff099db324951ac10792dbb562230, State: Running, Role: LEADER
I20260709 13:09:52.816147 23222 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd1ff099db324951ac10792dbb562230" member_type: VOTER }
I20260709 13:09:52.816563 23219 sys_catalog.cc:565] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:52.825408 23223 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd1ff099db324951ac10792dbb562230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd1ff099db324951ac10792dbb562230" member_type: VOTER } }
I20260709 13:09:52.825562 23224 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd1ff099db324951ac10792dbb562230. Latest consensus state: current_term: 1 leader_uuid: "bd1ff099db324951ac10792dbb562230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd1ff099db324951ac10792dbb562230" member_type: VOTER } }
I20260709 13:09:52.825978 23223 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:52.826040 23224 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:52.827876 23233 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:52.832451 23233 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:52.833415 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:52.840626 23233 catalog_manager.cc:1383] Generated new cluster ID: 9814ff7249fd46ad82c5b8b80a681f4a
I20260709 13:09:52.840863 23233 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:52.859663 23233 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:52.860800 23233 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:52.874248 23233 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230: Generated new TSK 0
I20260709 13:09:52.874707 23233 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:52.899920 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:52.908366 23241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:52.910000 23240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:52.910725 23243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:52.911726 15384 server_base.cc:1061] running on GCE node
I20260709 13:09:52.913726 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:52.913936 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:52.914109 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602592914082 us; error 0 us; skew 500 ppm
I20260709 13:09:52.914711 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:52.924340 15384 webserver.cc:533] Webserver started at http://127.15.6.1:35021/ using document root <none> and password file <none>
I20260709 13:09:52.924783 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:52.924965 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:52.925246 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:52.926445 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "e56d4fa89a4e41fb99476c088544e8b8"
format_stamp: "Formatted at 2026-07-09 13:09:52 on dist-test-slave-pqzm"
I20260709 13:09:52.930999 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:52.934854 23248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:52.935529 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:52.936189 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "e56d4fa89a4e41fb99476c088544e8b8"
format_stamp: "Formatted at 2026-07-09 13:09:52 on dist-test-slave-pqzm"
I20260709 13:09:52.936442 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:52.954401 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:52.955484 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:52.956880 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:52.958982 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:52.959174 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:52.959376 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:52.959530 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:52.997784 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:44223
I20260709 13:09:52.997922 23310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:44223 every 8 connection(s)
I20260709 13:09:53.002825 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:53.011242 23316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:53.010655 23315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:53.015625 23318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:53.016358 23311 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38693
I20260709 13:09:53.016378 15384 server_base.cc:1061] running on GCE node
I20260709 13:09:53.016819 23311 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:53.017586 23311 heartbeater.cc:507] Master 127.15.6.62:38693 requested a full tablet report, sending...
I20260709 13:09:53.018352 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:53.018577 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:53.018756 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602593018739 us; error 0 us; skew 500 ppm
I20260709 13:09:53.019488 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:53.019834 23184 ts_manager.cc:194] Registered new tserver with Master: e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:53.022053 15384 webserver.cc:533] Webserver started at http://127.15.6.2:36459/ using document root <none> and password file <none>
I20260709 13:09:53.022240 23184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50604
I20260709 13:09:53.022709 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:53.022979 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:53.023299 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:53.024523 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "690e3a11be554a93b36ec5017ed89787"
format_stamp: "Formatted at 2026-07-09 13:09:53 on dist-test-slave-pqzm"
I20260709 13:09:53.028564 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:53.031512 23323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.032222 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:53.032472 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "690e3a11be554a93b36ec5017ed89787"
format_stamp: "Formatted at 2026-07-09 13:09:53 on dist-test-slave-pqzm"
I20260709 13:09:53.032722 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:53.044646 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:53.045742 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:53.047107 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:53.049190 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:53.049374 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.049575 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:53.049719 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.088073 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:43361
I20260709 13:09:53.088217 23385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:43361 every 8 connection(s)
I20260709 13:09:53.092578 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:53.099895 23389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:53.102200 23390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:53.103889 23392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:53.104041 15384 server_base.cc:1061] running on GCE node
I20260709 13:09:53.104212 23386 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38693
I20260709 13:09:53.104668 23386 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:53.105140 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:53.105439 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:53.105545 23386 heartbeater.cc:507] Master 127.15.6.62:38693 requested a full tablet report, sending...
I20260709 13:09:53.105672 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602593105652 us; error 0 us; skew 500 ppm
I20260709 13:09:53.106505 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:53.107822 23184 ts_manager.cc:194] Registered new tserver with Master: 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:53.109022 15384 webserver.cc:533] Webserver started at http://127.15.6.3:32847/ using document root <none> and password file <none>
I20260709 13:09:53.109655 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:53.109619 23184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50614
I20260709 13:09:53.110102 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:53.110431 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:53.111886 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "5e2983c2051a44788d4064010321c7f5"
format_stamp: "Formatted at 2026-07-09 13:09:53 on dist-test-slave-pqzm"
I20260709 13:09:53.116168 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:09:53.119239 23397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.119984 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:53.120239 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "5e2983c2051a44788d4064010321c7f5"
format_stamp: "Formatted at 2026-07-09 13:09:53 on dist-test-slave-pqzm"
I20260709 13:09:53.120458 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:53.150977 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:53.152134 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:53.153489 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:53.155694 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:53.155887 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.156126 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:53.156268 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.194290 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:38025
I20260709 13:09:53.194404 23459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:38025 every 8 connection(s)
I20260709 13:09:53.199090 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:53.212417 23463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:53.212607 23464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:53.214264 23466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:53.215085 15384 server_base.cc:1061] running on GCE node
I20260709 13:09:53.216032 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:53.216292 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:53.216503 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602593216484 us; error 0 us; skew 500 ppm
I20260709 13:09:53.217278 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:53.217854 23460 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38693
I20260709 13:09:53.218178 23460 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:53.219018 23460 heartbeater.cc:507] Master 127.15.6.62:38693 requested a full tablet report, sending...
I20260709 13:09:53.219844 15384 webserver.cc:533] Webserver started at http://127.15.6.4:39181/ using document root <none> and password file <none>
I20260709 13:09:53.220386 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:53.220567 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:53.220798 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:53.220908 23184 ts_manager.cc:194] Registered new tserver with Master: 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:53.222132 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-3-root/instance:
uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
format_stamp: "Formatted at 2026-07-09 13:09:53 on dist-test-slave-pqzm"
I20260709 13:09:53.222337 23184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50630
I20260709 13:09:53.226548 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:53.229672 23471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.230314 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:53.230574 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-3-root
uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
format_stamp: "Formatted at 2026-07-09 13:09:53 on dist-test-slave-pqzm"
I20260709 13:09:53.230822 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:53.241055 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:53.242175 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:53.243468 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:53.245510 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:53.245707 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.245908 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:53.246068 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:53.284263 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.4:38341
I20260709 13:09:53.284358 23533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.4:38341 every 8 connection(s)
I20260709 13:09:53.297151 23534 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38693
I20260709 13:09:53.297539 23534 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:53.298480 23534 heartbeater.cc:507] Master 127.15.6.62:38693 requested a full tablet report, sending...
I20260709 13:09:53.300467 23184 ts_manager.cc:194] Registered new tserver with Master: e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:53.300904 15384 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013512082s
I20260709 13:09:53.301774 23184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50640
I20260709 13:09:53.325230 23184 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50656:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:53.552989 23425 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc9b65add704609837229927a148b95 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:53.554410 23425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc9b65add704609837229927a148b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.554771 23495 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba0176229a34f60bf5899d36f898fe5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:53.556928 23496 tablet_service.cc:1511] Processing CreateTablet for tablet 4b942ac249aa46ec842c3d763c4c5716 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:53.558269 23496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b942ac249aa46ec842c3d763c4c5716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.558113 23494 tablet_service.cc:1511] Processing CreateTablet for tablet 524a9d5200604a8183ccae982b284bac (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:53.559437 23494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524a9d5200604a8183ccae982b284bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.560911 23422 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8bad3e990a48568e879ecb570caa29 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:53.562187 23422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8bad3e990a48568e879ecb570caa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.563024 23424 tablet_service.cc:1511] Processing CreateTablet for tablet 2efa2c7bd75b49468d45b6a49ad005fc (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:53.563840 23493 tablet_service.cc:1511] Processing CreateTablet for tablet a3eb2b6228254ee6bc99789c42b8fa29 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:53.564363 23424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efa2c7bd75b49468d45b6a49ad005fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.567588 23493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3eb2b6228254ee6bc99789c42b8fa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.567718 23351 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc9b65add704609837229927a148b95 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:53.569085 23351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc9b65add704609837229927a148b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.568919 23499 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc9b65add704609837229927a148b95 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:53.570171 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc9b65add704609837229927a148b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.569368 23492 tablet_service.cc:1511] Processing CreateTablet for tablet 106c7f82b57a430e8e9c9d0c209d5a5a (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:53.572165 23492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106c7f82b57a430e8e9c9d0c209d5a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.572023 23423 tablet_service.cc:1511] Processing CreateTablet for tablet e383f298f23f4ba8bb47a27742f0bff0 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:53.573318 23423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e383f298f23f4ba8bb47a27742f0bff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.575209 23491 tablet_service.cc:1511] Processing CreateTablet for tablet 30b043244b784f45b564c43cf1477286 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:53.576519 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b043244b784f45b564c43cf1477286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.576907 23498 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdd495d63c648ff8364f543e4da9901 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:53.578207 23498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdd495d63c648ff8364f543e4da9901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.578212 23497 tablet_service.cc:1511] Processing CreateTablet for tablet e383f298f23f4ba8bb47a27742f0bff0 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:53.578585 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba0176229a34f60bf5899d36f898fe5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:53.580960 23420 tablet_service.cc:1511] Processing CreateTablet for tablet 524a9d5200604a8183ccae982b284bac (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:53.583168 23419 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb2904c2354438697ad5ed0013f8479 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:53.585445 23418 tablet_service.cc:1511] Processing CreateTablet for tablet 106c7f82b57a430e8e9c9d0c209d5a5a (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:53.588151 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba0176229a34f60bf5899d36f898fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.588184 23417 tablet_service.cc:1511] Processing CreateTablet for tablet 30b043244b784f45b564c43cf1477286 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:53.591001 23416 tablet_service.cc:1511] Processing CreateTablet for tablet dca9f11103cd4818baf567c36c6d7ce7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:53.591495 23490 tablet_service.cc:1511] Processing CreateTablet for tablet aa2603a30eb24f32a97306bcfe46d1ec (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:53.592116 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e383f298f23f4ba8bb47a27742f0bff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.592763 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba0176229a34f60bf5899d36f898fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.596176 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524a9d5200604a8183ccae982b284bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.598412 23416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca9f11103cd4818baf567c36c6d7ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.600155 23418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106c7f82b57a430e8e9c9d0c209d5a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.592785 23490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2603a30eb24f32a97306bcfe46d1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.602573 23350 tablet_service.cc:1511] Processing CreateTablet for tablet 2efa2c7bd75b49468d45b6a49ad005fc (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:53.604830 23350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efa2c7bd75b49468d45b6a49ad005fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.605171 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdd495d63c648ff8364f543e4da9901 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:53.606405 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdd495d63c648ff8364f543e4da9901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.601768 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b043244b784f45b564c43cf1477286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.616103 23419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb2904c2354438697ad5ed0013f8479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.633122 23348 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8bad3e990a48568e879ecb570caa29 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:53.634482 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8bad3e990a48568e879ecb570caa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.635414 23342 tablet_service.cc:1511] Processing CreateTablet for tablet dca9f11103cd4818baf567c36c6d7ce7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:53.636775 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca9f11103cd4818baf567c36c6d7ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.636999 23347 tablet_service.cc:1511] Processing CreateTablet for tablet 4b942ac249aa46ec842c3d763c4c5716 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:53.638278 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b942ac249aa46ec842c3d763c4c5716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.640955 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 524a9d5200604a8183ccae982b284bac (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:53.642225 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524a9d5200604a8183ccae982b284bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.644974 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb2904c2354438697ad5ed0013f8479 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:53.646255 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb2904c2354438697ad5ed0013f8479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.648913 23344 tablet_service.cc:1511] Processing CreateTablet for tablet a3eb2b6228254ee6bc99789c42b8fa29 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:53.650184 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3eb2b6228254ee6bc99789c42b8fa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.652719 23343 tablet_service.cc:1511] Processing CreateTablet for tablet 30b043244b784f45b564c43cf1477286 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:53.653992 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b043244b784f45b564c43cf1477286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.678485 23491 tablet_service.cc:1511] Processing CreateTablet for tablet 441e0cae71fc45e4b1f2c0b4aa958cf9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:53.688661 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441e0cae71fc45e4b1f2c0b4aa958cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.701128 23553 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:53.711692 23552 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:53.717250 23551 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:53.720925 23272 tablet_service.cc:1511] Processing CreateTablet for tablet 4b942ac249aa46ec842c3d763c4c5716 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:53.721107 23269 tablet_service.cc:1511] Processing CreateTablet for tablet a3eb2b6228254ee6bc99789c42b8fa29 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:53.722339 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b942ac249aa46ec842c3d763c4c5716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.723089 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3eb2b6228254ee6bc99789c42b8fa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.724483 23273 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8bad3e990a48568e879ecb570caa29 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:53.725901 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8bad3e990a48568e879ecb570caa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.726045 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 106c7f82b57a430e8e9c9d0c209d5a5a (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:53.729229 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106c7f82b57a430e8e9c9d0c209d5a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.732836 23276 tablet_service.cc:1511] Processing CreateTablet for tablet 2efa2c7bd75b49468d45b6a49ad005fc (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:53.733819 23552 tablet_bootstrap.cc:654] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.735136 23275 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdd495d63c648ff8364f543e4da9901 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:53.737560 23274 tablet_service.cc:1511] Processing CreateTablet for tablet e383f298f23f4ba8bb47a27742f0bff0 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:53.727854 23267 tablet_service.cc:1511] Processing CreateTablet for tablet dca9f11103cd4818baf567c36c6d7ce7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:53.729112 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba0176229a34f60bf5899d36f898fe5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:53.749107 23418 tablet_service.cc:1511] Processing CreateTablet for tablet 441e0cae71fc45e4b1f2c0b4aa958cf9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:53.750352 23418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441e0cae71fc45e4b1f2c0b4aa958cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.727844 23270 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb2904c2354438697ad5ed0013f8479 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:53.756067 23495 tablet_service.cc:1511] Processing CreateTablet for tablet d9b34184164445d4bf8bb87b3e76b22d (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:53.757027 23420 tablet_service.cc:1511] Processing CreateTablet for tablet d5348b6264474d048efc80da425fee14 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:53.757351 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b34184164445d4bf8bb87b3e76b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.759545 23347 tablet_service.cc:1511] Processing CreateTablet for tablet d9b34184164445d4bf8bb87b3e76b22d (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:53.760828 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b34184164445d4bf8bb87b3e76b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.760571 23342 tablet_service.cc:1511] Processing CreateTablet for tablet aa2603a30eb24f32a97306bcfe46d1ec (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:53.761845 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2603a30eb24f32a97306bcfe46d1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.762878 23417 tablet_service.cc:1511] Processing CreateTablet for tablet d9b34184164445d4bf8bb87b3e76b22d (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:53.764271 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b34184164445d4bf8bb87b3e76b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.767378 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5348b6264474d048efc80da425fee14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.771155 23499 tablet_service.cc:1511] Processing CreateTablet for tablet 295ce00aba194098a6b6e3736a7c7b8d (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:53.772432 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ce00aba194098a6b6e3736a7c7b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.774685 23343 tablet_service.cc:1511] Processing CreateTablet for tablet d5348b6264474d048efc80da425fee14 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:53.775941 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5348b6264474d048efc80da425fee14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.763659 23551 tablet_bootstrap.cc:654] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.790174 23269 tablet_service.cc:1511] Processing CreateTablet for tablet aa2603a30eb24f32a97306bcfe46d1ec (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:53.790581 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 295ce00aba194098a6b6e3736a7c7b8d (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:53.791751 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ce00aba194098a6b6e3736a7c7b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.784160 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efa2c7bd75b49468d45b6a49ad005fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.801734 23419 tablet_service.cc:1511] Processing CreateTablet for tablet ac5e3b8a31e54e7186eff3a07ae3dcae (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:53.803063 23419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5e3b8a31e54e7186eff3a07ae3dcae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.809664 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba0176229a34f60bf5899d36f898fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.810863 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdd495d63c648ff8364f543e4da9901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.814927 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb2904c2354438697ad5ed0013f8479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.816251 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca9f11103cd4818baf567c36c6d7ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.818221 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e383f298f23f4ba8bb47a27742f0bff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.832895 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2603a30eb24f32a97306bcfe46d1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.845356 23493 tablet_service.cc:1511] Processing CreateTablet for tablet ac5e3b8a31e54e7186eff3a07ae3dcae (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:53.846071 23552 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:53.846590 23493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5e3b8a31e54e7186eff3a07ae3dcae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:53.845297 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:53.852449 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 441e0cae71fc45e4b1f2c0b4aa958cf9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:53.853667 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441e0cae71fc45e4b1f2c0b4aa958cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.846592 23552 ts_tablet_manager.cc:1403] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.135s	user 0.029s	sys 0.004s
I20260709 13:09:53.858877 23552 raft_consensus.cc:359] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:53.859436 23553 tablet_bootstrap.cc:654] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.864506 23555 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:53.903640 23551 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:53.904237 23551 ts_tablet_manager.cc:1403] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.187s	user 0.020s	sys 0.011s
I20260709 13:09:53.907264 23551 raft_consensus.cc:359] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:53.907981 23551 raft_consensus.cc:385] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.908265 23551 raft_consensus.cc:740] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.909017 23551 consensus_queue.cc:260] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:53.914105 23272 tablet_service.cc:1511] Processing CreateTablet for tablet d5348b6264474d048efc80da425fee14 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:53.859603 23552 raft_consensus.cc:385] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:53.920087 23169 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.6.2:43361, user_credentials={real_user=slave}} blocked reactor thread for 56291.2us
I20260709 13:09:53.923054 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 846d941237a64689b8c0a9604d7635d9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:53.926468 23495 tablet_service.cc:1511] Processing CreateTablet for tablet 846d941237a64689b8c0a9604d7635d9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:53.944824 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846d941237a64689b8c0a9604d7635d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.944700 23491 tablet_service.cc:1511] Processing CreateTablet for tablet cdbe8c884d0146eab6e90a8245b86fe3 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:53.930583 23555 tablet_bootstrap.cc:654] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.948827 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846d941237a64689b8c0a9604d7635d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.948623 23342 tablet_service.cc:1511] Processing CreateTablet for tablet 26380e16f1a247e4b9a611e57faafdf9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:53.949797 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26380e16f1a247e4b9a611e57faafdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.931720 23416 tablet_service.cc:1511] Processing CreateTablet for tablet 26380e16f1a247e4b9a611e57faafdf9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:53.952178 23416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26380e16f1a247e4b9a611e57faafdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.942539 23552 raft_consensus.cc:740] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.946862 23534 heartbeater.cc:499] Master 127.15.6.62:38693 was elected leader, sending a full tablet report...
I20260709 13:09:53.947096 23551 ts_tablet_manager.cc:1434] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.002s
I20260709 13:09:53.945309 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 846d941237a64689b8c0a9604d7635d9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:53.952194 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbe8c884d0146eab6e90a8245b86fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.957031 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846d941237a64689b8c0a9604d7635d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.960207 23552 consensus_queue.cc:260] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:53.970795 23348 tablet_service.cc:1511] Processing CreateTablet for tablet cdbe8c884d0146eab6e90a8245b86fe3 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:53.972036 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbe8c884d0146eab6e90a8245b86fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.973515 23493 tablet_service.cc:1511] Processing CreateTablet for tablet d84edc3d80d547aba534dc0d00486d96 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:53.974711 23493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84edc3d80d547aba534dc0d00486d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.976109 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5348b6264474d048efc80da425fee14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.980703 23420 tablet_service.cc:1511] Processing CreateTablet for tablet d84edc3d80d547aba534dc0d00486d96 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:53.981856 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84edc3d80d547aba534dc0d00486d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.982852 23551 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:53.989331 23553 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:53.989159 23274 tablet_service.cc:1511] Processing CreateTablet for tablet 295ce00aba194098a6b6e3736a7c7b8d (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:53.989799 23553 ts_tablet_manager.cc:1403] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.289s	user 0.023s	sys 0.000s
I20260709 13:09:53.994923 23267 tablet_service.cc:1511] Processing CreateTablet for tablet ac5e3b8a31e54e7186eff3a07ae3dcae (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:53.996117 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5e3b8a31e54e7186eff3a07ae3dcae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:53.998188 23275 tablet_service.cc:1511] Processing CreateTablet for tablet 26380e16f1a247e4b9a611e57faafdf9 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:54.012466 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ce00aba194098a6b6e3736a7c7b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.019949 23497 tablet_service.cc:1511] Processing CreateTablet for tablet a7494d11a71a4d9a93693fc53b5d2421 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:54.000726 23268 tablet_service.cc:1511] Processing CreateTablet for tablet cdbe8c884d0146eab6e90a8245b86fe3 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:54.022588 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7494d11a71a4d9a93693fc53b5d2421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.025183 23460 heartbeater.cc:499] Master 127.15.6.62:38693 was elected leader, sending a full tablet report...
I20260709 13:09:54.025990 23311 heartbeater.cc:499] Master 127.15.6.62:38693 was elected leader, sending a full tablet report...
I20260709 13:09:54.026779 23555 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:54.027251 23555 ts_tablet_manager.cc:1403] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.012s
I20260709 13:09:54.026964 23418 tablet_service.cc:1511] Processing CreateTablet for tablet a7494d11a71a4d9a93693fc53b5d2421 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:54.023384 23345 tablet_service.cc:1511] Processing CreateTablet for tablet a7494d11a71a4d9a93693fc53b5d2421 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:54.031436 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7494d11a71a4d9a93693fc53b5d2421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.034570 23344 tablet_service.cc:1511] Processing CreateTablet for tablet a86340eab4214c8faa598315e8097257 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:54.035751 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86340eab4214c8faa598315e8097257. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:54.038425 23535 tablet.cc:2406] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:54.039148 23418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7494d11a71a4d9a93693fc53b5d2421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.040068 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26380e16f1a247e4b9a611e57faafdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.020195 23271 tablet_service.cc:1511] Processing CreateTablet for tablet d84edc3d80d547aba534dc0d00486d96 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:54.042596 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84edc3d80d547aba534dc0d00486d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.020226 23552 ts_tablet_manager.cc:1434] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.164s	user 0.011s	sys 0.002s
I20260709 13:09:54.040007 23553 raft_consensus.cc:359] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.051121 23553 raft_consensus.cc:385] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.048085 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbe8c884d0146eab6e90a8245b86fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.051999 23276 tablet_service.cc:1511] Processing CreateTablet for tablet a86340eab4214c8faa598315e8097257 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:54.053087 23551 tablet_bootstrap.cc:654] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.051421 23553 raft_consensus.cc:740] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.059729 23553 consensus_queue.cc:260] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.060741 23420 tablet_service.cc:1511] Processing CreateTablet for tablet a86340eab4214c8faa598315e8097257 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:54.063977 23552 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:54.068630 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86340eab4214c8faa598315e8097257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.069988 23499 tablet_service.cc:1511] Processing CreateTablet for tablet ddc99a8f26574b5e9d7a7d91000bf4a2 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:54.071185 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc99a8f26574b5e9d7a7d91000bf4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.082787 23559 raft_consensus.cc:493] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.083331 23559 raft_consensus.cc:515] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.085866 23559 leader_election.cc:290] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:54.088577 23270 tablet_service.cc:1511] Processing CreateTablet for tablet ddc99a8f26574b5e9d7a7d91000bf4a2 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:54.097011 23555 raft_consensus.cc:359] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.097781 23555 raft_consensus.cc:385] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.098073 23555 raft_consensus.cc:740] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.098807 23555 consensus_queue.cc:260] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.112622 23386 heartbeater.cc:499] Master 127.15.6.62:38693 was elected leader, sending a full tablet report...
I20260709 13:09:54.106587 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86340eab4214c8faa598315e8097257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.125844 23553 ts_tablet_manager.cc:1434] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.136s	user 0.015s	sys 0.003s
I20260709 13:09:54.130863 23553 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:54.144003 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc99a8f26574b5e9d7a7d91000bf4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.152581 23552 tablet_bootstrap.cc:654] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.160038 23565 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.160596 23565 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.163414 23565 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:54.180795 23344 tablet_service.cc:1511] Processing CreateTablet for tablet ddc99a8f26574b5e9d7a7d91000bf4a2 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:54.182219 23555 ts_tablet_manager.cc:1434] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.155s	user 0.018s	sys 0.026s
I20260709 13:09:54.183215 23555 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:54.182197 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc99a8f26574b5e9d7a7d91000bf4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.197683 23555 tablet_bootstrap.cc:654] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.202895 23419 tablet_service.cc:1511] Processing CreateTablet for tablet 22769b9fbe4642f185da6c9a4f36aa30 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:54.205900 23419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22769b9fbe4642f185da6c9a4f36aa30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.206125 23553 tablet_bootstrap.cc:654] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.213938 23552 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:54.214430 23552 ts_tablet_manager.cc:1403] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.010s
I20260709 13:09:54.214671 23553 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:54.215140 23553 ts_tablet_manager.cc:1403] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.004s
I20260709 13:09:54.216876 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 22769b9fbe4642f185da6c9a4f36aa30 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:54.217200 23552 raft_consensus.cc:359] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.219393 23552 raft_consensus.cc:385] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.218052 23553 raft_consensus.cc:359] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.218760 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:54.219774 23497 tablet_service.cc:1511] Processing CreateTablet for tablet 22769b9fbe4642f185da6c9a4f36aa30 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:54.219885 23552 raft_consensus.cc:740] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
W20260709 13:09:54.221261 23401 leader_election.cc:343] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.221289 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22769b9fbe4642f185da6c9a4f36aa30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.222087 23553 raft_consensus.cc:385] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.222529 23553 raft_consensus.cc:740] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.224928 23342 tablet_service.cc:1511] Processing CreateTablet for tablet d7300cd12cfb435b920f7079d2605e20 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:54.226145 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7300cd12cfb435b920f7079d2605e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.221261 23552 consensus_queue.cc:260] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.229341 23552 ts_tablet_manager.cc:1434] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:54.219878 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22769b9fbe4642f185da6c9a4f36aa30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.232086 23558 raft_consensus.cc:493] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.232586 23558 raft_consensus.cc:515] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.235324 23558 leader_election.cc:290] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:54.236080 23416 tablet_service.cc:1511] Processing CreateTablet for tablet d7300cd12cfb435b920f7079d2605e20 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:54.264807 23416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7300cd12cfb435b920f7079d2605e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.269029 23499 tablet_service.cc:1511] Processing CreateTablet for tablet d7300cd12cfb435b920f7079d2605e20 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:54.270464 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7300cd12cfb435b920f7079d2605e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.273334 23267 tablet_service.cc:1511] Processing CreateTablet for tablet b6cb1e511f734cf3b2669918cf9efbc7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:54.274607 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6cb1e511f734cf3b2669918cf9efbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.276237 23559 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.276710 23559 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.278771 23559 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:54.286252 23561 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.286801 23561 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.295037 23551 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:54.295552 23551 ts_tablet_manager.cc:1403] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.313s	user 0.003s	sys 0.030s
I20260709 13:09:54.223831 23553 consensus_queue.cc:260] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.301020 23561 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:54.298779 23552 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:54.311546 23553 ts_tablet_manager.cc:1434] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.004s
I20260709 13:09:54.312597 23553 tablet_bootstrap.cc:492] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:54.298453 23551 raft_consensus.cc:359] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.324286 23551 raft_consensus.cc:385] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.324608 23551 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.325400 23551 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.327386 23551 ts_tablet_manager.cc:1434] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.004s
I20260709 13:09:54.329555 23491 tablet_service.cc:1511] Processing CreateTablet for tablet faeb76eaa46b49f398e91a6a3bbfacb1 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:54.330756 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faeb76eaa46b49f398e91a6a3bbfacb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.330801 23267 tablet_service.cc:1511] Processing CreateTablet for tablet faeb76eaa46b49f398e91a6a3bbfacb1 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:54.332136 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faeb76eaa46b49f398e91a6a3bbfacb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.333789 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
W20260709 13:09:54.352259 23401 leader_election.cc:343] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.353524 23561 raft_consensus.cc:493] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.354027 23561 raft_consensus.cc:515] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.363289 23495 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9c9fb771764a4bb12fbf71035e081b (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:54.364635 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9c9fb771764a4bb12fbf71035e081b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.363821 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:54.367420 23285 raft_consensus.cc:2468] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:54.368235 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:54.370347 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:54.371331 23561 leader_election.cc:290] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:09:54.371886 23252 leader_election.cc:343] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.372824 23551 tablet_bootstrap.cc:492] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:54.381184 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9c9fb771764a4bb12fbf71035e081b (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:54.382550 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9c9fb771764a4bb12fbf71035e081b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.387413 23552 tablet_bootstrap.cc:654] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.391611 23499 tablet_service.cc:1511] Processing CreateTablet for tablet 075558731b7c4293accc5598016e108e (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:54.392987 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075558731b7c4293accc5598016e108e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.392879 23274 tablet_service.cc:1511] Processing CreateTablet for tablet 9223cb5b87c546029aaf855836b6e545 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:54.397742 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9223cb5b87c546029aaf855836b6e545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.407629 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:09:54.410015 23474 leader_election.cc:343] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.412272 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:54.412820 23435 raft_consensus.cc:2468] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:09:54.413983 23249 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:54.414572 23551 tablet_bootstrap.cc:654] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.415036 23567 raft_consensus.cc:2804] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.415390 23567 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.415633 23567 raft_consensus.cc:3060] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.422662 23567 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.425849 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:54.426971 23553 tablet_bootstrap.cc:654] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:54.427237 23252 leader_election.cc:343] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.428989 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:54.429533 23435 raft_consensus.cc:3060] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.433627 23419 tablet_service.cc:1511] Processing CreateTablet for tablet b6cb1e511f734cf3b2669918cf9efbc7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:54.434999 23419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6cb1e511f734cf3b2669918cf9efbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.436511 23416 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9c9fb771764a4bb12fbf71035e081b (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:54.437712 23416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9c9fb771764a4bb12fbf71035e081b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.441162 23418 tablet_service.cc:1511] Processing CreateTablet for tablet 075558731b7c4293accc5598016e108e (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:54.442268 23418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075558731b7c4293accc5598016e108e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.444924 23400 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:54.447084 23555 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:54.447593 23555 ts_tablet_manager.cc:1403] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.265s	user 0.010s	sys 0.006s
I20260709 13:09:54.431995 23567 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:54.451867 23555 raft_consensus.cc:359] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.462905 23555 raft_consensus.cc:385] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.463239 23555 raft_consensus.cc:740] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.464031 23555 consensus_queue.cc:260] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.466037 23555 ts_tablet_manager.cc:1434] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:09:54.452670 23497 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5153ef78cf4bf89ae5eb12f0f475b4 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:54.469272 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5153ef78cf4bf89ae5eb12f0f475b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.471581 23491 tablet_service.cc:1511] Processing CreateTablet for tablet f4dd509182394fe29d31851c23847034 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:09:54.472378 23400 leader_election.cc:343] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.472818 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dd509182394fe29d31851c23847034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.474790 23274 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5153ef78cf4bf89ae5eb12f0f475b4 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:54.472833 23400 leader_election.cc:304] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:54.479224 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5153ef78cf4bf89ae5eb12f0f475b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.451645 23435 raft_consensus.cc:2468] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:09:54.484418 23559 raft_consensus.cc:2764] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:54.482044 23271 tablet_service.cc:1511] Processing CreateTablet for tablet f4dd509182394fe29d31851c23847034 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:54.488670 23249 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:54.489794 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 075558731b7c4293accc5598016e108e (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:54.490561 23567 raft_consensus.cc:2804] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.490995 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075558731b7c4293accc5598016e108e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.491827 23555 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:54.491684 23567 raft_consensus.cc:697] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:09:54.493930 23567 consensus_queue.cc:237] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.490491 23342 tablet_service.cc:1511] Processing CreateTablet for tablet b6cb1e511f734cf3b2669918cf9efbc7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:54.487622 23559 raft_consensus.cc:2749] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.496322 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:09:54.539513 23473 leader_election.cc:343] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.540012 23473 leader_election.cc:304] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:54.541105 23558 raft_consensus.cc:2749] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.516124 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dd509182394fe29d31851c23847034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.546099 23551 tablet_bootstrap.cc:492] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:54.546603 23551 ts_tablet_manager.cc:1403] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.033s
I20260709 13:09:54.547833 23553 tablet_bootstrap.cc:492] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:54.548321 23553 ts_tablet_manager.cc:1403] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.236s	user 0.003s	sys 0.012s
I20260709 13:09:54.551061 23551 raft_consensus.cc:359] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.551337 23553 raft_consensus.cc:359] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.551756 23551 raft_consensus.cc:385] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.552121 23551 raft_consensus.cc:740] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.553089 23552 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:54.553658 23552 ts_tablet_manager.cc:1403] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.292s	user 0.018s	sys 0.011s
I20260709 13:09:54.553042 23551 consensus_queue.cc:260] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
W20260709 13:09:54.543352 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:38025, user_credentials={real_user=slave}} blocked reactor thread for 54770.9us
I20260709 13:09:54.552062 23553 raft_consensus.cc:385] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:54.553335 23400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:44223, user_credentials={real_user=slave}} blocked reactor thread for 80994.5us
I20260709 13:09:54.558377 23553 raft_consensus.cc:740] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.560039 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 9223cb5b87c546029aaf855836b6e545 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:54.555737 23344 tablet_service.cc:1511] Processing CreateTablet for tablet faeb76eaa46b49f398e91a6a3bbfacb1 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:54.560707 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:54.561452 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9223cb5b87c546029aaf855836b6e545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.562372 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:09:54.563690 23326 leader_election.cc:343] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.559067 23347 tablet_service.cc:1511] Processing CreateTablet for tablet 9223cb5b87c546029aaf855836b6e545 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:09:54.564682 23326 leader_election.cc:343] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.560297 23553 consensus_queue.cc:260] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.567499 23553 ts_tablet_manager.cc:1434] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:54.560029 23348 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5153ef78cf4bf89ae5eb12f0f475b4 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:54.558018 23551 ts_tablet_manager.cc:1434] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:09:54.573351 23420 tablet_service.cc:1511] Processing CreateTablet for tablet f4dd509182394fe29d31851c23847034 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:54.574023 23553 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:54.573861 23349 tablet_service.cc:1511] Processing CreateTablet for tablet abf5322b429943b79e7e871a1f61ce06 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:54.574601 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4dd509182394fe29d31851c23847034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.578207 23551 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:54.580183 23267 tablet_service.cc:1511] Processing CreateTablet for tablet bfd8bf8d048d4ad39c2f930d0606181f (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:54.586398 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd8bf8d048d4ad39c2f930d0606181f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.589129 23417 tablet_service.cc:1511] Processing CreateTablet for tablet abf5322b429943b79e7e871a1f61ce06 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:54.590325 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf5322b429943b79e7e871a1f61ce06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.562500 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6cb1e511f734cf3b2669918cf9efbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.593684 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf5322b429943b79e7e871a1f61ce06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.595230 23551 tablet_bootstrap.cc:654] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.598555 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9223cb5b87c546029aaf855836b6e545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.600234 23495 tablet_service.cc:1511] Processing CreateTablet for tablet abf5322b429943b79e7e871a1f61ce06 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:54.601467 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf5322b429943b79e7e871a1f61ce06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.601927 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faeb76eaa46b49f398e91a6a3bbfacb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.604663 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:54.605434 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5153ef78cf4bf89ae5eb12f0f475b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.606227 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:54.606956 23555 tablet_bootstrap.cc:654] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:54.607587 23324 leader_election.cc:343] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.608068 23324 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:54.609211 23561 raft_consensus.cc:2749] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.603296 23552 raft_consensus.cc:359] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.612782 23552 raft_consensus.cc:385] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:54.613457 23324 leader_election.cc:343] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.614610 23324 leader_election.cc:304] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:54.615665 23561 raft_consensus.cc:2749] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.616484 23552 raft_consensus.cc:740] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.627281 23555 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:54.619287 23552 consensus_queue.cc:260] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.627827 23555 ts_tablet_manager.cc:1403] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.007s
I20260709 13:09:54.630767 23555 raft_consensus.cc:359] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.631412 23555 raft_consensus.cc:385] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.631692 23555 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.638880 23555 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.615551 23553 tablet_bootstrap.cc:654] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.643127 23551 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:54.643623 23555 ts_tablet_manager.cc:1434] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:09:54.644639 23555 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:54.645471 23552 ts_tablet_manager.cc:1434] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:09:54.646473 23552 tablet_bootstrap.cc:492] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:54.643631 23551 ts_tablet_manager.cc:1403] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.001s
I20260709 13:09:54.650801 23551 raft_consensus.cc:359] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.651463 23551 raft_consensus.cc:385] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.651747 23551 raft_consensus.cc:740] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.652153 23553 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:54.652782 23553 ts_tablet_manager.cc:1403] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.006s
I20260709 13:09:54.653105 23552 tablet_bootstrap.cc:654] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.655871 23553 raft_consensus.cc:359] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.652704 23551 consensus_queue.cc:260] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.656726 23553 raft_consensus.cc:385] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.657161 23553 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.658147 23551 ts_tablet_manager.cc:1434] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:09:54.655902 23555 tablet_bootstrap.cc:654] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.658000 23553 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.659265 23551 tablet_bootstrap.cc:492] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:54.661046 23553 ts_tablet_manager.cc:1434] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:54.666744 23551 tablet_bootstrap.cc:654] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.668171 23552 tablet_bootstrap.cc:492] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:54.668687 23552 ts_tablet_manager.cc:1403] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.010s
I20260709 13:09:54.669730 23553 tablet_bootstrap.cc:492] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:54.703648 23552 raft_consensus.cc:359] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.705611 23552 raft_consensus.cc:385] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.706038 23552 raft_consensus.cc:740] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.709438 23347 tablet_service.cc:1511] Processing CreateTablet for tablet bfd8bf8d048d4ad39c2f930d0606181f (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:54.710186 23552 consensus_queue.cc:260] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.711302 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd8bf8d048d4ad39c2f930d0606181f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.712042 23561 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.718353 23561 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.707620 23417 tablet_service.cc:1511] Processing CreateTablet for tablet bfd8bf8d048d4ad39c2f930d0606181f (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:54.729480 23271 tablet_service.cc:1511] Processing CreateTablet for tablet f0c812f930c747ba8d2e17253818f574 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:54.730592 23561 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:54.731236 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c812f930c747ba8d2e17253818f574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.729490 23495 tablet_service.cc:1511] Processing CreateTablet for tablet f0c812f930c747ba8d2e17253818f574 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:54.734001 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c812f930c747ba8d2e17253818f574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.738559 23551 tablet_bootstrap.cc:492] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:54.733863 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:54.739533 23286 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:54.739547 23551 ts_tablet_manager.cc:1403] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 13:09:54.741583 23326 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:09:54.729421 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd8bf8d048d4ad39c2f930d0606181f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.745782 23349 tablet_service.cc:1511] Processing CreateTablet for tablet f0c812f930c747ba8d2e17253818f574 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:54.747187 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c812f930c747ba8d2e17253818f574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.748222 23551 raft_consensus.cc:359] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.748971 23551 raft_consensus.cc:385] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.749255 23551 raft_consensus.cc:740] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.749917 23561 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.750578 23558 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.751309 23558 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.750532 23561 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.752954 23561 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.754249 23558 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:54.755456 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:09:54.766153 23473 leader_election.cc:343] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.770854 23420 tablet_service.cc:1511] Processing CreateTablet for tablet 591a48f99daf4f3ca78a90b308ab3134 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:54.772368 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591a48f99daf4f3ca78a90b308ab3134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.774829 23344 tablet_service.cc:1511] Processing CreateTablet for tablet 8570fd3d81f4448587060878fe3c4a60 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:54.761112 23553 tablet_bootstrap.cc:654] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.762784 23552 ts_tablet_manager.cc:1434] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.005s
I20260709 13:09:54.776216 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8570fd3d81f4448587060878fe3c4a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.777201 23552 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:54.780951 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 8570fd3d81f4448587060878fe3c4a60 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:54.781448 23561 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.763909 23555 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:54.764042 23551 consensus_queue.cc:260] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.786077 23551 ts_tablet_manager.cc:1434] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.003s
I20260709 13:09:54.786873 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8570fd3d81f4448587060878fe3c4a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.787671 23551 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:54.792111 23585 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.792706 23585 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.795302 23585 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:54.796876 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:54.797646 23509 raft_consensus.cc:2468] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:54.800024 23274 tablet_service.cc:1511] Processing CreateTablet for tablet 591a48f99daf4f3ca78a90b308ab3134 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:54.799712 23183 catalog_manager.cc:5697] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.799731 23401 leader_election.cc:304] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:54.801400 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591a48f99daf4f3ca78a90b308ab3134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.786015 23495 tablet_service.cc:1511] Processing CreateTablet for tablet 591a48f99daf4f3ca78a90b308ab3134 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:54.801987 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:54.802893 23435 raft_consensus.cc:2468] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:54.803253 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591a48f99daf4f3ca78a90b308ab3134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.804832 23472 leader_election.cc:304] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:54.806097 23558 raft_consensus.cc:2804] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.806445 23558 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.806751 23558 raft_consensus.cc:3060] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.808594 23555 ts_tablet_manager.cc:1403] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.164s	user 0.009s	sys 0.010s
I20260709 13:09:54.808920 23585 raft_consensus.cc:2804] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.811066 23585 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.811470 23585 raft_consensus.cc:3060] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.818250 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:54.819022 23508 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.824517 23417 tablet_service.cc:1511] Processing CreateTablet for tablet c9252e3ece10448a9a6b9a2a9c39e109 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:54.826313 23555 raft_consensus.cc:359] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.827098 23555 raft_consensus.cc:385] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.825479 23551 tablet_bootstrap.cc:654] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.827118 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:54.828851 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9252e3ece10448a9a6b9a2a9c39e109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.825830 23347 tablet_service.cc:1511] Processing CreateTablet for tablet c9252e3ece10448a9a6b9a2a9c39e109 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:54.836834 23267 tablet_service.cc:1511] Processing CreateTablet for tablet c9252e3ece10448a9a6b9a2a9c39e109 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:54.838137 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9252e3ece10448a9a6b9a2a9c39e109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.838387 23558 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.838137 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9252e3ece10448a9a6b9a2a9c39e109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.842612 23567 raft_consensus.cc:493] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.843241 23567 raft_consensus.cc:515] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.854635 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 800fdd40a53c4181873d9251355e0317 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:54.855962 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 800fdd40a53c4181873d9251355e0317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.845911 23508 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:09:54.870599 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:54.871259 23561 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:54.871402 23558 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:54.871969 23558 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.872308 23473 leader_election.cc:343] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.872481 23558 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.873097 23552 tablet_bootstrap.cc:654] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.840114 23555 raft_consensus.cc:740] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.871914 23561 raft_consensus.cc:493] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.886694 23555 consensus_queue.cc:260] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.892472 23555 ts_tablet_manager.cc:1434] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.002s
I20260709 13:09:54.893818 23555 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:54.895875 23567 leader_election.cc:290] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:54.895975 23561 raft_consensus.cc:515] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.897817 23553 tablet_bootstrap.cc:492] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:54.898530 23561 leader_election.cc:290] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:54.899380 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
W20260709 13:09:54.901176 23324 leader_election.cc:343] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.903734 23555 tablet_bootstrap.cc:654] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.898438 23553 ts_tablet_manager.cc:1403] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.229s	user 0.005s	sys 0.014s
I20260709 13:09:54.913666 23327 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:54.914609 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:54.915226 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 800fdd40a53c4181873d9251355e0317 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:54.915969 23597 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.916378 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:54.916514 23597 raft_consensus.cc:697] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:09:54.917598 23597 consensus_queue.cc:237] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.915238 23286 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.916610 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 800fdd40a53c4181873d9251355e0317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.909556 23585 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.941448 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:54.943408 23585 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:54.944366 23435 raft_consensus.cc:2393] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e971a25f8dfb42fcb1afb9ecf74f760d in current term 1: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:09:54.944701 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:54.945489 23508 raft_consensus.cc:2393] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e2983c2051a44788d4064010321c7f5 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
W20260709 13:09:54.948264 23327 leader_election.cc:343] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.948701 23327 leader_election.cc:304] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:54.949434 23597 raft_consensus.cc:2749] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.949954 23598 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.941514 23286 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:09:54.956591 23499 tablet_service.cc:1511] Processing CreateTablet for tablet 800fdd40a53c4181873d9251355e0317 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:54.957955 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 800fdd40a53c4181873d9251355e0317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.957748 23184 catalog_manager.cc:5697] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.951555 23598 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.960722 23598 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:54.962865 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:54.964511 23420 tablet_service.cc:1511] Processing CreateTablet for tablet 65dd0b5483a44bcba9b20f703b4f9588 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:54.966117 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dd0b5483a44bcba9b20f703b4f9588. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:54.966897 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:54.968201 23472 leader_election.cc:304] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:54.969182 23598 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.969988 23551 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:54.970321 23600 raft_consensus.cc:2749] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.970494 23551 ts_tablet_manager.cc:1403] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.008s
I20260709 13:09:54.971012 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:54.971582 23286 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:54.972375 23558 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:54.972802 23474 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:54.973785 23600 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:54.974138 23600 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.974419 23600 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.975117 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:54.979148 23585 raft_consensus.cc:493] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.941699 23553 raft_consensus.cc:359] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:54.979635 23585 raft_consensus.cc:515] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:54.979763 23348 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab56513b0d44631b1b0258f31989b62 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:54.985463 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab56513b0d44631b1b0258f31989b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.985859 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:54.986097 23585 leader_election.cc:290] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:54.987531 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:54.987947 23551 raft_consensus.cc:359] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.969985 23598 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:54.990952 23598 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:54.990777 23497 tablet_service.cc:1511] Processing CreateTablet for tablet 65dd0b5483a44bcba9b20f703b4f9588 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:54.993137 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:54.988600 23551 raft_consensus.cc:385] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.994505 23551 raft_consensus.cc:740] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.994778 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:54.993155 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:54.996737 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dd0b5483a44bcba9b20f703b4f9588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.000285 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:55.000818 23417 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab56513b0d44631b1b0258f31989b62 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:09:55.001753 23250 leader_election.cc:343] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.002521 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab56513b0d44631b1b0258f31989b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.004105 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 6f687663b31c40fea5a41eff18c7b6d5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:09:55.005188 23399 leader_election.cc:343] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:55.005748 23252 leader_election.cc:343] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.006209 23252 leader_election.cc:304] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:55.006492 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:55.004658 23495 tablet_service.cc:1511] Processing CreateTablet for tablet 8570fd3d81f4448587060878fe3c4a60 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:54.994699 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:55.007531 23567 raft_consensus.cc:2749] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:55.008625 23472 leader_election.cc:343] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.006757 23344 tablet_service.cc:1511] Processing CreateTablet for tablet 6f687663b31c40fea5a41eff18c7b6d5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:55.009757 23552 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:55.009910 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f687663b31c40fea5a41eff18c7b6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.010306 23495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8570fd3d81f4448587060878fe3c4a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.010627 23491 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab56513b0d44631b1b0258f31989b62 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:55.011945 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab56513b0d44631b1b0258f31989b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.012133 23552 ts_tablet_manager.cc:1403] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.235s	user 0.009s	sys 0.010s
I20260709 13:09:54.995327 23551 consensus_queue.cc:260] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:54.983642 23553 raft_consensus.cc:385] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.015486 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 6f687663b31c40fea5a41eff18c7b6d5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:55.007284 23435 raft_consensus.cc:2393] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e971a25f8dfb42fcb1afb9ecf74f760d in current term 1: Already voted for candidate e56d4fa89a4e41fb99476c088544e8b8 in this term.
I20260709 13:09:55.016415 23553 raft_consensus.cc:740] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.017376 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f687663b31c40fea5a41eff18c7b6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.017767 23553 consensus_queue.cc:260] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.019256 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f687663b31c40fea5a41eff18c7b6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.019991 23551 ts_tablet_manager.cc:1434] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:09:55.020007 23361 raft_consensus.cc:2468] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:55.021219 23551 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
W20260709 13:09:55.006211 23399 leader_election.cc:343] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.022393 23553 ts_tablet_manager.cc:1434] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.113s	user 0.005s	sys 0.002s
I20260709 13:09:55.022783 23473 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5
W20260709 13:09:55.023041 23399 leader_election.cc:343] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.016050 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:55.023972 23598 raft_consensus.cc:2804] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.024349 23598 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.024670 23598 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:55.025154 23400 leader_election.cc:343] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.025579 23400 leader_election.cc:304] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:55.015295 23552 raft_consensus.cc:359] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.023494 23553 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:55.023515 23399 leader_election.cc:304] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:55.029436 23472 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:55.030432 23559 raft_consensus.cc:2749] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.030791 23558 raft_consensus.cc:3060] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.028204 23585 raft_consensus.cc:2749] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.027091 23552 raft_consensus.cc:385] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.032274 23552 raft_consensus.cc:740] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.033152 23552 consensus_queue.cc:260] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.035394 23552 ts_tablet_manager.cc:1434] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 13:09:55.036281 23267 tablet_service.cc:1511] Processing CreateTablet for tablet 65dd0b5483a44bcba9b20f703b4f9588 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:55.004124 23600 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.037298 23598 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.041391 23567 raft_consensus.cc:493] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.041855 23567 raft_consensus.cc:515] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:55.042936 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:55.043469 23361 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.037497 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dd0b5483a44bcba9b20f703b4f9588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.049846 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:55.047757 23567 leader_election.cc:290] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
W20260709 13:09:55.051193 23249 leader_election.cc:343] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.051553 23558 raft_consensus.cc:2749] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.052028 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
W20260709 13:09:55.053175 23252 leader_election.cc:343] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.051683 23361 raft_consensus.cc:2468] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:55.053610 23252 leader_election.cc:304] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:55.054586 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 15f593b2e24c4ec29a2710db6dbde323 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:55.055653 23493 tablet_service.cc:1511] Processing CreateTablet for tablet 15f593b2e24c4ec29a2710db6dbde323 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:55.056891 23493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f593b2e24c4ec29a2710db6dbde323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.062152 23551 tablet_bootstrap.cc:654] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.062819 23473 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:55.063155 23567 raft_consensus.cc:2749] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.063704 23558 raft_consensus.cc:2804] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.064842 23600 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:55.064976 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:55.065599 23286 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:55.065860 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:55.073519 23552 tablet_bootstrap.cc:492] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:55.076498 23347 tablet_service.cc:1511] Processing CreateTablet for tablet 15f593b2e24c4ec29a2710db6dbde323 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:55.077719 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f593b2e24c4ec29a2710db6dbde323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.077792 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
W20260709 13:09:55.079375 23472 leader_election.cc:343] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.082060 23598 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:55.087662 23558 raft_consensus.cc:697] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:55.088683 23558 consensus_queue.cc:237] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.090528 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f593b2e24c4ec29a2710db6dbde323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.093176 23555 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:55.093767 23555 ts_tablet_manager.cc:1403] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.200s	user 0.016s	sys 0.003s
I20260709 13:09:55.096855 23555 raft_consensus.cc:359] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.097505 23286 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 2.
I20260709 13:09:55.102079 23553 tablet_bootstrap.cc:654] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.110628 23474 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:55.111889 23598 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:55.116776 23417 tablet_service.cc:1511] Processing CreateTablet for tablet b1af8f7f5d2f49d2a6bafad6338a0e92 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:55.117166 23598 raft_consensus.cc:697] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:55.117190 23567 consensus_queue.cc:1048] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.118165 23598 consensus_queue.cc:237] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.118193 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1af8f7f5d2f49d2a6bafad6338a0e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.107651 23555 raft_consensus.cc:385] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.122407 23274 tablet_service.cc:1511] Processing CreateTablet for tablet b1af8f7f5d2f49d2a6bafad6338a0e92 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:55.124804 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1af8f7f5d2f49d2a6bafad6338a0e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.124029 23555 raft_consensus.cc:740] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.132854 23555 consensus_queue.cc:260] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.122913 23493 tablet_service.cc:1511] Processing CreateTablet for tablet b1af8f7f5d2f49d2a6bafad6338a0e92 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:55.139714 23493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1af8f7f5d2f49d2a6bafad6338a0e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.143388 23499 tablet_service.cc:1511] Processing CreateTablet for tablet 97060878042843a39d96aa2725227238 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:55.144701 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97060878042843a39d96aa2725227238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.145910 23552 tablet_bootstrap.cc:654] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.144356 23348 tablet_service.cc:1511] Processing CreateTablet for tablet 97060878042843a39d96aa2725227238 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:55.159350 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97060878042843a39d96aa2725227238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.160099 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfeaf4ca4744c74bb5c73cef813d119 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:55.160497 23567 consensus_queue.cc:1048] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.161468 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfeaf4ca4744c74bb5c73cef813d119 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:55.162631 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfeaf4ca4744c74bb5c73cef813d119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.164402 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfeaf4ca4744c74bb5c73cef813d119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.176839 23183 catalog_manager.cc:5697] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.143370 23420 tablet_service.cc:1511] Processing CreateTablet for tablet 97060878042843a39d96aa2725227238 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:55.184855 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97060878042843a39d96aa2725227238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.189568 23555 ts_tablet_manager.cc:1434] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 13:09:55.203012 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfeaf4ca4744c74bb5c73cef813d119 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:55.212628 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfeaf4ca4744c74bb5c73cef813d119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.208901 23276 tablet_service.cc:1511] Processing CreateTablet for tablet b321c32adbbf498ab098332acdde971b (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:55.213935 23183 catalog_manager.cc:5697] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 1 to 2, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 2 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.222429 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b321c32adbbf498ab098332acdde971b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.206580 23491 tablet_service.cc:1511] Processing CreateTablet for tablet b321c32adbbf498ab098332acdde971b (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:55.225144 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b321c32adbbf498ab098332acdde971b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.220842 23555 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:55.233054 23553 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:55.233637 23553 ts_tablet_manager.cc:1403] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.210s	user 0.009s	sys 0.014s
I20260709 13:09:55.241202 23344 tablet_service.cc:1511] Processing CreateTablet for tablet b321c32adbbf498ab098332acdde971b (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:55.242411 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b321c32adbbf498ab098332acdde971b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.237026 23553 raft_consensus.cc:359] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.245689 23553 raft_consensus.cc:385] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.246039 23553 raft_consensus.cc:740] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.246876 23553 consensus_queue.cc:260] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.249315 23553 ts_tablet_manager.cc:1434] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:09:55.251880 23551 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:55.252383 23551 ts_tablet_manager.cc:1403] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.231s	user 0.007s	sys 0.021s
I20260709 13:09:55.255210 23551 raft_consensus.cc:359] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.259322 23270 tablet_service.cc:1511] Processing CreateTablet for tablet b0b3b6fe106647af871885230d191f65 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:55.263037 23342 tablet_service.cc:1511] Processing CreateTablet for tablet c9c98c482f2e46369c59ac866488c0e4 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:55.266776 23416 tablet_service.cc:1511] Processing CreateTablet for tablet c9c98c482f2e46369c59ac866488c0e4 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:55.274657 23420 tablet_service.cc:1511] Processing CreateTablet for tablet b0b3b6fe106647af871885230d191f65 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:55.275306 23416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c98c482f2e46369c59ac866488c0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.277199 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b3b6fe106647af871885230d191f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.274289 23493 tablet_service.cc:1511] Processing CreateTablet for tablet b0b3b6fe106647af871885230d191f65 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:55.278821 23493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b3b6fe106647af871885230d191f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.274245 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b3b6fe106647af871885230d191f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.286175 23555 tablet_bootstrap.cc:654] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.269191 23552 tablet_bootstrap.cc:492] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:55.272998 23553 tablet_bootstrap.cc:492] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:55.290907 23552 ts_tablet_manager.cc:1403] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.218s	user 0.015s	sys 0.011s
I20260709 13:09:55.293228 23585 raft_consensus.cc:493] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.293677 23585 raft_consensus.cc:515] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.293838 23552 raft_consensus.cc:359] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.294579 23552 raft_consensus.cc:385] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.294862 23552 raft_consensus.cc:740] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.288221 23551 raft_consensus.cc:385] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.296072 23551 raft_consensus.cc:740] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.296872 23551 consensus_queue.cc:260] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.297273 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:09:55.298745 23400 leader_election.cc:343] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.299113 23551 ts_tablet_manager.cc:1434] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.046s	user 0.001s	sys 0.005s
I20260709 13:09:55.299983 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:55.295553 23552 consensus_queue.cc:260] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.304819 23497 tablet_service.cc:1511] Processing CreateTablet for tablet c9c98c482f2e46369c59ac866488c0e4 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:55.305617 23552 ts_tablet_manager.cc:1434] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:09:55.306028 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c98c482f2e46369c59ac866488c0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.307586 23552 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
W20260709 13:09:55.308910 23399 leader_election.cc:343] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.309362 23399 leader_election.cc:304] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:55.309516 23348 tablet_service.cc:1511] Processing CreateTablet for tablet bedf4afe97a74466b70b3190f1c0c1de (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:55.310096 23559 raft_consensus.cc:2749] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.314610 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c98c482f2e46369c59ac866488c0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.295686 23585 leader_election.cc:290] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:55.324379 23420 tablet_service.cc:1511] Processing CreateTablet for tablet bedf4afe97a74466b70b3190f1c0c1de (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:55.325449 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedf4afe97a74466b70b3190f1c0c1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.324270 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedf4afe97a74466b70b3190f1c0c1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.333794 23551 tablet_bootstrap.cc:492] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:55.345633 23499 tablet_service.cc:1511] Processing CreateTablet for tablet ad6889af10f54526b070fa81c53b6b92 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:55.355680 23509 raft_consensus.cc:1240] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Rejecting Update request from peer 690e3a11be554a93b36ec5017ed89787 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:55.356907 23598 raft_consensus.cc:493] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.357210 23597 consensus_queue.cc:1059] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.357385 23598 raft_consensus.cc:515] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.357946 23597 consensus_queue.cc:1243] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Peer e971a25f8dfb42fcb1afb9ecf74f760d log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:09:55.358489 23597 raft_consensus.cc:3055] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:55.358806 23597 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:09:55.359565 23597 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.360550 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:55.364676 23286 raft_consensus.cc:2468] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:55.361943 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:55.359589 23598 leader_election.cc:290] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:55.365628 23474 leader_election.cc:304] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:55.366091 23553 tablet_bootstrap.cc:654] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.365588 23361 raft_consensus.cc:2468] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:55.368335 23276 tablet_service.cc:1511] Processing CreateTablet for tablet bedf4afe97a74466b70b3190f1c0c1de (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:55.366446 23598 raft_consensus.cc:2804] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.366350 23597 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:55.375906 23598 raft_consensus.cc:493] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.376322 23598 raft_consensus.cc:3060] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.369565 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedf4afe97a74466b70b3190f1c0c1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.383970 23270 tablet_service.cc:1511] Processing CreateTablet for tablet ad6889af10f54526b070fa81c53b6b92 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:55.384712 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6889af10f54526b070fa81c53b6b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.386382 23349 tablet_service.cc:1511] Processing CreateTablet for tablet ad6889af10f54526b070fa81c53b6b92 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:55.387526 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6889af10f54526b070fa81c53b6b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.387624 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6889af10f54526b070fa81c53b6b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.389829 23491 tablet_service.cc:1511] Processing CreateTablet for tablet 34ad643f490e4b029e3b1a87544df7e7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:55.391084 23598 raft_consensus.cc:515] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.394040 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 34ad643f490e4b029e3b1a87544df7e7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:55.396450 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:55.397195 23286 raft_consensus.cc:3060] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.398622 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ad643f490e4b029e3b1a87544df7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.391027 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ad643f490e4b029e3b1a87544df7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.404227 23555 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:55.405519 23567 raft_consensus.cc:493] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.410382 23344 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2d8f4b8d8446f6bf9822988a72557e (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:55.412153 23567 raft_consensus.cc:515] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.412627 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2d8f4b8d8446f6bf9822988a72557e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.414283 23567 leader_election.cc:290] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:55.415814 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:55.416951 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:55.417423 23555 ts_tablet_manager.cc:1403] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.197s	user 0.017s	sys 0.011s
I20260709 13:09:55.417666 23435 raft_consensus.cc:2468] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:09:55.417053 23286 raft_consensus.cc:2468] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
W20260709 13:09:55.417336 23252 leader_election.cc:343] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.420847 23474 leader_election.cc:304] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:55.423344 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:55.423868 23361 raft_consensus.cc:3060] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.425719 23608 raft_consensus.cc:2804] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.426223 23608 raft_consensus.cc:697] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:55.427052 23608 consensus_queue.cc:237] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.427757 23551 tablet_bootstrap.cc:654] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.430011 23361 raft_consensus.cc:2468] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:55.430533 23552 tablet_bootstrap.cc:654] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.432358 23249 leader_election.cc:304] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:55.423951 23598 leader_election.cc:290] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:55.424700 23555 raft_consensus.cc:359] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.434188 23555 raft_consensus.cc:385] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.434508 23567 raft_consensus.cc:2804] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.434922 23567 raft_consensus.cc:493] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.435243 23567 raft_consensus.cc:3060] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.443630 23598 raft_consensus.cc:493] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.444370 23598 raft_consensus.cc:515] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.444926 23551 tablet_bootstrap.cc:492] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:55.396309 23417 tablet_service.cc:1511] Processing CreateTablet for tablet 34ad643f490e4b029e3b1a87544df7e7 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:55.445459 23551 ts_tablet_manager.cc:1403] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.120s	user 0.006s	sys 0.006s
I20260709 13:09:55.445067 23567 raft_consensus.cc:515] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.446486 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ad643f490e4b029e3b1a87544df7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.447410 23567 leader_election.cc:290] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:55.448051 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:55.448010 23551 raft_consensus.cc:359] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.448457 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:55.449550 23552 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:55.460220 23435 raft_consensus.cc:3060] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.460633 23552 ts_tablet_manager.cc:1403] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.154s	user 0.006s	sys 0.005s
W20260709 13:09:55.461315 23252 leader_election.cc:343] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.462996 23552 raft_consensus.cc:359] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.463521 23552 raft_consensus.cc:385] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.463773 23552 raft_consensus.cc:740] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.464509 23552 consensus_queue.cc:260] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.460278 23551 raft_consensus.cc:385] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.466537 23551 raft_consensus.cc:740] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.467173 23551 consensus_queue.cc:260] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.434525 23555 raft_consensus.cc:740] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.468379 23555 consensus_queue.cc:260] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.452301 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:55.474277 23553 tablet_bootstrap.cc:492] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
W20260709 13:09:55.474347 23474 leader_election.cc:343] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.474849 23553 ts_tablet_manager.cc:1403] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.202s	user 0.011s	sys 0.030s
I20260709 13:09:55.452765 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:55.454880 23416 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2d8f4b8d8446f6bf9822988a72557e (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:55.476768 23416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2d8f4b8d8446f6bf9822988a72557e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.467521 23435 raft_consensus.cc:2468] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:09:55.478467 23249 leader_election.cc:304] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
W20260709 13:09:55.479038 23473 leader_election.cc:343] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.455535 23499 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2d8f4b8d8446f6bf9822988a72557e (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:55.480473 23499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2d8f4b8d8446f6bf9822988a72557e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.456532 23270 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8184122e504defbfcc6fbc81b06ab3 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:55.482331 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8184122e504defbfcc6fbc81b06ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.469256 23551 ts_tablet_manager.cc:1434] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:55.469901 23552 ts_tablet_manager.cc:1434] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:09:55.479444 23567 raft_consensus.cc:2804] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.483846 23567 raft_consensus.cc:697] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:09:55.484338 23552 tablet_bootstrap.cc:492] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:55.479517 23473 leader_election.cc:304] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:55.484705 23567 consensus_queue.cc:237] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.489054 23608 raft_consensus.cc:2749] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.484293 23551 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:55.451635 23598 leader_election.cc:290] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:55.525040 23555 ts_tablet_manager.cc:1434] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.107s	user 0.011s	sys 0.012s
I20260709 13:09:55.526281 23555 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:55.527102 23420 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8184122e504defbfcc6fbc81b06ab3 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:09:55.527911 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:38025, user_credentials={real_user=slave}} blocked reactor thread for 49533us
I20260709 13:09:55.528249 23420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8184122e504defbfcc6fbc81b06ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.530644 23491 tablet_service.cc:1511] Processing CreateTablet for tablet 56283a2404464c0bb214e90b06fdea8c (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:55.531702 23491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56283a2404464c0bb214e90b06fdea8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.533116 23344 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8184122e504defbfcc6fbc81b06ab3 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:55.534160 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8184122e504defbfcc6fbc81b06ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.534893 23286 raft_consensus.cc:1275] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Refusing update from remote peer e971a25f8dfb42fcb1afb9ecf74f760d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:55.538251 23361 raft_consensus.cc:1275] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e971a25f8dfb42fcb1afb9ecf74f760d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:09:55.538632 23361 pending_rounds.cc:85] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: Aborting all ops after (but not including) 0
I20260709 13:09:55.538870 23361 pending_rounds.cc:107] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:55.539134 23361 raft_consensus.cc:2889] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:55.541775 23558 consensus_queue.cc:1048] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.547093 23552 tablet_bootstrap.cc:654] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.547845 23553 raft_consensus.cc:359] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.550910 23553 raft_consensus.cc:385] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.551252 23553 raft_consensus.cc:740] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.552145 23553 consensus_queue.cc:260] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:55.553690 23598 consensus_queue.cc:1048] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.553987 23342 tablet_service.cc:1511] Processing CreateTablet for tablet 56283a2404464c0bb214e90b06fdea8c (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:55.555804 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56283a2404464c0bb214e90b06fdea8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.557271 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 56283a2404464c0bb214e90b06fdea8c (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:55.558502 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56283a2404464c0bb214e90b06fdea8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.560695 23553 ts_tablet_manager.cc:1434] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.086s	user 0.014s	sys 0.006s
I20260709 13:09:55.564100 23553 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:55.541785 23181 catalog_manager.cc:5697] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.568850 23421 tablet_service.cc:1511] Processing CreateTablet for tablet 7562f6ac7d8f4b459a477422faee3ad5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:55.570068 23421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7562f6ac7d8f4b459a477422faee3ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.573114 23553 tablet_bootstrap.cc:654] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.575186 23497 tablet_service.cc:1511] Processing CreateTablet for tablet 7562f6ac7d8f4b459a477422faee3ad5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:55.577436 23551 tablet_bootstrap.cc:654] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.579026 23435 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.579113 23276 tablet_service.cc:1511] Processing CreateTablet for tablet 7562f6ac7d8f4b459a477422faee3ad5 (DEFAULT_TABLE table=test-workload [id=5101062bdbf44251a6b95ca525e131df]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:55.579766 23552 tablet_bootstrap.cc:492] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:55.580279 23552 ts_tablet_manager.cc:1403] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.006s
I20260709 13:09:55.580351 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7562f6ac7d8f4b459a477422faee3ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.583977 23598 consensus_queue.cc:1048] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.583127 23552 raft_consensus.cc:359] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.585918 23552 raft_consensus.cc:385] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.586234 23552 raft_consensus.cc:740] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.586695 23598 consensus_queue.cc:1048] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.588233 23552 consensus_queue.cc:260] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.563004 23555 tablet_bootstrap.cc:654] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.587550 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7562f6ac7d8f4b459a477422faee3ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.604386 23552 ts_tablet_manager.cc:1434] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:55.611692 23552 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:55.617746 23585 raft_consensus.cc:493] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.618258 23585 raft_consensus.cc:515] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:55.621671 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:55.625814 23552 tablet_bootstrap.cc:654] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.626420 23509 raft_consensus.cc:2468] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:55.638432 23585 leader_election.cc:290] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:55.640004 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:55.640612 23359 raft_consensus.cc:2468] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:55.641822 23399 leader_election.cc:304] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:09:55.647764 23585 raft_consensus.cc:2804] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.647028 23181 catalog_manager.cc:5697] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.648190 23585 raft_consensus.cc:493] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.658843 23585 raft_consensus.cc:3060] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.670423 23553 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:55.670858 23553 ts_tablet_manager.cc:1403] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.000s
I20260709 13:09:55.678151 23553 raft_consensus.cc:359] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.678897 23553 raft_consensus.cc:385] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.680358 23553 raft_consensus.cc:740] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.683815 23551 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:55.684449 23551 ts_tablet_manager.cc:1403] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.200s	user 0.032s	sys 0.023s
I20260709 13:09:55.690891 23555 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:55.691499 23555 ts_tablet_manager.cc:1403] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.004s
I20260709 13:09:55.757995 23559 raft_consensus.cc:493] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.758626 23559 raft_consensus.cc:515] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:55.692178 23553 consensus_queue.cc:260] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:56.269878 23559 leader_election.cc:290] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:09:56.265159 23585 consensus_meta.cc:287] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.007s
W20260709 13:09:56.276719 23552 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.034s	sys 0.070s
W20260709 13:09:56.279771 23552 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.035s	sys 0.071s
I20260709 13:09:56.289680 23552 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:56.290258 23552 ts_tablet_manager.cc:1403] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.679s	user 0.042s	sys 0.072s
I20260709 13:09:56.293833 23552 raft_consensus.cc:359] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:56.294567 23552 raft_consensus.cc:385] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.294844 23552 raft_consensus.cc:740] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.283814 23585 raft_consensus.cc:515] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:56.303843 23555 raft_consensus.cc:359] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:56.305445 23555 raft_consensus.cc:385] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.305759 23555 raft_consensus.cc:740] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.306449 23555 consensus_queue.cc:260] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:56.295549 23552 consensus_queue.cc:260] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:56.304786 23551 raft_consensus.cc:359] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:56.307818 23551 raft_consensus.cc:385] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.306851 23585 leader_election.cc:290] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:56.308101 23551 raft_consensus.cc:740] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.308812 23551 consensus_queue.cc:260] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:56.309345 23552 ts_tablet_manager.cc:1434] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:09:56.310561 23552 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:56.310813 23551 ts_tablet_manager.cc:1434] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.626s	user 0.017s	sys 0.002s
W20260709 13:09:56.311095 23551 ts_tablet_manager.cc:1467] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: Tablet startup took 626ms
I20260709 13:09:56.312611 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:56.313361 23509 raft_consensus.cc:3060] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:56.311378 23551 ts_tablet_manager.cc:1469] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: Trace:
0709 13:09:53.553362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.553814 (+   452us) service_pool.cc:224] Handling call
0709 13:09:53.555661 (+  1847us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:53.555744 (+    83us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:53.622815 (+ 67071us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:53.727436 (+104621us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:53.727912 (+   476us) inbound_call.cc:177] Queueing success response
0709 13:09:55.483917 (+1756005us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:55.684729 (+200812us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:56.262291 (+577562us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:56.266188 (+  3897us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":634,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"tablet-open.queue_time_us":1756112}
I20260709 13:09:56.315002 23551 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:56.318622 23555 ts_tablet_manager.cc:1434] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.627s	user 0.006s	sys 0.002s
W20260709 13:09:56.318946 23555 ts_tablet_manager.cc:1467] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Tablet startup took 627ms
W20260709 13:09:56.319212 23555 ts_tablet_manager.cc:1469] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Trace:
0709 13:09:53.714949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.719130 (+  4181us) service_pool.cc:224] Handling call
0709 13:09:53.733683 (+ 14553us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:53.733770 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:53.965999 (+232229us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:53.994894 (+ 28895us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:53.995335 (+   441us) inbound_call.cc:177] Queueing success response
0709 13:09:55.525818 (+1530483us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:55.691836 (+166018us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:55.692876 (+  1040us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:55.693452 (+   576us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":9735,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"tablet-open.queue_time_us":1530527,"thread_start_us":9888,"threads_started":1}
I20260709 13:09:56.321142 23509 raft_consensus.cc:2468] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:56.321663 23555 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:56.322609 23401 leader_election.cc:304] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:56.324795 23585 raft_consensus.cc:2804] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.325340 23585 raft_consensus.cc:697] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:56.328322 23555 tablet_bootstrap.cc:654] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.326195 23585 consensus_queue.cc:237] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:56.328867 23551 tablet_bootstrap.cc:654] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.336555 23552 tablet_bootstrap.cc:654] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.343019 23551 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:56.343442 23551 ts_tablet_manager.cc:1403] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 13:09:56.346004 23551 raft_consensus.cc:359] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:56.346629 23551 raft_consensus.cc:385] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.346876 23551 raft_consensus.cc:740] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.352970 23551 consensus_queue.cc:260] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:56.356302 23551 ts_tablet_manager.cc:1434] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:09:56.357303 23551 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:56.362782 23551 tablet_bootstrap.cc:654] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.528421 23600 raft_consensus.cc:493] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.529078 23600 raft_consensus.cc:515] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:56.581192 23608 raft_consensus.cc:493] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.581728 23598 raft_consensus.cc:493] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.582388 23598 raft_consensus.cc:515] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:56.584537 23598 leader_election.cc:290] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:56.581741 23608 raft_consensus.cc:515] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:56.588511 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba0176229a34f60bf5899d36f898fe5" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
W20260709 13:09:56.589946 23472 leader_election.cc:343] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.595013 23608 leader_election.cc:290] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:56.609685 23600 leader_election.cc:290] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:56.710369 23585 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.711182 23585 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:56.714741 23585 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:56.762969 23585 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:09:56.763716 23585 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:56.778179 23585 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:57.476567 23585 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.477087 23585 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:57.479118 23585 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:57.479574 23585 raft_consensus.cc:493] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.480014 23585 raft_consensus.cc:515] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:57.482197 23585 leader_election.cc:290] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:57.505092 23585 raft_consensus.cc:493] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.513738 23585 raft_consensus.cc:515] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:57.517665 23585 leader_election.cc:290] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:09:57.520726 23551 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.007s	sys 0.015s
W20260709 13:09:57.521124 23551 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.007s	sys 0.015s
W20260709 13:09:57.995168 23555 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.664s	user 0.012s	sys 0.025s
W20260709 13:09:57.995589 23555 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.665s	user 0.012s	sys 0.025s
W20260709 13:09:58.015177 23399 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.6.2:43361 timed out after 1.700s (SENT)
I20260709 13:09:58.122776 23636 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.123484 23636 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.125749 23636 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.126968 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.129765 23435 raft_consensus.cc:2468] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:58.131246 23472 leader_election.cc:304] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.191983 23636 raft_consensus.cc:2804] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:58.192564 23636 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.197921 23636 raft_consensus.cc:3060] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.228404 23653 raft_consensus.cc:493] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.229465 23653 raft_consensus.cc:515] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.232123 23644 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:09:58.231701 23555 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:58.231693 23551 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:58.232916 23551 ts_tablet_manager.cc:1403] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 1.876s	user 0.009s	sys 0.022s
I20260709 13:09:58.232707 23644 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.235054 23644 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.235641 23555 ts_tablet_manager.cc:1403] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 1.914s	user 0.020s	sys 0.026s
I20260709 13:09:58.235775 23551 raft_consensus.cc:359] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.236531 23551 raft_consensus.cc:385] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.236791 23551 raft_consensus.cc:740] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.228504 23650 raft_consensus.cc:493] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.237222 23653 leader_election.cc:290] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.238418 23653 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:09:58.237835 23650 raft_consensus.cc:515] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.238906 23653 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.241479 23652 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.242046 23652 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.243237 23555 raft_consensus.cc:359] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:09:58.225251 23399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:43361, user_credentials={real_user=slave}} blocked reactor thread for 210079us
I20260709 13:09:58.244347 23555 raft_consensus.cc:385] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.238411 23551 consensus_queue.cc:260] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.246512 23555 raft_consensus.cc:740] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.247280 23555 consensus_queue.cc:260] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.249096 23647 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.257565 23653 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
W20260709 13:09:58.258405 23252 consensus_peers.cc:597] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 -> Peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Couldn't send request to peer e971a25f8dfb42fcb1afb9ecf74f760d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.259367 23551 ts_tablet_manager.cc:1434] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:58.259066 23555 ts_tablet_manager.cc:1434] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:09:58.246537 23650 leader_election.cc:290] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.249706 23647 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.267625 23551 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
W20260709 13:09:58.268275 23553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.004s	user 0.024s	sys 0.075s
W20260709 13:09:58.268618 23553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.006s	user 0.024s	sys 0.076s
I20260709 13:09:58.272223 23553 ts_tablet_manager.cc:1434] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 2.601s	user 0.030s	sys 0.076s
W20260709 13:09:58.272454 23553 ts_tablet_manager.cc:1467] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: Tablet startup took 2601ms
I20260709 13:09:58.268450 23650 raft_consensus.cc:493] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.272650 23553 ts_tablet_manager.cc:1469] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: Trace:
0709 13:09:53.631869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.632025 (+   156us) service_pool.cc:224] Handling call
0709 13:09:53.634005 (+  1980us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:53.634097 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:53.696867 (+ 62770us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:53.763858 (+ 66991us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:53.764405 (+   547us) inbound_call.cc:177] Queueing success response
0709 13:09:55.563669 (+1799264us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:55.671079 (+107410us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:55.676237 (+  5158us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:55.676735 (+   498us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":3150,"raft.queue_time_us":1965451,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"tablet-open.queue_time_us":1799350,"thread_start_us":2006169,"threads_started":1}
I20260709 13:09:58.276639 23650 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.277925 23654 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:09:58.270015 23652 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.278508 23555 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:58.288144 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.288322 23636 raft_consensus.cc:515] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.290539 23636 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.291051 23555 tablet_bootstrap.cc:654] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.291254 23651 raft_consensus.cc:493] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.280016 23650 leader_election.cc:290] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.280966 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.291756 23651 raft_consensus.cc:515] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.292153 23284 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:58.293603 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.293803 23651 leader_election.cc:290] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.294260 23283 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.281471 23551 tablet_bootstrap.cc:654] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.294567 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.295192 23282 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.284284 23654 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.297531 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.298174 23286 raft_consensus.cc:2468] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:09:58.277486 23647 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.298686 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.298064 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.298987 23434 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:09:58.296355 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:58.297390 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.300117 23433 raft_consensus.cc:3060] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.300606 23285 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:09:58.300285 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.303723 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.304662 23654 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:58.303692 23281 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.303190 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.306461 23655 raft_consensus.cc:493] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.306075 23650 raft_consensus.cc:493] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.310860 23647 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:09:58.311659 23181 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50604 (request call id 13) took 2677 ms. Trace:
W20260709 13:09:58.312690 23552 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.566s	user 0.021s	sys 0.025s
W20260709 13:09:58.321547 23552 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.575s	user 0.022s	sys 0.025s
I20260709 13:09:58.322005 23553 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:58.319891 23655 raft_consensus.cc:515] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.322661 23647 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.323802 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.327592 23505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.322773 23650 raft_consensus.cc:515] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.321439 23181 rpcz_store.cc:276] 0709 13:09:55.643993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.644134 (+   141us) service_pool.cc:224] Handling call
0709 13:09:55.661240 (+ 17106us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:55.661273 (+    33us) write_op.cc:454] Released schema lock
0709 13:09:58.311570 (+2650297us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:55.654670 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:55.655210 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:55.655249 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:09:55.655268 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:55.655608 (+   340us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:55.655662 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:55.655693 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:55.655907 (+   214us) tablet.cc:701] Row locks acquired
0709 13:09:55.655932 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:09:55.656207 (+   275us) write_op.cc:270] Start()
0709 13:09:55.656317 (+   110us) write_op.cc:276] Timestamp: P: 1783602595656159 usec, L: 0
0709 13:09:55.656337 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:09:55.656935 (+   598us) log.cc:844] Serialized 531 byte log entry
0709 13:09:55.658811 (+  1876us) op_driver.cc:464] REPLICATION: finished
0709 13:09:55.659230 (+   419us) write_op.cc:301] APPLY: starting
0709 13:09:55.659304 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:55.659401 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:55.659500 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:55.659705 (+   205us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:55.659884 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:55.659928 (+    44us) write_op.cc:312] APPLY: finished
0709 13:09:55.660105 (+   177us) log.cc:844] Serialized 22 byte log entry
0709 13:09:55.660261 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:55.660342 (+    81us) write_op.cc:454] Released schema lock
0709 13:09:55.660381 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":780302,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":244,"apply.run_cpu_time_us":1384,"apply.run_wall_time_us":1391,"num_ops":1,"prepare.queue_time_us":4532,"prepare.run_cpu_time_us":2426,"prepare.run_wall_time_us":2547,"replication_time_us":2366}]]}
I20260709 13:09:58.331858 23433 raft_consensus.cc:2468] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 2.
I20260709 13:09:58.333863 23552 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:58.334323 23552 ts_tablet_manager.cc:1403] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 2.024s	user 0.032s	sys 0.026s
I20260709 13:09:58.334638 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.334713 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.335408 23361 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.335614 23434 raft_consensus.cc:2368] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 for earlier term 1. Current term is 2.
I20260709 13:09:58.336834 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.337385 23361 raft_consensus.cc:3060] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.340103 23655 leader_election.cc:290] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:09:58.340730 23252 leader_election.cc:343] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.341151 23559 raft_consensus.cc:493] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.336995 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.341670 23559 raft_consensus.cc:515] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.342171 23433 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:58.342211 23645 consensus_queue.cc:1048] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:58.343703 23559 leader_election.cc:290] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.344902 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.346606 23505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.347374 23504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.347554 23507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.347813 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.337374 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.348453 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.349274 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.345679 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.348456 23359 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.350200 23501 raft_consensus.cc:2393] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e2983c2051a44788d4064010321c7f5 in current term 2: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:09:58.351208 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc9b65add704609837229927a148b95" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.351595 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.351961 23508 raft_consensus.cc:2393] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:09:58.352200 23360 raft_consensus.cc:2468] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.351145 23361 raft_consensus.cc:2468] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:58.352644 23552 raft_consensus.cc:359] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.353160 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.353819 23358 raft_consensus.cc:2468] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.354180 23650 leader_election.cc:290] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.354310 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.337143 23472 leader_election.cc:304] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.354593 23647 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.355268 23506 raft_consensus.cc:2368] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 for earlier term 1. Current term is 2.
I20260709 13:09:58.356245 23635 raft_consensus.cc:2804] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:58.356423 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:58.356700 23635 raft_consensus.cc:697] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:58.354915 23360 raft_consensus.cc:2468] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:58.357636 23635 consensus_queue.cc:237] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.357577 23182 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50614 (request call id 15) took 2690 ms. Trace:
I20260709 13:09:58.358799 23182 rpcz_store.cc:276] 0709 13:09:55.667292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.667840 (+   548us) service_pool.cc:224] Handling call
0709 13:09:58.357373 (+2689533us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2570641,"reported_tablets":1}
I20260709 13:09:58.359985 23184 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50630 (request call id 17) took 2692 ms. Trace:
I20260709 13:09:58.360352 23184 rpcz_store.cc:276] 0709 13:09:55.667667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.669046 (+  1379us) service_pool.cc:224] Handling call
0709 13:09:58.359934 (+2690888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2637189,"reported_tablets":2}
I20260709 13:09:58.360656 23327 leader_election.cc:400] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Vote denied by peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341) with higher term. Message: Invalid argument: T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 for earlier term 1. Current term is 2.
I20260709 13:09:58.360157 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.361075 23327 leader_election.cc:403] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:58.361382 23361 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.361732 23650 raft_consensus.cc:3060] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.361133 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.353358 23552 raft_consensus.cc:385] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.346365 23502 raft_consensus.cc:2468] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.380872 23552 raft_consensus.cc:740] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.385293 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.385460 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.386142 23359 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:09:58.383841 23552 consensus_queue.cc:260] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.381155 23636 raft_consensus.cc:493] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.389245 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.392216 23283 raft_consensus.cc:2468] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:58.393136 23183 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50640 (request call id 15) took 2736 ms. Trace:
I20260709 13:09:58.395015 23183 rpcz_store.cc:276] 0709 13:09:55.656628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.656768 (+   140us) service_pool.cc:224] Handling call
0709 13:09:58.393068 (+2736300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2648919,"reported_tablets":3}
I20260709 13:09:58.394114 23636 raft_consensus.cc:515] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.396138 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba0176229a34f60bf5899d36f898fe5" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.391320 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.397528 23555 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:58.401398 23636 leader_election.cc:290] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:58.401875 23555 ts_tablet_manager.cc:1403] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.013s
I20260709 13:09:58.402153 23551 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:58.402595 23551 ts_tablet_manager.cc:1403] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.005s
I20260709 13:09:58.393734 23650 raft_consensus.cc:2749] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341) with higher term. Message: Invalid argument: T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 for earlier term 1. Current term is 2.
I20260709 13:09:58.404361 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.405194 23555 raft_consensus.cc:359] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.400751 23552 ts_tablet_manager.cc:1434] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:09:58.405906 23555 raft_consensus.cc:385] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.406255 23555 raft_consensus.cc:740] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.391373 23553 tablet_bootstrap.cc:654] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.407482 23552 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:58.407358 23326 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:09:58.407717 23401 leader_election.cc:304] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.405658 23250 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:09:58.409312 23250 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.410174 23657 raft_consensus.cc:2804] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.410559 23657 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.410871 23657 raft_consensus.cc:3060] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.411985 23645 raft_consensus.cc:2804] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:58.412370 23645 raft_consensus.cc:493] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.412672 23645 raft_consensus.cc:3060] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.413458 23552 tablet_bootstrap.cc:654] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.415999 23651 raft_consensus.cc:2749] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.417449 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.416653 23551 raft_consensus.cc:359] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.418190 23551 raft_consensus.cc:385] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:58.417554 23400 leader_election.cc:343] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.420044 23326 leader_election.cc:304] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.421098 23400 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.421437 23326 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.422161 23647 raft_consensus.cc:2804] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:58.422465 23655 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:58.422508 23647 raft_consensus.cc:493] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.422935 23655 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:09:58.423005 23647 raft_consensus.cc:3060] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.423373 23655 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.423934 23559 raft_consensus.cc:2749] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.429718 23645 raft_consensus.cc:515] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.430399 23551 raft_consensus.cc:740] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.431100 23551 consensus_queue.cc:260] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.429955 23647 raft_consensus.cc:515] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.432377 23400 leader_election.cc:304] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:09:58.434546 23559 raft_consensus.cc:2804] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:58.434712 23400 leader_election.cc:343] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.434922 23559 raft_consensus.cc:493] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.432986 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
W20260709 13:09:58.433655 23474 leader_election.cc:343] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.435850 23474 leader_election.cc:304] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.433848 23551 ts_tablet_manager.cc:1434] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:09:58.437315 23636 consensus_queue.cc:1048] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.437566 23652 consensus_queue.cc:1048] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.435251 23559 raft_consensus.cc:3060] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.437867 23647 leader_election.cc:290] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.436651 23635 raft_consensus.cc:2804] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.443856 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
W20260709 13:09:58.437062 23474 leader_election.cc:343] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.444334 23399 leader_election.cc:304] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.444743 23474 leader_election.cc:304] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.436556 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:58.445688 23555 consensus_queue.cc:260] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.438997 23506 raft_consensus.cc:3060] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.438917 23551 tablet_bootstrap.cc:492] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:58.441609 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.441470 23657 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.460098 23648 consensus_queue.cc:1048] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:58.442657 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b043244b784f45b564c43cf1477286" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.443101 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.444000 23635 raft_consensus.cc:493] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.415112 23650 raft_consensus.cc:2804] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.461671 23650 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.461827 23657 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.461585 23635 raft_consensus.cc:3060] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.462144 23650 raft_consensus.cc:3060] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.446689 23646 raft_consensus.cc:2764] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:58.436174 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.446964 23399 leader_election.cc:304] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.462905 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.460152 23360 raft_consensus.cc:2468] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 2.
W20260709 13:09:58.447436 23456 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0fe0 after lost signal to thread 15387
I20260709 13:09:58.439087 23655 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.463958 23646 raft_consensus.cc:2804] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.464299 23646 raft_consensus.cc:493] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.464602 23646 raft_consensus.cc:3060] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.465319 23655 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 3 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.449923 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
W20260709 13:09:58.466920 23456 debug-util.cc:398] Leaking SignalData structure 0x7b0800195940 after lost signal to thread 23218
I20260709 13:09:58.467437 23183 catalog_manager.cc:5697] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } }
W20260709 13:09:58.468448 23456 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2480 after lost signal to thread 23310
W20260709 13:09:58.469615 23456 debug-util.cc:398] Leaking SignalData structure 0x7b08000d47e0 after lost signal to thread 23385
I20260709 13:09:58.470075 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
W20260709 13:09:58.470767 23456 debug-util.cc:398] Leaking SignalData structure 0x7b0800289560 after lost signal to thread 23459
I20260709 13:09:58.452060 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.451088 23559 raft_consensus.cc:515] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.472643 23644 consensus_queue.cc:1048] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.456993 23555 ts_tablet_manager.cc:1434] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 13:09:58.474040 23433 raft_consensus.cc:2393] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:09:58.474638 23555 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:09:58.476290 23456 debug-util.cc:398] Leaking SignalData structure 0x7b0800332080 after lost signal to thread 23533
W20260709 13:09:58.476929 23456 debug-util.cc:398] Leaking SignalData structure 0x7b080014ae60 after lost signal to thread 23634
I20260709 13:09:58.472103 23399 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
W20260709 13:09:58.479118 23399 leader_election.cc:343] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.440526 23645 leader_election.cc:290] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.446432 23636 raft_consensus.cc:2749] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.470383 23635 raft_consensus.cc:515] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.479530 23399 leader_election.cc:304] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.480607 23645 raft_consensus.cc:2749] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.479959 23644 raft_consensus.cc:2804] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:58.481578 23644 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:09:58.481482 23635 leader_election.cc:290] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:58.482277 23644 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:58.456467 23249 leader_election.cc:343] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.482872 23249 leader_election.cc:304] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.483621 23657 raft_consensus.cc:2749] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.484568 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.485177 23283 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:58.486459 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.489078 23650 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.489225 23646 raft_consensus.cc:515] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.490185 23358 raft_consensus.cc:2393] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:09:58.490475 23434 raft_consensus.cc:2393] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:09:58.491185 23646 leader_election.cc:290] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:09:58.492168 23473 leader_election.cc:343] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.492695 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3eb2b6228254ee6bc99789c42b8fa29" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.459712 23551 tablet_bootstrap.cc:654] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.493013 23555 tablet_bootstrap.cc:654] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.493963 23283 raft_consensus.cc:3060] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.494977 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.492995 23324 leader_election.cc:304] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.496538 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.472115 23183 catalog_manager.cc:5697] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 2, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 2 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.497413 23655 raft_consensus.cc:2749] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.497498 23279 raft_consensus.cc:2393] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e2983c2051a44788d4064010321c7f5 in current term 1: Already voted for candidate e56d4fa89a4e41fb99476c088544e8b8 in this term.
I20260709 13:09:58.498486 23324 leader_election.cc:400] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025) with higher term. Message: Invalid argument: T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 for earlier term 1. Current term is 2.
I20260709 13:09:58.500427 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.500727 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e383f298f23f4ba8bb47a27742f0bff0" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.501262 23552 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:58.501724 23552 ts_tablet_manager.cc:1403] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.014s
I20260709 13:09:58.498714 23644 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.502241 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.502787 23281 raft_consensus.cc:3060] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.504213 23644 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.501812 23324 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.504452 23552 raft_consensus.cc:359] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.492763 23559 leader_election.cc:290] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:58.505677 23552 raft_consensus.cc:385] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.506273 23552 raft_consensus.cc:740] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.506976 23552 consensus_queue.cc:260] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.506074 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.508795 23655 raft_consensus.cc:2749] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.492797 23473 leader_election.cc:304] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.507032 23650 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.510068 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.510445 23635 raft_consensus.cc:2749] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.508500 23552 ts_tablet_manager.cc:1434] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:58.510727 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.511610 23358 raft_consensus.cc:2393] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e2983c2051a44788d4064010321c7f5 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:09:58.508369 23553 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:58.512591 23553 ts_tablet_manager.cc:1403] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.192s	user 0.010s	sys 0.002s
I20260709 13:09:58.512436 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.513058 23280 raft_consensus.cc:3060] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.510502 23283 raft_consensus.cc:2468] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:09:58.512027 23552 tablet_bootstrap.cc:492] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:58.514356 23279 raft_consensus.cc:1240] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Rejecting Update request from peer e971a25f8dfb42fcb1afb9ecf74f760d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:58.517756 23553 raft_consensus.cc:359] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.518260 23553 raft_consensus.cc:385] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.518481 23553 raft_consensus.cc:740] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.520423 23434 raft_consensus.cc:1240] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Rejecting Update request from peer e56d4fa89a4e41fb99476c088544e8b8 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:58.520581 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:58.521564 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.522135 23357 raft_consensus.cc:3060] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.524767 23553 consensus_queue.cc:260] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.521840 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.527158 23360 raft_consensus.cc:3060] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.533092 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:58.539978 23434 raft_consensus.cc:3060] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.540246 23326 leader_election.cc:304] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5
W20260709 13:09:58.541535 23326 leader_election.cc:343] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.541975 23326 leader_election.cc:304] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.543124 23326 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
W20260709 13:09:58.544000 23474 leader_election.cc:343] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.544149 23657 consensus_queue.cc:1059] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.544938 23657 raft_consensus.cc:3055] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.544947 23635 consensus_queue.cc:1059] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:58.545521 23657 raft_consensus.cc:740] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
W20260709 13:09:58.543673 23400 leader_election.cc:343] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.546665 23655 raft_consensus.cc:2749] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.546330 23657 consensus_queue.cc:260] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.547564 23506 raft_consensus.cc:2468] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:09:58.544927 23357 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:58.545980 23635 raft_consensus.cc:3055] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.548767 23635 raft_consensus.cc:740] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:58.548960 23401 leader_election.cc:304] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.549605 23635 consensus_queue.cc:260] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.545693 23280 raft_consensus.cc:2468] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:58.552374 23281 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:58.550462 23647 raft_consensus.cc:2764] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:58.552626 23635 raft_consensus.cc:3060] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.554476 23474 leader_election.cc:304] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.547624 23434 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:09:58.548146 23657 raft_consensus.cc:3060] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.554067 23326 leader_election.cc:304] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.555611 23249 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:58.557287 23552 tablet_bootstrap.cc:654] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.555635 23636 raft_consensus.cc:2804] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.557826 23400 leader_election.cc:304] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:09:58.558503 23636 raft_consensus.cc:697] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:58.558885 23644 raft_consensus.cc:2804] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.559424 23644 raft_consensus.cc:697] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:58.557797 23651 raft_consensus.cc:2804] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.552901 23646 raft_consensus.cc:2804] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:58.560148 23651 raft_consensus.cc:697] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:09:58.557272 23647 raft_consensus.cc:2804] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:58.552675 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.554476 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.566220 23553 ts_tablet_manager.cc:1434] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:09:58.559500 23636 consensus_queue.cc:237] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.560295 23644 consensus_queue.cc:237] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.572485 23651 consensus_queue.cc:237] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:09:58.573019 23473 leader_election.cc:343] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.573467 23473 leader_election.cc:304] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.565863 23647 raft_consensus.cc:697] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:09:58.575136 23553 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:58.575857 23647 consensus_queue.cc:237] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.576591 23558 raft_consensus.cc:2749] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.580875 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:58.581988 23399 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.581704 23434 raft_consensus.cc:2393] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e56d4fa89a4e41fb99476c088544e8b8 in this term.
I20260709 13:09:58.583489 23645 raft_consensus.cc:2749] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.596580 23551 tablet_bootstrap.cc:492] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:58.597579 23551 ts_tablet_manager.cc:1403] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.159s	user 0.006s	sys 0.012s
W20260709 13:09:58.614616 23473 leader_election.cc:343] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.623818 23360 raft_consensus.cc:2468] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:58.624405 23650 raft_consensus.cc:2749] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.625139 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.620893 23357 raft_consensus.cc:1240] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Rejecting Update request from peer e971a25f8dfb42fcb1afb9ecf74f760d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:58.626083 23399 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.626859 23644 raft_consensus.cc:2749] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.627871 23650 raft_consensus.cc:493] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.628312 23650 raft_consensus.cc:515] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.631086 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.632421 23650 leader_election.cc:290] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:09:58.633313 23326 leader_election.cc:343] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.636778 23324 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.638170 23399 leader_election.cc:304] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.638954 23645 raft_consensus.cc:2804] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.639259 23551 raft_consensus.cc:359] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.639406 23645 raft_consensus.cc:697] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:58.639950 23551 raft_consensus.cc:385] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.640372 23551 raft_consensus.cc:740] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.640686 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.640563 23645 consensus_queue.cc:237] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.640959 23551 consensus_queue.cc:260] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.641290 23434 raft_consensus.cc:2468] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:58.643242 23650 raft_consensus.cc:2749] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.643854 23551 ts_tablet_manager.cc:1434] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:09:58.644450 23636 raft_consensus.cc:493] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.644923 23636 raft_consensus.cc:515] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.645522 23646 raft_consensus.cc:697] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:58.647176 23551 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:58.646536 23646 consensus_queue.cc:237] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.647820 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.648633 23645 raft_consensus.cc:493] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.648437 23434 raft_consensus.cc:2468] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
W20260709 13:09:58.652510 23473 leader_election.cc:343] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.652872 23472 leader_election.cc:304] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.653614 23324 leader_election.cc:304] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.649103 23645 raft_consensus.cc:515] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.653954 23636 leader_election.cc:290] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.654598 23552 tablet_bootstrap.cc:492] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:58.654798 23650 raft_consensus.cc:2804] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.655030 23552 ts_tablet_manager.cc:1403] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.018s
I20260709 13:09:58.655107 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.655674 23645 leader_election.cc:290] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.655964 23283 raft_consensus.cc:2468] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:58.655186 23650 raft_consensus.cc:493] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.657998 23650 raft_consensus.cc:3060] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.653965 23669 raft_consensus.cc:2804] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.658084 23552 raft_consensus.cc:359] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.661803 23669 raft_consensus.cc:493] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.662174 23669 raft_consensus.cc:3060] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.663002 23551 tablet_bootstrap.cc:654] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.663683 23552 raft_consensus.cc:385] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.664089 23552 raft_consensus.cc:740] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.665009 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba0176229a34f60bf5899d36f898fe5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.665685 23552 consensus_queue.cc:260] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.665786 23502 raft_consensus.cc:2468] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.665702 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba0176229a34f60bf5899d36f898fe5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.672871 23283 raft_consensus.cc:2468] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:58.672958 23401 leader_election.cc:304] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.673709 23645 raft_consensus.cc:2804] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.674077 23645 raft_consensus.cc:493] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.674387 23645 raft_consensus.cc:3060] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.675305 23669 raft_consensus.cc:515] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.677510 23555 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:58.677956 23555 ts_tablet_manager.cc:1403] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.204s	user 0.016s	sys 0.000s
I20260709 13:09:58.677938 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:58.678647 23434 raft_consensus.cc:3060] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.678252 23650 raft_consensus.cc:515] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.679266 23669 leader_election.cc:290] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.679471 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.676808 23553 tablet_bootstrap.cc:654] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.680214 23283 raft_consensus.cc:3060] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.681555 23552 ts_tablet_manager.cc:1434] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 13:09:58.681376 23555 raft_consensus.cc:359] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.682164 23555 raft_consensus.cc:385] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.682610 23552 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:58.682494 23555 raft_consensus.cc:740] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.683548 23555 consensus_queue.cc:260] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.686013 23555 ts_tablet_manager.cc:1434] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:58.686988 23555 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:58.687687 23434 raft_consensus.cc:2468] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:58.694839 23552 tablet_bootstrap.cc:654] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.695760 23645 raft_consensus.cc:515] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.692055 23283 raft_consensus.cc:2468] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:58.699894 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba0176229a34f60bf5899d36f898fe5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.700917 23281 raft_consensus.cc:3060] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.700827 23474 leader_election.cc:304] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:58.703200 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:58.703431 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba0176229a34f60bf5899d36f898fe5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:58.704036 23502 raft_consensus.cc:3060] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.702172 23645 leader_election.cc:290] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.709435 23281 raft_consensus.cc:2468] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:58.712929 23400 leader_election.cc:304] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
W20260709 13:09:58.710323 23326 leader_election.cc:343] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.702657 23669 raft_consensus.cc:2804] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.718096 23669 raft_consensus.cc:697] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:58.719208 23551 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:58.718948 23669 consensus_queue.cc:237] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.719659 23551 ts_tablet_manager.cc:1403] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.003s
I20260709 13:09:58.723615 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb2904c2354438697ad5ed0013f8479" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:58.724233 23434 raft_consensus.cc:3060] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.726174 23502 raft_consensus.cc:2468] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:58.722167 23645 raft_consensus.cc:2804] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.729794 23645 raft_consensus.cc:697] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:58.730588 23645 consensus_queue.cc:237] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.723106 23551 raft_consensus.cc:359] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.717689 23650 leader_election.cc:290] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.732211 23551 raft_consensus.cc:385] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.732483 23551 raft_consensus.cc:740] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.735587 23553 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:58.734062 23551 consensus_queue.cc:260] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.736099 23553 ts_tablet_manager.cc:1403] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.006s
I20260709 13:09:58.738235 23551 ts_tablet_manager.cc:1434] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:09:58.739187 23551 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:58.739586 23553 raft_consensus.cc:359] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.740365 23553 raft_consensus.cc:385] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.740650 23553 raft_consensus.cc:740] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.741395 23553 consensus_queue.cc:260] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.745786 23555 tablet_bootstrap.cc:654] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.747478 23434 raft_consensus.cc:2468] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:09:58.747879 23553 ts_tablet_manager.cc:1434] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:58.761487 23553 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:58.761768 23324 leader_election.cc:304] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.763346 23650 raft_consensus.cc:2804] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.754050 23551 tablet_bootstrap.cc:654] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.764541 23650 raft_consensus.cc:697] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:09:58.765429 23650 consensus_queue.cc:237] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.767455 23553 tablet_bootstrap.cc:654] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.770270 23669 raft_consensus.cc:493] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.773808 23636 raft_consensus.cc:493] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.774282 23636 raft_consensus.cc:515] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.776326 23636 leader_election.cc:290] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:58.778189 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5e3b8a31e54e7186eff3a07ae3dcae" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.778698 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5e3b8a31e54e7186eff3a07ae3dcae" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.779090 23552 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:58.779610 23552 ts_tablet_manager.cc:1403] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.006s
W20260709 13:09:58.779913 23472 leader_election.cc:343] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.782294 23552 raft_consensus.cc:359] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.782912 23552 raft_consensus.cc:385] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.783156 23552 raft_consensus.cc:740] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.783775 23552 consensus_queue.cc:260] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:09:58.784960 23474 leader_election.cc:343] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.785405 23474 leader_election.cc:304] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:58.786185 23552 ts_tablet_manager.cc:1434] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:58.786818 23636 raft_consensus.cc:2749] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.787238 23552 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:58.790017 23182 catalog_manager.cc:5697] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.795946 23669 raft_consensus.cc:515] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.796847 23552 tablet_bootstrap.cc:654] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.798743 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b34184164445d4bf8bb87b3e76b22d" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:09:58.800249 23473 leader_election.cc:343] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.808274 23434 raft_consensus.cc:1240] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Rejecting Update request from peer e971a25f8dfb42fcb1afb9ecf74f760d for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:58.809680 23636 consensus_queue.cc:1059] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:58.810734 23635 raft_consensus.cc:3055] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.811070 23635 raft_consensus.cc:740] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:58.811839 23635 consensus_queue.cc:260] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.812918 23635 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.816294 23184 catalog_manager.cc:5697] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.817795 23184 catalog_manager.cc:5697] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.822484 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b34184164445d4bf8bb87b3e76b22d" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.822858 23357 raft_consensus.cc:1275] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e971a25f8dfb42fcb1afb9ecf74f760d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:58.823172 23434 raft_consensus.cc:2468] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:58.824205 23472 leader_election.cc:304] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:58.824662 23558 consensus_queue.cc:1048] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.825047 23648 raft_consensus.cc:2804] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.825443 23648 raft_consensus.cc:493] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.825749 23648 raft_consensus.cc:3060] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.836639 23648 raft_consensus.cc:515] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.840148 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b34184164445d4bf8bb87b3e76b22d" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:58.840399 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b34184164445d4bf8bb87b3e76b22d" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:58.840741 23433 raft_consensus.cc:3060] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:58.844756 23473 leader_election.cc:343] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.848136 23435 raft_consensus.cc:1275] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e971a25f8dfb42fcb1afb9ecf74f760d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:58.849884 23636 consensus_queue.cc:1048] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.850826 23433 raft_consensus.cc:2468] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:58.851673 23648 leader_election.cc:290] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.852399 23472 leader_election.cc:304] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:58.856942 23636 raft_consensus.cc:2804] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.858227 23636 raft_consensus.cc:697] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:58.859156 23636 consensus_queue.cc:237] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.860869 23669 leader_election.cc:290] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.869216 23555 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:58.869704 23555 ts_tablet_manager.cc:1403] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.183s	user 0.020s	sys 0.017s
I20260709 13:09:58.819279 23184 catalog_manager.cc:5697] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.871554 23184 catalog_manager.cc:5697] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.877074 23553 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:58.866776 23551 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:58.877983 23551 ts_tablet_manager.cc:1403] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.002s
I20260709 13:09:58.879954 23553 ts_tablet_manager.cc:1403] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.005s
I20260709 13:09:58.872246 23555 raft_consensus.cc:359] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.880609 23555 raft_consensus.cc:385] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.880301 23551 raft_consensus.cc:359] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.880899 23555 raft_consensus.cc:740] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.881050 23551 raft_consensus.cc:385] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.881381 23551 raft_consensus.cc:740] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.881762 23555 consensus_queue.cc:260] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.885311 23553 raft_consensus.cc:359] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.885998 23553 raft_consensus.cc:385] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.886317 23553 raft_consensus.cc:740] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.886963 23553 consensus_queue.cc:260] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.887853 23552 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:58.888307 23552 ts_tablet_manager.cc:1403] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.020s
I20260709 13:09:58.889189 23553 ts_tablet_manager.cc:1434] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:58.890172 23553 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:58.890652 23552 raft_consensus.cc:359] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.891288 23552 raft_consensus.cc:385] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.891541 23552 raft_consensus.cc:740] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.892170 23552 consensus_queue.cc:260] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.890540 23182 catalog_manager.cc:5697] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.894079 23552 ts_tablet_manager.cc:1434] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:58.894994 23552 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:58.885336 23555 ts_tablet_manager.cc:1434] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:09:58.896802 23555 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:58.896942 23553 tablet_bootstrap.cc:654] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.901969 23555 tablet_bootstrap.cc:654] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.895705 23182 catalog_manager.cc:5697] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.911150 23552 tablet_bootstrap.cc:654] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.920765 23183 catalog_manager.cc:5697] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.922876 23183 catalog_manager.cc:5697] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.933890 23657 raft_consensus.cc:493] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.934428 23657 raft_consensus.cc:515] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.936650 23657 leader_election.cc:290] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:58.938014 23552 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:58.938485 23552 ts_tablet_manager.cc:1403] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.044s	user 0.002s	sys 0.007s
I20260709 13:09:58.937886 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:58.939323 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:58.939952 23358 raft_consensus.cc:2393] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:09:58.940992 23249 leader_election.cc:304] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:58.941532 23552 raft_consensus.cc:359] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.942085 23654 raft_consensus.cc:3060] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.942296 23552 raft_consensus.cc:385] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.942683 23552 raft_consensus.cc:740] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.943322 23552 consensus_queue.cc:260] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:58.945302 23552 ts_tablet_manager.cc:1434] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:58.882016 23551 consensus_queue.cc:260] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:58.949245 23552 tablet_bootstrap.cc:492] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:58.950109 23654 raft_consensus.cc:2749] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.960932 23654 consensus_queue.cc:1048] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.960943 23552 tablet_bootstrap.cc:654] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.965729 23357 raft_consensus.cc:1240] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Rejecting Update request from peer e971a25f8dfb42fcb1afb9ecf74f760d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.967456 23636 consensus_queue.cc:1059] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:58.968315 23648 raft_consensus.cc:3055] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:58.968787 23648 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:58.969785 23648 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.971195 23648 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.973371 23552 tablet_bootstrap.cc:492] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:58.973809 23552 ts_tablet_manager.cc:1403] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.005s
I20260709 13:09:58.985539 23647 raft_consensus.cc:493] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.985984 23647 raft_consensus.cc:515] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:58.988206 23647 leader_election.cc:290] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:58.989181 23551 ts_tablet_manager.cc:1434] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.000s
I20260709 13:09:58.989346 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:58.990219 23551 tablet_bootstrap.cc:492] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:58.990001 23552 raft_consensus.cc:359] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.990631 23552 raft_consensus.cc:385] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.991816 23552 raft_consensus.cc:740] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.992933 23552 consensus_queue.cc:260] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:58.994969 23552 ts_tablet_manager.cc:1434] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:09:58.995235 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:58.996091 23281 raft_consensus.cc:2393] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:09:58.997349 23326 leader_election.cc:304] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:58.998436 23647 raft_consensus.cc:3060] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.995970 23552 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.015779 23184 catalog_manager.cc:5697] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.030303 23647 raft_consensus.cc:2749] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.034335 23636 consensus_queue.cc:1048] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.046300 23645 raft_consensus.cc:493] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.046823 23645 raft_consensus.cc:515] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.048882 23645 leader_election.cc:290] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:59.050980 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5348b6264474d048efc80da425fee14" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:59.052721 23552 tablet_bootstrap.cc:654] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:59.053651 23399 leader_election.cc:343] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.052649 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5348b6264474d048efc80da425fee14" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:59.055826 23654 raft_consensus.cc:493] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.054957 23646 consensus_queue.cc:1048] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:59.056353 23400 leader_election.cc:343] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.057034 23671 consensus_queue.cc:1048] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.057165 23400 leader_election.cc:304] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.056309 23654 raft_consensus.cc:515] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.060038 23559 raft_consensus.cc:2749] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.060510 23646 raft_consensus.cc:493] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.060966 23646 raft_consensus.cc:515] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.062105 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:59.062383 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:59.062966 23502 raft_consensus.cc:2468] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:09:59.063098 23357 raft_consensus.cc:2468] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:09:59.063468 23645 consensus_queue.cc:1048] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.063961 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84edc3d80d547aba534dc0d00486d96" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:59.063892 23646 leader_election.cc:290] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:59.065047 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84edc3d80d547aba534dc0d00486d96" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:59.054931 23551 tablet_bootstrap.cc:654] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.068204 23506 raft_consensus.cc:2468] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:59.064967 23250 leader_election.cc:304] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:09:59.073480 23651 raft_consensus.cc:2804] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.059733 23654 leader_election.cc:290] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:59.073868 23651 raft_consensus.cc:493] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.074209 23651 raft_consensus.cc:3060] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.072999 23400 leader_election.cc:343] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.094086 23401 leader_election.cc:304] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.097229 23645 raft_consensus.cc:2804] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.097687 23645 raft_consensus.cc:493] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.098045 23645 raft_consensus.cc:3060] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.082692 23654 consensus_queue.cc:1048] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:09:59.117367 23645 raft_consensus.cc:515] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.118460 23648 consensus_queue.cc:1048] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.125025 23646 consensus_queue.cc:1048] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.119913 23553 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:59.125972 23553 ts_tablet_manager.cc:1403] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.236s	user 0.031s	sys 0.062s
I20260709 13:09:59.128662 23553 raft_consensus.cc:359] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.129186 23553 raft_consensus.cc:385] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.129390 23553 raft_consensus.cc:740] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.129911 23553 consensus_queue.cc:260] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.134538 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84edc3d80d547aba534dc0d00486d96" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:59.135121 23506 raft_consensus.cc:3060] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.131942 23651 raft_consensus.cc:515] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.138233 23280 raft_consensus.cc:1275] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:59.139128 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:59.140275 23647 consensus_queue.cc:1048] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.140789 23502 raft_consensus.cc:3060] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.141491 23555 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.141942 23555 ts_tablet_manager.cc:1403] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.245s	user 0.032s	sys 0.076s
I20260709 13:09:59.153318 23552 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:59.153808 23552 ts_tablet_manager.cc:1403] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.027s
I20260709 13:09:59.150339 23645 leader_election.cc:290] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:59.156296 23552 raft_consensus.cc:359] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.156919 23552 raft_consensus.cc:385] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.157181 23552 raft_consensus.cc:740] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.157711 23553 ts_tablet_manager.cc:1434] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:09:59.158728 23553 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:59.160213 23279 raft_consensus.cc:1275] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:09:59.160619 23279 pending_rounds.cc:85] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Aborting all ops after (but not including) 0
I20260709 13:09:59.160833 23279 pending_rounds.cc:107] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:59.161091 23279 raft_consensus.cc:2889] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:59.164232 23508 raft_consensus.cc:1275] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:09:59.164613 23508 pending_rounds.cc:85] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: Aborting all ops after (but not including) 0
I20260709 13:09:59.164832 23508 pending_rounds.cc:107] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:59.165061 23508 raft_consensus.cc:2889] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:59.164983 23646 consensus_queue.cc:1048] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.165235 23502 raft_consensus.cc:2468] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:09:59.166427 23252 leader_election.cc:304] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:59.166930 23647 consensus_queue.cc:1048] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.150650 23555 raft_consensus.cc:359] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.168521 23555 raft_consensus.cc:385] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.168278 23654 raft_consensus.cc:2804] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.168984 23555 raft_consensus.cc:740] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.169610 23654 raft_consensus.cc:697] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:09:59.157276 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84edc3d80d547aba534dc0d00486d96" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:59.168977 23651 leader_election.cc:290] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:59.173640 23552 consensus_queue.cc:260] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.176909 23654 consensus_queue.cc:237] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.177060 23555 consensus_queue.cc:260] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.179123 23555 ts_tablet_manager.cc:1434] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:09:59.179982 23506 raft_consensus.cc:2468] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
W20260709 13:09:59.180277 23400 leader_election.cc:343] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.181337 23555 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:59.182215 23551 tablet_bootstrap.cc:492] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:59.182731 23551 ts_tablet_manager.cc:1403] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.011s
I20260709 13:09:59.185259 23401 leader_election.cc:304] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.186699 23644 raft_consensus.cc:2804] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.187181 23644 raft_consensus.cc:697] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:59.187120 23506 raft_consensus.cc:1275] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:59.181800 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:59.189227 23644 consensus_queue.cc:237] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.190205 23645 consensus_queue.cc:1048] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.188722 23357 raft_consensus.cc:3060] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.206068 23552 ts_tablet_manager.cc:1434] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:09:59.211592 23551 raft_consensus.cc:359] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.215329 23551 raft_consensus.cc:385] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.215628 23551 raft_consensus.cc:740] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.217228 23555 tablet_bootstrap.cc:654] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.218020 23551 consensus_queue.cc:260] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.223995 23552 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.225035 23635 consensus_queue.cc:1048] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.241879 23553 tablet_bootstrap.cc:654] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.244473 23357 raft_consensus.cc:2468] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:09:59.247350 23551 ts_tablet_manager.cc:1434] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.003s
I20260709 13:09:59.248384 23551 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:59.262358 23635 consensus_queue.cc:1048] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:59.263545 23184 catalog_manager.cc:5697] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.266356 23552 tablet_bootstrap.cc:654] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.273845 23671 raft_consensus.cc:493] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.274359 23671 raft_consensus.cc:515] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.276453 23671 leader_election.cc:290] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:59.278079 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:59.283407 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:09:59.284449 23400 leader_election.cc:343] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:59.285239 23399 leader_election.cc:343] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.263355 23644 consensus_queue.cc:1048] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:59.285709 23399 leader_election.cc:304] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.287261 23671 raft_consensus.cc:2749] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.293681 23555 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.294188 23555 ts_tablet_manager.cc:1403] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.007s
I20260709 13:09:59.294765 23671 consensus_queue.cc:1048] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.297181 23555 raft_consensus.cc:359] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.299283 23555 raft_consensus.cc:385] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.299582 23555 raft_consensus.cc:740] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.300513 23555 consensus_queue.cc:260] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.301569 23671 raft_consensus.cc:493] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.302057 23671 raft_consensus.cc:515] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.304394 23648 consensus_queue.cc:1048] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.305615 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:59.306077 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:09:59.307013 23399 leader_election.cc:343] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.307544 23671 leader_election.cc:290] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:09:59.307512 23400 leader_election.cc:343] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.310475 23400 leader_election.cc:304] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.311861 23555 ts_tablet_manager.cc:1434] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:09:59.318154 23553 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:59.316165 23671 raft_consensus.cc:2749] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.317193 23280 raft_consensus.cc:3060] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.338497 23553 ts_tablet_manager.cc:1403] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.180s	user 0.013s	sys 0.017s
I20260709 13:09:59.322606 23551 tablet_bootstrap.cc:654] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:59.322824 23473 consensus_peers.cc:597] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.343458 23650 raft_consensus.cc:493] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.343958 23650 raft_consensus.cc:515] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.323189 23555 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:59.324219 23552 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:59.345896 23552 ts_tablet_manager.cc:1403] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.009s
I20260709 13:09:59.326434 23184 catalog_manager.cc:5697] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.329924 23647 consensus_queue.cc:1048] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.348493 23647 consensus_queue.cc:1048] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.349473 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:59.350158 23506 raft_consensus.cc:2468] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:59.351625 23327 leader_election.cc:304] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:59.354051 23555 tablet_bootstrap.cc:654] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.356971 23645 raft_consensus.cc:493] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.345986 23650 leader_election.cc:290] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:59.355782 23553 raft_consensus.cc:359] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.358254 23553 raft_consensus.cc:385] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.357437 23552 raft_consensus.cc:359] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.358578 23553 raft_consensus.cc:740] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.358688 23552 raft_consensus.cc:385] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.359109 23552 raft_consensus.cc:740] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.359701 23552 consensus_queue.cc:260] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.357442 23645 raft_consensus.cc:515] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.357944 23650 raft_consensus.cc:2804] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.363348 23553 consensus_queue.cc:260] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.365689 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:59.364635 23650 raft_consensus.cc:493] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.373442 23552 ts_tablet_manager.cc:1434] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:59.364521 23645 leader_election.cc:290] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:59.373086 23559 raft_consensus.cc:493] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.375876 23559 raft_consensus.cc:515] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.376863 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846d941237a64689b8c0a9604d7635d9" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:59.377938 23559 leader_election.cc:290] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:59.378638 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846d941237a64689b8c0a9604d7635d9" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:59.379253 23506 raft_consensus.cc:2468] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:59.375178 23650 raft_consensus.cc:3060] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.384253 23399 leader_election.cc:343] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.384696 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5e3b8a31e54e7186eff3a07ae3dcae" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:59.385380 23506 raft_consensus.cc:2468] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:09:59.385895 23401 leader_election.cc:304] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:59.386860 23401 leader_election.cc:304] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:59.387495 23553 ts_tablet_manager.cc:1434] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
I20260709 13:09:59.387667 23671 raft_consensus.cc:2804] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.388052 23671 raft_consensus.cc:493] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.388358 23671 raft_consensus.cc:3060] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.392114 23645 raft_consensus.cc:2804] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.392500 23645 raft_consensus.cc:493] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.392817 23645 raft_consensus.cc:3060] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.399781 23552 tablet_bootstrap.cc:492] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.401109 23553 tablet_bootstrap.cc:492] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:59.405808 23671 raft_consensus.cc:515] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.414104 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846d941237a64689b8c0a9604d7635d9" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:59.414820 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846d941237a64689b8c0a9604d7635d9" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:59.415385 23506 raft_consensus.cc:3060] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.415624 23399 leader_election.cc:343] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.417806 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5e3b8a31e54e7186eff3a07ae3dcae" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:59.420933 23551 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:59.421422 23551 ts_tablet_manager.cc:1403] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.173s	user 0.022s	sys 0.021s
I20260709 13:09:59.425832 23645 raft_consensus.cc:515] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:09:59.399515 23326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.1:44223, user_credentials={real_user=slave}} blocked reactor thread for 52413.6us
I20260709 13:09:59.427129 23647 raft_consensus.cc:493] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.427414 23400 leader_election.cc:343] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.427646 23647 raft_consensus.cc:515] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:09:59.428351 23326 leader_election.cc:343] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:59.424609 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:59.422052 23506 raft_consensus.cc:2468] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:59.432391 23647 leader_election.cc:290] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:59.432895 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5348b6264474d048efc80da425fee14" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:09:59.433569 23281 raft_consensus.cc:2468] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:59.433614 23401 leader_election.cc:304] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:59.434502 23559 raft_consensus.cc:2804] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.413900 23671 leader_election.cc:290] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:59.434965 23559 raft_consensus.cc:697] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:59.434903 23551 raft_consensus.cc:359] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.435773 23551 raft_consensus.cc:385] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.436076 23551 raft_consensus.cc:740] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.436136 23559 consensus_queue.cc:237] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.436813 23551 consensus_queue.cc:260] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.439639 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5e3b8a31e54e7186eff3a07ae3dcae" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:59.440225 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5e3b8a31e54e7186eff3a07ae3dcae" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:59.440785 23506 raft_consensus.cc:3060] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.441004 23400 leader_election.cc:343] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.437227 23552 tablet_bootstrap.cc:654] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.442891 23551 ts_tablet_manager.cc:1434] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:09:59.447894 23645 leader_election.cc:290] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:59.448953 23551 tablet_bootstrap.cc:492] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:59.437156 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5348b6264474d048efc80da425fee14" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:59.452473 23434 raft_consensus.cc:2468] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:09:59.453136 23506 raft_consensus.cc:2468] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:09:59.453794 23324 leader_election.cc:304] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:09:59.454216 23401 leader_election.cc:304] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.454732 23647 raft_consensus.cc:2804] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.455118 23647 raft_consensus.cc:493] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.455310 23645 raft_consensus.cc:2804] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.455490 23647 raft_consensus.cc:3060] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.457808 23645 raft_consensus.cc:697] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:09:59.460999 23645 consensus_queue.cc:237] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.466550 23650 raft_consensus.cc:515] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.464416 23647 raft_consensus.cc:515] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.455336 23551 tablet_bootstrap.cc:654] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.469796 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5348b6264474d048efc80da425fee14" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:59.470366 23434 raft_consensus.cc:3060] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.474880 23647 leader_election.cc:290] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:59.485430 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5348b6264474d048efc80da425fee14" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:59.486048 23281 raft_consensus.cc:3060] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.487275 23553 tablet_bootstrap.cc:654] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.512697 23555 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.513162 23555 ts_tablet_manager.cc:1403] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.002s
I20260709 13:09:59.502525 23434 raft_consensus.cc:2468] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:09:59.514324 23281 raft_consensus.cc:2468] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:09:59.513262 23650 leader_election.cc:290] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:09:59.515782 23555 raft_consensus.cc:359] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.517705 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:09:59.518587 23506 raft_consensus.cc:3060] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.517753 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:59.516639 23326 leader_election.cc:304] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:09:59.517719 23555 raft_consensus.cc:385] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.531446 23555 raft_consensus.cc:740] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.532249 23555 consensus_queue.cc:260] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.534469 23555 ts_tablet_manager.cc:1434] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:09:59.535399 23555 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:59.536378 23506 raft_consensus.cc:2468] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
W20260709 13:09:59.523746 23326 leader_election.cc:343] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.537734 23327 leader_election.cc:304] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.538983 23647 raft_consensus.cc:2804] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.539498 23647 raft_consensus.cc:697] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:09:59.540589 23647 consensus_queue.cc:237] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.523944 23650 raft_consensus.cc:2804] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.544284 23650 raft_consensus.cc:697] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:09:59.545063 23650 consensus_queue.cc:237] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.555871 23555 tablet_bootstrap.cc:654] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.557354 23183 catalog_manager.cc:5697] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.559103 23552 tablet_bootstrap.cc:492] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:59.563146 23553 tablet_bootstrap.cc:492] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:59.568137 23552 ts_tablet_manager.cc:1403] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.171s	user 0.023s	sys 0.002s
I20260709 13:09:59.568205 23553 ts_tablet_manager.cc:1403] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.167s	user 0.009s	sys 0.009s
I20260709 13:09:59.568544 23184 catalog_manager.cc:5697] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.572088 23551 tablet_bootstrap.cc:492] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:59.572523 23551 ts_tablet_manager.cc:1403] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.004s
I20260709 13:09:59.573638 23552 raft_consensus.cc:359] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.574254 23552 raft_consensus.cc:385] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.574491 23552 raft_consensus.cc:740] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.574928 23551 raft_consensus.cc:359] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.575083 23552 consensus_queue.cc:260] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.575578 23551 raft_consensus.cc:385] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.575956 23551 raft_consensus.cc:740] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.576711 23551 consensus_queue.cc:260] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.579468 23553 raft_consensus.cc:359] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.580144 23553 raft_consensus.cc:385] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.580379 23553 raft_consensus.cc:740] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.581745 23553 consensus_queue.cc:260] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.586723 23552 ts_tablet_manager.cc:1434] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:59.587679 23552 tablet_bootstrap.cc:492] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.593411 23551 ts_tablet_manager.cc:1434] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:09:59.594422 23551 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:59.597965 23709 consensus_queue.cc:1048] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.599870 23551 tablet_bootstrap.cc:654] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.603994 23552 tablet_bootstrap.cc:654] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.609232 23553 ts_tablet_manager.cc:1434] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:09:59.610929 23553 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:59.611353 23183 catalog_manager.cc:5697] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.617677 23553 tablet_bootstrap.cc:654] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.618186 23552 tablet_bootstrap.cc:492] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:59.640862 23552 ts_tablet_manager.cc:1403] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 13:09:59.629807 23555 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.641438 23555 ts_tablet_manager.cc:1403] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.013s
I20260709 13:09:59.643392 23551 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:59.643524 23552 raft_consensus.cc:359] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.643873 23555 raft_consensus.cc:359] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.644287 23552 raft_consensus.cc:385] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.644498 23555 raft_consensus.cc:385] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.644587 23552 raft_consensus.cc:740] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.644852 23555 raft_consensus.cc:740] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.639644 23657 consensus_queue.cc:1048] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.623732 23182 catalog_manager.cc:5697] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.643908 23551 ts_tablet_manager.cc:1403] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.029s
I20260709 13:09:59.645444 23552 consensus_queue.cc:260] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.647655 23552 ts_tablet_manager.cc:1434] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:59.648631 23555 consensus_queue.cc:260] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.649601 23551 raft_consensus.cc:359] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.650269 23551 raft_consensus.cc:385] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.650403 23555 ts_tablet_manager.cc:1434] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:09:59.650578 23551 raft_consensus.cc:740] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.651582 23555 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:59.651419 23551 consensus_queue.cc:260] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.653575 23552 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.655642 23551 ts_tablet_manager.cc:1434] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:09:59.657270 23551 tablet_bootstrap.cc:492] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:59.661011 23555 tablet_bootstrap.cc:654] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.662046 23552 tablet_bootstrap.cc:654] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.665660 23636 raft_consensus.cc:493] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.666181 23636 raft_consensus.cc:515] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.668416 23636 leader_election.cc:290] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:59.669085 23551 tablet_bootstrap.cc:654] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.669823 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7494d11a71a4d9a93693fc53b5d2421" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:59.670980 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7494d11a71a4d9a93693fc53b5d2421" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:59.671581 23433 raft_consensus.cc:2468] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:59.673131 23472 leader_election.cc:304] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
W20260709 13:09:59.674364 23473 leader_election.cc:343] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.685251 23636 raft_consensus.cc:2804] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.685696 23636 raft_consensus.cc:493] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.686033 23636 raft_consensus.cc:3060] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.686954 23555 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.687485 23555 ts_tablet_manager.cc:1403] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.009s
I20260709 13:09:59.690340 23555 raft_consensus.cc:359] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.692073 23555 raft_consensus.cc:385] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.692389 23555 raft_consensus.cc:740] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.693102 23555 consensus_queue.cc:260] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.699733 23555 ts_tablet_manager.cc:1434] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:09:59.700695 23555 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:59.706357 23644 consensus_queue.cc:1048] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.710441 23555 tablet_bootstrap.cc:654] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.714835 23551 tablet_bootstrap.cc:492] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:59.715384 23551 ts_tablet_manager.cc:1403] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.000s
I20260709 13:09:59.705113 23636 raft_consensus.cc:515] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.717677 23739 raft_consensus.cc:493] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.718139 23739 raft_consensus.cc:515] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.720209 23636 leader_election.cc:290] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:59.723598 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7494d11a71a4d9a93693fc53b5d2421" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:59.723582 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7494d11a71a4d9a93693fc53b5d2421" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:59.724503 23739 leader_election.cc:290] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:09:59.724673 23433 raft_consensus.cc:3060] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.727200 23473 leader_election.cc:343] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.728582 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846d941237a64689b8c0a9604d7635d9" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:59.729342 23508 raft_consensus.cc:2393] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:09:59.727169 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846d941237a64689b8c0a9604d7635d9" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:59.730973 23551 raft_consensus.cc:359] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.747262 23551 raft_consensus.cc:385] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.732697 23324 leader_election.cc:304] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:59.735632 23433 raft_consensus.cc:2468] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:59.748059 23551 raft_consensus.cc:740] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.742296 23552 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:59.749136 23552 ts_tablet_manager.cc:1403] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.011s
I20260709 13:09:59.750062 23553 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:59.750521 23553 ts_tablet_manager.cc:1403] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.140s	user 0.026s	sys 0.013s
I20260709 13:09:59.751233 23551 consensus_queue.cc:260] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.750440 23739 raft_consensus.cc:3060] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.753628 23472 leader_election.cc:304] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:59.754400 23636 raft_consensus.cc:2804] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.756754 23552 raft_consensus.cc:359] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.757375 23552 raft_consensus.cc:385] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.757635 23552 raft_consensus.cc:740] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.757809 23636 raft_consensus.cc:697] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:59.757974 23657 raft_consensus.cc:493] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.758358 23552 consensus_queue.cc:260] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.758481 23657 raft_consensus.cc:515] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.758883 23553 raft_consensus.cc:359] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.758695 23636 consensus_queue.cc:237] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.759538 23553 raft_consensus.cc:385] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.759860 23553 raft_consensus.cc:740] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.760411 23552 ts_tablet_manager.cc:1434] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:59.761421 23552 tablet_bootstrap.cc:492] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.754092 23551 ts_tablet_manager.cc:1434] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:09:59.761829 23657 leader_election.cc:290] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:59.764914 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:09:59.766588 23250 leader_election.cc:343] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.767820 23551 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:59.768700 23555 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.769125 23555 ts_tablet_manager.cc:1403] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.016s
I20260709 13:09:59.769830 23553 consensus_queue.cc:260] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.770435 23280 raft_consensus.cc:3060] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.772197 23553 ts_tablet_manager.cc:1434] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:59.782303 23553 tablet_bootstrap.cc:492] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:59.782821 23552 tablet_bootstrap.cc:654] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.784299 23555 raft_consensus.cc:359] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.785249 23555 raft_consensus.cc:385] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.785506 23555 raft_consensus.cc:740] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.786211 23555 consensus_queue.cc:260] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.789805 23559 consensus_queue.cc:1048] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.794283 23739 raft_consensus.cc:2749] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.797202 23553 tablet_bootstrap.cc:654] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.800838 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:09:59.801750 23555 ts_tablet_manager.cc:1434] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:09:59.801510 23433 raft_consensus.cc:2468] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:09:59.805902 23555 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:59.807255 23249 leader_election.cc:304] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:59.809285 23657 raft_consensus.cc:2804] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.809629 23657 raft_consensus.cc:493] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.809937 23657 raft_consensus.cc:3060] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.814345 23551 tablet_bootstrap.cc:654] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.821640 23657 raft_consensus.cc:515] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.824450 23184 catalog_manager.cc:5697] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.826730 23709 raft_consensus.cc:493] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.832083 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:59.832098 23709 raft_consensus.cc:515] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:09:59.833648 23250 leader_election.cc:343] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.834339 23709 leader_election.cc:290] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:59.829946 23552 tablet_bootstrap.cc:492] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:59.835335 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:59.835570 23552 ts_tablet_manager.cc:1403] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.006s
I20260709 13:09:59.835876 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295ce00aba194098a6b6e3736a7c7b8d" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:09:59.837548 23502 raft_consensus.cc:2393] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:09:59.838801 23252 leader_election.cc:304] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:09:59.839474 23552 raft_consensus.cc:359] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.839959 23709 raft_consensus.cc:3060] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.840860 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:09:59.841408 23433 raft_consensus.cc:3060] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.842568 23657 leader_election.cc:290] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:09:59.845492 23552 raft_consensus.cc:385] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.845778 23552 raft_consensus.cc:740] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.846462 23552 consensus_queue.cc:260] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.852980 23433 raft_consensus.cc:2468] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:09:59.853578 23552 ts_tablet_manager.cc:1434] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:59.854300 23249 leader_election.cc:304] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:09:59.855461 23657 raft_consensus.cc:2804] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.856112 23657 raft_consensus.cc:697] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:09:59.856758 23553 tablet_bootstrap.cc:492] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:59.858680 23551 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:59.859131 23551 ts_tablet_manager.cc:1403] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.000s
I20260709 13:09:59.859376 23709 raft_consensus.cc:2749] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.856943 23657 consensus_queue.cc:237] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.860337 23555 tablet_bootstrap.cc:654] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.861089 23553 ts_tablet_manager.cc:1403] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.000s
I20260709 13:09:59.863095 23551 raft_consensus.cc:359] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.854580 23552 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.863668 23553 raft_consensus.cc:359] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.871672 23553 raft_consensus.cc:385] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.871956 23553 raft_consensus.cc:740] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.872581 23553 consensus_queue.cc:260] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.869553 23636 raft_consensus.cc:493] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.875291 23636 raft_consensus.cc:515] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.877380 23636 leader_election.cc:290] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:59.878841 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbe8c884d0146eab6e90a8245b86fe3" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:09:59.879480 23357 raft_consensus.cc:2468] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:09:59.880741 23473 leader_election.cc:304] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:09:59.881654 23636 raft_consensus.cc:2804] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.882061 23636 raft_consensus.cc:493] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.882421 23636 raft_consensus.cc:3060] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.882824 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbe8c884d0146eab6e90a8245b86fe3" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:09:59.884464 23474 leader_election.cc:343] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.886147 23553 ts_tablet_manager.cc:1434] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:59.887112 23553 tablet_bootstrap.cc:492] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:09:59.870590 23552 tablet_bootstrap.cc:654] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.863840 23551 raft_consensus.cc:385] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.891721 23182 catalog_manager.cc:5697] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.892515 23551 raft_consensus.cc:740] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.893203 23551 consensus_queue.cc:260] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:09:59.895475 23551 ts_tablet_manager.cc:1434] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:09:59.898289 23551 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:59.903577 23551 tablet_bootstrap.cc:654] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.906262 23636 raft_consensus.cc:515] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.910171 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbe8c884d0146eab6e90a8245b86fe3" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:09:59.910710 23555 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.910532 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbe8c884d0146eab6e90a8245b86fe3" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:09:59.911165 23357 raft_consensus.cc:3060] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.916052 23474 leader_election.cc:343] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.918548 23357 raft_consensus.cc:2468] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:09:59.919839 23555 ts_tablet_manager.cc:1403] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.000s
I20260709 13:09:59.920100 23473 leader_election.cc:304] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:09:59.922919 23555 raft_consensus.cc:359] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.922765 23669 raft_consensus.cc:2804] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.924355 23669 raft_consensus.cc:697] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:09:59.923998 23555 raft_consensus.cc:385] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.925154 23669 consensus_queue.cc:237] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.925851 23636 leader_election.cc:290] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:09:59.931010 23551 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:09:59.931558 23551 ts_tablet_manager.cc:1403] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:09:59.926875 23357 raft_consensus.cc:3060] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.927436 23552 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:09:59.933414 23645 consensus_queue.cc:1048] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.928974 23555 raft_consensus.cc:740] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.928668 23553 tablet_bootstrap.cc:654] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.934110 23552 ts_tablet_manager.cc:1403] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.080s	user 0.004s	sys 0.007s
I20260709 13:09:59.937382 23555 consensus_queue.cc:260] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.939759 23555 ts_tablet_manager.cc:1434] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:09:59.940719 23551 raft_consensus.cc:359] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.942319 23551 raft_consensus.cc:385] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.942634 23551 raft_consensus.cc:740] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.943307 23551 consensus_queue.cc:260] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.942028 23555 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:09:59.949195 23551 ts_tablet_manager.cc:1434] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:09:59.953894 23551 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:09:59.954811 23552 raft_consensus.cc:359] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.951704 23555 tablet_bootstrap.cc:654] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.955471 23552 raft_consensus.cc:385] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.955757 23552 raft_consensus.cc:740] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.961455 23551 tablet_bootstrap.cc:654] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.959206 23552 consensus_queue.cc:260] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:09:59.962563 23280 raft_consensus.cc:3060] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.970007 23552 ts_tablet_manager.cc:1434] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:09:59.971504 23739 consensus_queue.cc:1048] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.972345 23647 consensus_queue.cc:1048] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.974987 23552 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:09:59.979405 23671 consensus_queue.cc:1048] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.988683 23553 tablet_bootstrap.cc:492] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:09:59.989228 23553 ts_tablet_manager.cc:1403] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.000s
I20260709 13:09:59.989199 23552 tablet_bootstrap.cc:654] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.996853 23553 raft_consensus.cc:359] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:09:59.997215 23636 raft_consensus.cc:493] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.997509 23553 raft_consensus.cc:385] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.998059 23553 raft_consensus.cc:740] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.999281 23555 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:09:59.999101 23636 raft_consensus.cc:515] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:09:59.999877 23555 ts_tablet_manager.cc:1403] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 13:09:59.998553 23553 consensus_queue.cc:260] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.001219 23636 leader_election.cc:290] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.004129 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faeb76eaa46b49f398e91a6a3bbfacb1" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.004719 23553 ts_tablet_manager.cc:1434] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:00.005760 23553 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
W20260709 13:10:00.016649 23474 leader_election.cc:343] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.024399 23555 raft_consensus.cc:359] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.031036 23555 raft_consensus.cc:385] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.030083 23182 catalog_manager.cc:5697] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.034840 23555 raft_consensus.cc:740] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.035729 23555 consensus_queue.cc:260] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.033082 23553 tablet_bootstrap.cc:654] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.026994 23559 consensus_queue.cc:1048] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.025112 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faeb76eaa46b49f398e91a6a3bbfacb1" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.031728 23552 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:00.038674 23551 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:00.045192 23552 ts_tablet_manager.cc:1403] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.024s
I20260709 13:10:00.047853 23727 consensus_queue.cc:1048] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.047974 23552 raft_consensus.cc:359] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.048630 23552 raft_consensus.cc:385] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.048888 23552 raft_consensus.cc:740] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.049535 23552 consensus_queue.cc:260] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.050482 23644 raft_consensus.cc:493] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.051108 23552 ts_tablet_manager.cc:1434] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:10:00.050920 23644 raft_consensus.cc:515] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.052080 23552 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:00.047899 23671 consensus_queue.cc:1048] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:00.057811 23552 tablet_bootstrap.cc:654] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.060918 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22769b9fbe4642f185da6c9a4f36aa30" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.061578 23508 raft_consensus.cc:2468] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:10:00.063093 23401 leader_election.cc:304] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:00.063657 23644 leader_election.cc:290] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.064396 23559 raft_consensus.cc:2804] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.064848 23559 raft_consensus.cc:493] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.065276 23559 raft_consensus.cc:3060] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.071208 23669 raft_consensus.cc:493] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.071704 23669 raft_consensus.cc:515] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.074870 23669 leader_election.cc:290] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.081048 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22769b9fbe4642f185da6c9a4f36aa30" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:10:00.085340 23400 leader_election.cc:343] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:00.085693 23473 leader_election.cc:343] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.086181 23473 leader_election.cc:304] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.087205 23669 raft_consensus.cc:2749] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.087481 23552 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:00.097906 23552 ts_tablet_manager.cc:1403] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.005s
I20260709 13:10:00.099413 23555 ts_tablet_manager.cc:1434] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.006s
I20260709 13:10:00.100486 23555 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:00.100749 23552 raft_consensus.cc:359] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.101578 23552 raft_consensus.cc:385] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.101850 23552 raft_consensus.cc:740] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.101019 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.102571 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.102495 23552 consensus_queue.cc:260] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:00.103343 23474 leader_election.cc:343] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.104143 23552 ts_tablet_manager.cc:1434] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:00.104156 23647 consensus_queue.cc:1048] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.105821 23552 tablet_bootstrap.cc:492] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
W20260709 13:10:00.106137 23473 leader_election.cc:343] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.106616 23473 leader_election.cc:304] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.109863 23669 raft_consensus.cc:2749] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.111259 23559 raft_consensus.cc:515] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.112440 23551 ts_tablet_manager.cc:1403] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.159s	user 0.010s	sys 0.019s
I20260709 13:10:00.118885 23552 tablet_bootstrap.cc:654] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.136379 23645 raft_consensus.cc:493] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.138134 23555 tablet_bootstrap.cc:654] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.141726 23551 raft_consensus.cc:359] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.142711 23551 raft_consensus.cc:385] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.142982 23551 raft_consensus.cc:740] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.136487 23559 leader_election.cc:290] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.146349 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22769b9fbe4642f185da6c9a4f36aa30" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:00.136935 23645 raft_consensus.cc:515] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.148867 23508 raft_consensus.cc:3060] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.149228 23671 raft_consensus.cc:493] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.150079 23671 raft_consensus.cc:515] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.151132 23645 leader_election.cc:290] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.149341 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22769b9fbe4642f185da6c9a4f36aa30" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:00.153170 23671 leader_election.cc:290] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.143620 23551 consensus_queue.cc:260] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:00.159714 23400 leader_election.cc:343] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.160041 23551 ts_tablet_manager.cc:1434] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:10:00.159554 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7300cd12cfb435b920f7079d2605e20" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.159986 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.160746 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.161180 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7300cd12cfb435b920f7079d2605e20" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.160547 23503 raft_consensus.cc:2468] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:10:00.159957 23647 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:10:00.162676 23551 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:00.162724 23647 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
W20260709 13:10:00.167706 23399 leader_election.cc:343] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:00.162278 23401 leader_election.cc:343] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:00.171281 23400 leader_election.cc:343] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.171687 23400 leader_election.cc:304] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:00.172580 23552 tablet_bootstrap.cc:492] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:00.173427 23647 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.174013 23671 raft_consensus.cc:2749] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.174492 23509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.175086 23509 raft_consensus.cc:2468] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:10:00.175107 23553 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:00.175644 23552 ts_tablet_manager.cc:1403] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.004s
I20260709 13:10:00.175943 23553 ts_tablet_manager.cc:1403] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.170s	user 0.018s	sys 0.009s
I20260709 13:10:00.183184 23327 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:00.186367 23647 raft_consensus.cc:2804] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.188292 23647 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:10:00.188644 23647 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.190562 23552 raft_consensus.cc:359] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.191234 23552 raft_consensus.cc:385] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.191500 23552 raft_consensus.cc:740] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.192175 23552 consensus_queue.cc:260] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.193153 23508 raft_consensus.cc:2468] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:10:00.200453 23552 ts_tablet_manager.cc:1434] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:10:00.196463 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:00.200408 23553 raft_consensus.cc:359] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.207718 23553 raft_consensus.cc:385] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.208031 23553 raft_consensus.cc:740] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.208664 23553 consensus_queue.cc:260] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.210611 23553 ts_tablet_manager.cc:1434] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.000s
I20260709 13:10:00.211521 23553 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:00.201817 23552 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:00.212965 23356 raft_consensus.cc:3060] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.205451 23551 tablet_bootstrap.cc:654] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.207041 23401 leader_election.cc:304] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:00.219545 23433 raft_consensus.cc:2393] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 2: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:10:00.219781 23559 raft_consensus.cc:2804] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.223976 23559 raft_consensus.cc:493] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.226071 23559 raft_consensus.cc:3060] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.239393 23553 tablet_bootstrap.cc:654] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.241403 23401 leader_election.cc:304] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.243026 23645 raft_consensus.cc:2804] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.243541 23645 raft_consensus.cc:697] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:00.244522 23552 tablet_bootstrap.cc:654] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.244349 23645 consensus_queue.cc:237] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.242812 23669 consensus_queue.cc:1048] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.251075 23650 raft_consensus.cc:493] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.251499 23650 raft_consensus.cc:515] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.246474 23559 raft_consensus.cc:515] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.253404 23650 leader_election.cc:290] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:00.254451 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.256660 23559 leader_election.cc:290] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.258836 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7300cd12cfb435b920f7079d2605e20" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:00.259233 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7300cd12cfb435b920f7079d2605e20" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:00.261142 23506 raft_consensus.cc:3060] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.260233 23360 raft_consensus.cc:3060] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.278676 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:00.279490 23433 raft_consensus.cc:2393] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e56d4fa89a4e41fb99476c088544e8b8 in this term.
I20260709 13:10:00.281751 23644 raft_consensus.cc:493] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.282267 23644 raft_consensus.cc:515] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.284647 23644 leader_election.cc:290] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.286720 23506 raft_consensus.cc:2468] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
W20260709 13:10:00.287525 23399 leader_election.cc:343] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.289510 23552 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:00.289976 23552 ts_tablet_manager.cc:1403] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.088s	user 0.002s	sys 0.009s
I20260709 13:10:00.290004 23555 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:00.290304 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075558731b7c4293accc5598016e108e" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.290555 23555 ts_tablet_manager.cc:1403] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.023s
I20260709 13:10:00.292893 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075558731b7c4293accc5598016e108e" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.293121 23555 raft_consensus.cc:359] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.293792 23555 raft_consensus.cc:385] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.294029 23555 raft_consensus.cc:740] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.294560 23324 leader_election.cc:304] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.294657 23555 consensus_queue.cc:260] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.297778 23555 ts_tablet_manager.cc:1434] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 13:10:00.300197 23401 leader_election.cc:343] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.300411 23709 consensus_queue.cc:1048] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.300765 23636 consensus_queue.cc:1048] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.301677 23657 consensus_queue.cc:1048] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.298820 23739 raft_consensus.cc:2749] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.307173 23552 raft_consensus.cc:359] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.307639 23552 raft_consensus.cc:385] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.307833 23552 raft_consensus.cc:740] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.309132 23555 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:00.304215 23559 raft_consensus.cc:493] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.309114 23657 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:10:00.310612 23553 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:00.309631 23551 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:00.308382 23552 consensus_queue.cc:260] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.312980 23551 ts_tablet_manager.cc:1403] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.006s
I20260709 13:10:00.312952 23553 ts_tablet_manager.cc:1403] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.014s
W20260709 13:10:00.301690 23399 leader_election.cc:343] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.320914 23552 ts_tablet_manager.cc:1434] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:10:00.323172 23552 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:00.311324 23559 raft_consensus.cc:515] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.329720 23551 raft_consensus.cc:359] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.330438 23551 raft_consensus.cc:385] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.330705 23551 raft_consensus.cc:740] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.322005 23399 leader_election.cc:304] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:00.319180 23657 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.335363 23657 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.337199 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.337963 23357 raft_consensus.cc:2393] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 3: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:10:00.339123 23401 leader_election.cc:304] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:00.339715 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.340339 23508 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 3.
I20260709 13:10:00.341524 23252 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:00.343130 23657 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:00.344216 23559 leader_election.cc:290] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.345355 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cb1e511f734cf3b2669918cf9efbc7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.345985 23280 raft_consensus.cc:2468] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 0.
I20260709 13:10:00.311556 23647 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.347312 23400 leader_election.cc:304] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:00.331301 23551 consensus_queue.cc:260] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.344839 23657 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e971a25f8dfb42fcb1afb9ecf74f760d)
I20260709 13:10:00.358657 23551 ts_tablet_manager.cc:1434] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:10:00.349076 23647 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.356930 23709 raft_consensus.cc:493] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.359403 23657 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.368017 23671 raft_consensus.cc:2804] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.360008 23559 raft_consensus.cc:2804] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.370661 23551 tablet_bootstrap.cc:492] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:00.362216 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:00.374202 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:00.374928 23435 raft_consensus.cc:2393] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 2: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:10:00.371968 23671 raft_consensus.cc:493] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.377158 23671 raft_consensus.cc:3060] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.377358 23555 tablet_bootstrap.cc:654] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.386576 23635 consensus_queue.cc:1048] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.386137 23552 tablet_bootstrap.cc:654] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.387261 23657 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.373096 23645 raft_consensus.cc:2749] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.408684 23636 raft_consensus.cc:493] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.409260 23636 raft_consensus.cc:515] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.411347 23636 leader_election.cc:290] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.412922 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dd509182394fe29d31851c23847034" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.413975 23553 raft_consensus.cc:359] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:00.414651 23474 leader_election.cc:343] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.414716 23553 raft_consensus.cc:385] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.415745 23553 raft_consensus.cc:740] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.416505 23553 consensus_queue.cc:260] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:00.421861 23780 log.cc:927] Time spent T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:10:00.422655 23553 ts_tablet_manager.cc:1434] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 13:10:00.432698 23553 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:00.433045 23657 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.433566 23508 raft_consensus.cc:2468] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:10:00.434026 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:00.372958 23709 raft_consensus.cc:515] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.435402 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:00.440054 23671 raft_consensus.cc:515] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.462298 23551 tablet_bootstrap.cc:654] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.458567 23647 raft_consensus.cc:493] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.457159 23559 raft_consensus.cc:697] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:00.464936 23327 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5
I20260709 13:10:00.471946 23739 raft_consensus.cc:2804] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.472417 23739 raft_consensus.cc:697] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:00.473351 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbe8c884d0146eab6e90a8245b86fe3" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.473201 23739 consensus_queue.cc:237] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.475710 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbe8c884d0146eab6e90a8245b86fe3" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.477304 23250 leader_election.cc:304] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:00.471698 23709 leader_election.cc:290] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.467499 23280 raft_consensus.cc:3060] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.486656 23358 raft_consensus.cc:2393] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 3: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:10:00.488489 23671 leader_election.cc:290] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.489193 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cb1e511f734cf3b2669918cf9efbc7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:00.489807 23283 raft_consensus.cc:3060] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:00.457706 23399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:43361, user_credentials={real_user=slave}} blocked reactor thread for 156049us
I20260709 13:10:00.495440 23553 tablet_bootstrap.cc:654] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.518020 23432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dd509182394fe29d31851c23847034" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:00.523608 23432 raft_consensus.cc:2468] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:00.495920 23647 raft_consensus.cc:515] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.527509 23647 leader_election.cc:290] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:00.528791 23472 leader_election.cc:304] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.533859 23786 raft_consensus.cc:493] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.534379 23784 raft_consensus.cc:2804] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.534305 23786 raft_consensus.cc:515] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.534790 23784 raft_consensus.cc:493] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.535140 23784 raft_consensus.cc:3060] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.528910 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.536428 23786 leader_election.cc:290] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.537060 23635 raft_consensus.cc:493] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.537500 23635 raft_consensus.cc:515] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.529582 23657 raft_consensus.cc:2749] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.539564 23635 leader_election.cc:290] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.543020 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:00.543694 23431 raft_consensus.cc:2468] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:00.544960 23472 leader_election.cc:304] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:00.545797 23635 raft_consensus.cc:2804] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.546182 23635 raft_consensus.cc:493] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.546559 23635 raft_consensus.cc:3060] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.530634 23432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:00.550165 23432 raft_consensus.cc:2468] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:00.524688 23559 consensus_queue.cc:237] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.532088 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cb1e511f734cf3b2669918cf9efbc7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:00.500353 23283 raft_consensus.cc:2468] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:10:00.533219 23555 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:00.549567 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.556761 23555 ts_tablet_manager.cc:1403] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.252s	user 0.031s	sys 0.026s
W20260709 13:10:00.552063 23326 leader_election.cc:343] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:00.559711 23399 leader_election.cc:343] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:00.560416 23399 leader_election.cc:343] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.560738 23324 leader_election.cc:304] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.561949 23647 raft_consensus.cc:2804] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.562316 23647 raft_consensus.cc:493] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.562641 23647 raft_consensus.cc:3060] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.540741 23506 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 3.
I20260709 13:10:00.532863 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cb1e511f734cf3b2669918cf9efbc7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.559340 23555 raft_consensus.cc:359] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.572017 23555 raft_consensus.cc:385] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.572333 23555 raft_consensus.cc:740] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.575249 23555 consensus_queue.cc:260] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.580838 23635 raft_consensus.cc:515] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.583280 23252 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:00.583683 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
W20260709 13:10:00.584134 23399 leader_election.cc:343] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.584278 23434 raft_consensus.cc:3060] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.590265 23784 raft_consensus.cc:515] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.587230 23647 raft_consensus.cc:515] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.592120 23182 catalog_manager.cc:5697] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.595506 23555 ts_tablet_manager.cc:1434] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:10:00.598325 23793 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.598843 23793 raft_consensus.cc:697] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:00.599622 23793 consensus_queue.cc:237] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.600327 23552 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:00.600785 23552 ts_tablet_manager.cc:1403] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.279s	user 0.014s	sys 0.006s
I20260709 13:10:00.604372 23555 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:00.597303 23727 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.606981 23552 raft_consensus.cc:359] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.612279 23552 raft_consensus.cc:385] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.612497 23552 raft_consensus.cc:740] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.613829 23552 consensus_queue.cc:260] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.607638 23635 leader_election.cc:290] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.616529 23434 raft_consensus.cc:2468] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:00.626822 23559 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.627463 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dd509182394fe29d31851c23847034" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:00.627327 23559 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.628079 23433 raft_consensus.cc:3060] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.634392 23552 ts_tablet_manager.cc:1434] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 13:10:00.635474 23552 tablet_bootstrap.cc:492] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:00.615947 23727 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.626718 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.640874 23551 tablet_bootstrap.cc:492] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:00.641278 23551 ts_tablet_manager.cc:1403] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.271s	user 0.023s	sys 0.015s
I20260709 13:10:00.633780 23784 leader_election.cc:290] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.647161 23472 leader_election.cc:304] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:00.652247 23669 raft_consensus.cc:2804] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.652702 23669 raft_consensus.cc:697] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:00.653403 23669 consensus_queue.cc:237] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.655836 23636 consensus_queue.cc:1048] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.661748 23553 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:00.662242 23553 ts_tablet_manager.cc:1403] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.230s	user 0.034s	sys 0.017s
I20260709 13:10:00.667335 23553 raft_consensus.cc:359] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.668002 23553 raft_consensus.cc:385] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.668339 23553 raft_consensus.cc:740] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.670361 23553 consensus_queue.cc:260] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.670693 23671 raft_consensus.cc:493] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.671075 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.671691 23508 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 3.
I20260709 13:10:00.672721 23327 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
W20260709 13:10:00.673094 23474 leader_election.cc:343] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.673507 23650 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:00.673887 23650 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.674212 23650 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.671222 23671 raft_consensus.cc:515] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.676801 23400 leader_election.cc:304] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:00.678309 23789 raft_consensus.cc:2804] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.678792 23789 raft_consensus.cc:697] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:00.679814 23789 consensus_queue.cc:237] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.681474 23650 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.682369 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.684154 23553 ts_tablet_manager.cc:1434] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:10:00.685144 23553 tablet_bootstrap.cc:492] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:00.685782 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:00.686345 23508 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.667591 23727 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.690212 23650 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 4 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:00.691480 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dd509182394fe29d31851c23847034" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:00.691591 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:10:00.692843 23399 leader_election.cc:343] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.685071 23555 tablet_bootstrap.cc:654] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.697466 23552 tablet_bootstrap.cc:654] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.700033 23671 leader_election.cc:290] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.704131 23559 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.706652 23553 tablet_bootstrap.cc:654] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.708112 23181 catalog_manager.cc:5697] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.667655 23647 leader_election.cc:290] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:10:00.721812 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:00.726186 23551 raft_consensus.cc:359] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.726909 23551 raft_consensus.cc:385] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.727164 23551 raft_consensus.cc:740] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.727998 23551 consensus_queue.cc:260] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.737346 23551 ts_tablet_manager.cc:1434] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.000s
I20260709 13:10:00.723127 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:00.731364 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:00.749569 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:10:00.738821 23400 leader_election.cc:343] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.753237 23552 tablet_bootstrap.cc:492] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:00.753818 23552 ts_tablet_manager.cc:1403] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.004s
I20260709 13:10:00.738632 23654 raft_consensus.cc:493] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.743952 23474 leader_election.cc:343] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.756470 23654 raft_consensus.cc:515] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.758435 23654 leader_election.cc:290] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.752197 23434 raft_consensus.cc:3060] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.758775 23184 catalog_manager.cc:5697] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 2 to 3, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 3 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.762784 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.763429 23356 raft_consensus.cc:2468] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:00.764560 23250 leader_election.cc:304] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:00.755920 23400 leader_election.cc:304] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.755765 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.766156 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.766726 23503 raft_consensus.cc:2468] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:00.765322 23555 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:00.768544 23555 ts_tablet_manager.cc:1403] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.164s	user 0.021s	sys 0.002s
I20260709 13:10:00.770599 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.771227 23503 raft_consensus.cc:2468] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
W20260709 13:10:00.772512 23401 leader_election.cc:343] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.772995 23401 leader_election.cc:304] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:00.774914 23433 raft_consensus.cc:2468] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:00.775110 23559 raft_consensus.cc:2749] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.775389 23401 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:00.768489 23787 raft_consensus.cc:2749] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.777107 23787 raft_consensus.cc:2804] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:00.771240 23555 raft_consensus.cc:359] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.772941 23508 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 4.
I20260709 13:10:00.777431 23787 raft_consensus.cc:493] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.777829 23787 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.778595 23327 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:00.776228 23551 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:00.779987 23647 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:00.780404 23647 raft_consensus.cc:697] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:00.780843 23434 raft_consensus.cc:2468] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:00.781662 23555 raft_consensus.cc:385] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.781963 23555 raft_consensus.cc:740] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.782586 23555 consensus_queue.cc:260] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.782948 23324 leader_election.cc:304] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:00.783816 23650 raft_consensus.cc:2804] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.784252 23650 raft_consensus.cc:697] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:00.784729 23555 ts_tablet_manager.cc:1434] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:10:00.785653 23555 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:00.784986 23183 catalog_manager.cc:5697] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.784987 23650 consensus_queue.cc:237] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.778946 23552 raft_consensus.cc:359] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.788386 23552 raft_consensus.cc:385] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.765342 23654 raft_consensus.cc:2804] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.788710 23552 raft_consensus.cc:740] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
W20260709 13:10:00.791807 23474 leader_election.cc:343] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.789223 23654 raft_consensus.cc:493] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.792395 23654 raft_consensus.cc:3060] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.781177 23647 consensus_queue.cc:237] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:10:00.800354 23801 log.cc:927] Time spent T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:00.801008 23552 consensus_queue.cc:260] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.803354 23552 ts_tablet_manager.cc:1434] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
I20260709 13:10:00.804227 23552 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:00.805001 23654 raft_consensus.cc:515] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.807757 23553 tablet_bootstrap.cc:492] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:00.807812 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:00.808322 23553 ts_tablet_manager.cc:1403] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.123s	user 0.031s	sys 0.005s
I20260709 13:10:00.808498 23508 raft_consensus.cc:3060] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.809388 23555 tablet_bootstrap.cc:654] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.809563 23551 tablet_bootstrap.cc:654] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.816344 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.817857 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:00.819048 23552 tablet_bootstrap.cc:654] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.825176 23553 raft_consensus.cc:359] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.825834 23553 raft_consensus.cc:385] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.826081 23553 raft_consensus.cc:740] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.826877 23553 consensus_queue.cc:260] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.829201 23802 raft_consensus.cc:493] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.829772 23802 raft_consensus.cc:515] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.832253 23472 leader_election.cc:304] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.833758 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7300cd12cfb435b920f7079d2605e20" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:00.834484 23503 raft_consensus.cc:2393] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate 5e2983c2051a44788d4064010321c7f5 in this term.
I20260709 13:10:00.835243 23669 raft_consensus.cc:2804] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.835094 23787 raft_consensus.cc:515] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.835844 23669 raft_consensus.cc:697] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:00.836897 23553 ts_tablet_manager.cc:1434] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:00.836781 23669 consensus_queue.cc:237] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:00.838052 23553 tablet_bootstrap.cc:492] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:00.840616 23283 raft_consensus.cc:3060] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.842185 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7300cd12cfb435b920f7079d2605e20" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:00.843482 23324 leader_election.cc:304] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:00.834400 23789 raft_consensus.cc:493] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.844336 23727 raft_consensus.cc:3060] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.844254 23789 raft_consensus.cc:515] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.846400 23789 leader_election.cc:290] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.846611 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:00.847486 23280 raft_consensus.cc:3060] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.848662 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:10:00.850256 23399 leader_election.cc:343] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.852241 23727 raft_consensus.cc:2749] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.835886 23802 leader_election.cc:290] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.857861 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:00.859170 23553 tablet_bootstrap.cc:654] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:00.859067 23400 leader_election.cc:343] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.859584 23400 leader_election.cc:304] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:00.864086 23559 raft_consensus.cc:2749] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.863090 23182 catalog_manager.cc:5697] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.883108 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:00.883769 23503 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.867594 23789 consensus_queue.cc:1048] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:10:00.872737 23182 catalog_manager.cc:5697] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.904932 23552 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:00.905416 23552 ts_tablet_manager.cc:1403] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.043s
I20260709 13:10:00.905912 23551 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:00.906491 23551 ts_tablet_manager.cc:1403] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.001s
I20260709 13:10:00.908382 23789 raft_consensus.cc:493] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.902441 23508 raft_consensus.cc:2468] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:10:00.905385 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:00.909538 23280 raft_consensus.cc:2468] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:00.909646 23360 raft_consensus.cc:3060] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.909806 23252 leader_election.cc:304] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:00.910132 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524a9d5200604a8183ccae982b284bac" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:00.911062 23808 raft_consensus.cc:2804] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.893685 23559 consensus_queue.cc:1048] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:10:00.911577 23808 raft_consensus.cc:697] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:00.912602 23808 consensus_queue.cc:237] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.908847 23789 raft_consensus.cc:515] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.915175 23789 leader_election.cc:290] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:00.916512 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
W20260709 13:10:00.918349 23401 leader_election.cc:343] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.919237 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:00.890923 23787 leader_election.cc:290] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 3 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
W20260709 13:10:00.922317 23399 leader_election.cc:343] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.900727 23654 leader_election.cc:290] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:00.934684 23399 leader_election.cc:304] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:00.936605 23555 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:00.937162 23555 ts_tablet_manager.cc:1403] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.004s
I20260709 13:10:00.939975 23555 raft_consensus.cc:359] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.940740 23787 raft_consensus.cc:2749] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.943773 23551 raft_consensus.cc:359] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.957515 23555 raft_consensus.cc:385] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.958160 23555 raft_consensus.cc:740] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.957341 23551 raft_consensus.cc:385] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.958809 23551 raft_consensus.cc:740] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.931006 23360 raft_consensus.cc:2468] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:10:00.930845 23503 raft_consensus.cc:2468] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 3.
I20260709 13:10:00.956290 23184 catalog_manager.cc:5697] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 3 to 4, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 4 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.959880 23552 raft_consensus.cc:359] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.960573 23552 raft_consensus.cc:385] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.960825 23552 raft_consensus.cc:740] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.963347 23555 consensus_queue.cc:260] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.967567 23184 catalog_manager.cc:5697] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.978164 23401 leader_election.cc:304] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:00.979094 23502 raft_consensus.cc:1240] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Rejecting Update request from peer 690e3a11be554a93b36ec5017ed89787 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.981344 23671 raft_consensus.cc:2804] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.981825 23671 raft_consensus.cc:697] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 3 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:00.982530 23802 consensus_queue.cc:1059] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.962674 23551 consensus_queue.cc:260] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:00.985698 23555 ts_tablet_manager.cc:1434] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:10:00.988212 23552 consensus_queue.cc:260] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:00.992754 23555 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:00.987974 23802 raft_consensus.cc:3055] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.995038 23551 ts_tablet_manager.cc:1434] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:10:00.997881 23551 tablet_bootstrap.cc:492] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:00.989928 23671 consensus_queue.cc:237] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:00.999585 23552 ts_tablet_manager.cc:1434] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.001s
I20260709 13:10:01.000927 23552 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:00.995474 23802 raft_consensus.cc:740] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:01.002617 23802 consensus_queue.cc:260] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.005296 23802 raft_consensus.cc:3060] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.007227 23785 consensus_queue.cc:1048] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.009025 23552 tablet_bootstrap.cc:654] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.021693 23182 catalog_manager.cc:5697] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.027994 23551 tablet_bootstrap.cc:654] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.028946 23553 tablet_bootstrap.cc:492] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.029428 23553 ts_tablet_manager.cc:1403] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.192s	user 0.039s	sys 0.028s
I20260709 13:10:01.035868 23553 raft_consensus.cc:359] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.036490 23553 raft_consensus.cc:385] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.036747 23553 raft_consensus.cc:740] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.037770 23784 raft_consensus.cc:493] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.038319 23784 raft_consensus.cc:515] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.042977 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075558731b7c4293accc5598016e108e" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.044967 23506 raft_consensus.cc:1240] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 4 FOLLOWER]: Rejecting Update request from peer e56d4fa89a4e41fb99476c088544e8b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:01.045534 23784 leader_election.cc:290] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:01.037401 23553 consensus_queue.cc:260] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.051853 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075558731b7c4293accc5598016e108e" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:01.052999 23553 ts_tablet_manager.cc:1434] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:10:01.048725 23360 raft_consensus.cc:2468] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:01.055061 23808 consensus_queue.cc:1059] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.055940 23434 raft_consensus.cc:2468] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:01.056617 23808 raft_consensus.cc:3055] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:01.056967 23808 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:01.057715 23808 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.058845 23808 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.060331 23553 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.061525 23473 leader_election.cc:304] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:01.062238 23784 raft_consensus.cc:2804] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.062588 23784 raft_consensus.cc:493] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.062835 23784 raft_consensus.cc:3060] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.066195 23553 tablet_bootstrap.cc:654] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.067291 23555 tablet_bootstrap.cc:654] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:01.073817 23399 consensus_peers.cc:597] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.076645 23181 catalog_manager.cc:5697] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 2 to 3, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.082124 23784 raft_consensus.cc:515] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.077745 23184 catalog_manager.cc:5697] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:01.094055 23474 consensus_peers.cc:597] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.104060 23789 consensus_queue.cc:1048] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.107492 23552 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:01.108003 23552 ts_tablet_manager.cc:1403] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.107s	user 0.032s	sys 0.003s
I20260709 13:10:01.112293 23635 consensus_queue.cc:1048] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.111452 23552 raft_consensus.cc:359] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.117596 23552 raft_consensus.cc:385] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.117897 23552 raft_consensus.cc:740] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.118556 23552 consensus_queue.cc:260] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.125198 23784 leader_election.cc:290] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:01.137619 23552 ts_tablet_manager.cc:1434] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:10:01.138675 23552 tablet_bootstrap.cc:492] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:01.130014 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075558731b7c4293accc5598016e108e" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:01.145864 23433 raft_consensus.cc:3060] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.154145 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075558731b7c4293accc5598016e108e" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:01.153892 23671 consensus_queue.cc:1048] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:01.155165 23356 raft_consensus.cc:3060] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.159384 23433 raft_consensus.cc:2468] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:01.160543 23472 leader_election.cc:304] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:01.161346 23635 raft_consensus.cc:2804] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.161809 23635 raft_consensus.cc:697] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:01.162591 23635 consensus_queue.cc:237] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.167734 23657 raft_consensus.cc:493] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.169512 23657 raft_consensus.cc:515] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.171478 23657 leader_election.cc:290] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:01.178129 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.186776 23789 raft_consensus.cc:493] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.188408 23250 leader_election.cc:343] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.191314 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:01.196940 23789 raft_consensus.cc:515] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.203691 23283 raft_consensus.cc:1275] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:01.204118 23283 pending_rounds.cc:85] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Aborting all ops after (but not including) 1
I20260709 13:10:01.204348 23283 pending_rounds.cc:107] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:01.204600 23283 raft_consensus.cc:2889] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.204901 23553 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.205361 23553 ts_tablet_manager.cc:1403] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.013s
I20260709 13:10:01.206460 23647 consensus_queue.cc:1048] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.206884 23789 leader_election.cc:290] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:01.208063 23553 raft_consensus.cc:359] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.208714 23553 raft_consensus.cc:385] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.208977 23553 raft_consensus.cc:740] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.209244 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:01.209584 23553 consensus_queue.cc:260] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.204530 23551 tablet_bootstrap.cc:492] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:01.211843 23551 ts_tablet_manager.cc:1403] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.018s
I20260709 13:10:01.212987 23553 ts_tablet_manager.cc:1434] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:01.213920 23553 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.214082 23559 raft_consensus.cc:493] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.204842 23555 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:01.214821 23555 ts_tablet_manager.cc:1403] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.222s	user 0.008s	sys 0.006s
I20260709 13:10:01.214571 23559 raft_consensus.cc:515] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.214592 23551 raft_consensus.cc:359] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.216760 23551 raft_consensus.cc:385] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.217049 23551 raft_consensus.cc:740] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.216059 23433 raft_consensus.cc:2468] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:01.218680 23551 consensus_queue.cc:260] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.221561 23559 leader_election.cc:290] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:01.221792 23551 ts_tablet_manager.cc:1434] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:10:01.222949 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.223542 23555 raft_consensus.cc:359] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.224205 23555 raft_consensus.cc:385] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.224447 23555 raft_consensus.cc:740] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.225847 23356 raft_consensus.cc:2468] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
W20260709 13:10:01.227324 23401 leader_election.cc:343] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.228485 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:01.229689 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:10:01.232235 23400 leader_election.cc:343] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.231755 23184 catalog_manager.cc:5697] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.232695 23400 leader_election.cc:304] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
W20260709 13:10:01.234071 23400 leader_election.cc:343] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.234469 23553 tablet_bootstrap.cc:654] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:01.234865 23399 leader_election.cc:343] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.235113 23671 raft_consensus.cc:2749] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.236191 23399 leader_election.cc:304] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:01.236955 23789 raft_consensus.cc:2749] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.244666 23555 consensus_queue.cc:260] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.248564 23551 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:01.250029 23636 raft_consensus.cc:493] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.250500 23636 raft_consensus.cc:515] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.252646 23636 leader_election.cc:290] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:01.256132 23555 ts_tablet_manager.cc:1434] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:10:01.254063 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.263690 23555 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:01.264307 23249 leader_election.cc:304] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787
W20260709 13:10:01.269285 23473 leader_election.cc:343] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.274971 23657 raft_consensus.cc:2804] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.275342 23657 raft_consensus.cc:493] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.275705 23657 raft_consensus.cc:3060] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.278472 23506 raft_consensus.cc:1275] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 4 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:01.278977 23553 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.279508 23553 ts_tablet_manager.cc:1403] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.013s
I20260709 13:10:01.283535 23552 tablet_bootstrap.cc:654] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.279716 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:01.284381 23433 raft_consensus.cc:2468] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:01.285423 23472 leader_election.cc:304] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:01.286655 23669 raft_consensus.cc:2804] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.287014 23669 raft_consensus.cc:493] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.287315 23669 raft_consensus.cc:3060] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.282228 23802 consensus_queue.cc:1048] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:10:01.299510 23808 raft_consensus.cc:493] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.300029 23808 raft_consensus.cc:515] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.301951 23808 leader_election.cc:290] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:01.303165 23553 raft_consensus.cc:359] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.303848 23553 raft_consensus.cc:385] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.304958 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:01.307014 23555 tablet_bootstrap.cc:654] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.304106 23553 raft_consensus.cc:740] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.307729 23553 consensus_queue.cc:260] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.314227 23551 tablet_bootstrap.cc:654] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.330845 23553 ts_tablet_manager.cc:1434] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:10:01.332482 23553 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.310683 23647 consensus_queue.cc:1048] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:10:01.334056 23802 consensus_queue.cc:1048] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.337479 23669 raft_consensus.cc:515] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.338377 23657 raft_consensus.cc:515] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.342635 23635 raft_consensus.cc:493] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.348274 23635 raft_consensus.cc:515] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.355392 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9c9fb771764a4bb12fbf71035e081b" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:01.355611 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5153ef78cf4bf89ae5eb12f0f475b4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:01.356040 23657 leader_election.cc:290] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:10:01.363987 23474 leader_election.cc:343] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.365506 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:01.363018 23635 leader_election.cc:290] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:01.366621 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5153ef78cf4bf89ae5eb12f0f475b4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.367244 23358 raft_consensus.cc:2468] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:01.367400 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:01.367978 23433 raft_consensus.cc:3060] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:01.368695 23250 leader_election.cc:343] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:01.369035 23474 consensus_peers.cc:597] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.366658 23552 tablet_bootstrap.cc:492] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:01.370180 23552 ts_tablet_manager.cc:1403] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.232s	user 0.003s	sys 0.013s
I20260709 13:10:01.373833 23252 leader_election.cc:304] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:01.375154 23473 leader_election.cc:304] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:01.375676 23654 raft_consensus.cc:2749] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.376077 23555 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:01.376538 23555 ts_tablet_manager.cc:1403] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.001s
I20260709 13:10:01.378324 23654 consensus_queue.cc:1048] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.381147 23669 leader_election.cc:290] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:01.382721 23432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:01.383339 23432 raft_consensus.cc:3060] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.372781 23552 raft_consensus.cc:359] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.386441 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:01.386885 23552 raft_consensus.cc:385] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.387214 23552 raft_consensus.cc:740] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.388029 23552 consensus_queue.cc:260] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.390535 23552 ts_tablet_manager.cc:1434] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.005s
I20260709 13:10:01.390856 23433 raft_consensus.cc:2468] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:10:01.391477 23552 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:01.378163 23784 raft_consensus.cc:2804] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.391937 23249 leader_election.cc:304] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:01.393190 23654 raft_consensus.cc:2804] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.391942 23784 raft_consensus.cc:493] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.393898 23358 raft_consensus.cc:1275] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:10:01.389684 23473 leader_election.cc:343] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.394070 23654 raft_consensus.cc:697] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:01.395541 23784 raft_consensus.cc:3060] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.394284 23358 pending_rounds.cc:85] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: Aborting all ops after (but not including) 1
I20260709 13:10:01.393354 23555 raft_consensus.cc:359] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.396950 23358 pending_rounds.cc:107] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:01.396936 23654 consensus_queue.cc:237] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.397531 23358 raft_consensus.cc:2889] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.399062 23553 tablet_bootstrap.cc:654] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.399253 23789 consensus_queue.cc:1048] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.397192 23555 raft_consensus.cc:385] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.401063 23555 raft_consensus.cc:740] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.402585 23551 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:01.403046 23551 ts_tablet_manager.cc:1403] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.155s	user 0.017s	sys 0.002s
I20260709 13:10:01.401703 23555 consensus_queue.cc:260] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.406306 23555 ts_tablet_manager.cc:1434] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:10:01.414199 23555 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:01.428328 23432 raft_consensus.cc:2468] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:01.429662 23472 leader_election.cc:304] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:01.430872 23636 raft_consensus.cc:2804] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.431324 23636 raft_consensus.cc:697] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:01.432139 23636 consensus_queue.cc:237] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.434576 23552 tablet_bootstrap.cc:654] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.451532 23506 raft_consensus.cc:1275] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:01.444314 23181 catalog_manager.cc:5697] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.461213 23551 raft_consensus.cc:359] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.462076 23551 raft_consensus.cc:385] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.462355 23551 raft_consensus.cc:740] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.464352 23551 consensus_queue.cc:260] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.466851 23785 consensus_queue.cc:1048] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.472535 23669 consensus_queue.cc:1048] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.480679 23784 raft_consensus.cc:515] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.482725 23784 leader_election.cc:290] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:01.491891 23551 ts_tablet_manager.cc:1434] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.001s
I20260709 13:10:01.494810 23551 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:01.517987 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5153ef78cf4bf89ae5eb12f0f475b4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:01.519384 23654 consensus_queue.cc:1048] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:01.534798 23356 raft_consensus.cc:3060] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.495867 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5153ef78cf4bf89ae5eb12f0f475b4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:01.542199 23181 catalog_manager.cc:5697] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.545306 23358 raft_consensus.cc:3060] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:01.545822 23474 leader_election.cc:343] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:01.544353 23472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:38025, user_credentials={real_user=slave}} blocked reactor thread for 72405.7us
I20260709 13:10:01.556496 23553 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.557027 23553 ts_tablet_manager.cc:1403] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.225s	user 0.028s	sys 0.010s
I20260709 13:10:01.562889 23555 tablet_bootstrap.cc:654] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.572870 23358 raft_consensus.cc:2468] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:01.576746 23473 leader_election.cc:304] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:01.577960 23635 raft_consensus.cc:2804] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.578418 23635 raft_consensus.cc:697] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:01.579233 23635 consensus_queue.cc:237] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.582603 23553 raft_consensus.cc:359] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.583323 23553 raft_consensus.cc:385] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.583581 23553 raft_consensus.cc:740] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.584266 23553 consensus_queue.cc:260] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.601284 23553 ts_tablet_manager.cc:1434] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 13:10:01.603624 23552 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:01.604151 23552 ts_tablet_manager.cc:1403] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.213s	user 0.020s	sys 0.029s
I20260709 13:10:01.604414 23553 tablet_bootstrap.cc:492] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.609180 23551 tablet_bootstrap.cc:654] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.624205 23552 raft_consensus.cc:359] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.625138 23552 raft_consensus.cc:385] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.625414 23552 raft_consensus.cc:740] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.628156 23552 consensus_queue.cc:260] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.641237 23555 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:01.641750 23555 ts_tablet_manager.cc:1403] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.005s
I20260709 13:10:01.647746 23555 raft_consensus.cc:359] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.652103 23555 raft_consensus.cc:385] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.652366 23555 raft_consensus.cc:740] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.653103 23555 consensus_queue.cc:260] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.655351 23555 ts_tablet_manager.cc:1434] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:01.656498 23555 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:01.660094 23553 tablet_bootstrap.cc:654] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.662266 23555 tablet_bootstrap.cc:654] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.664631 23184 catalog_manager.cc:5697] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.670493 23838 raft_consensus.cc:493] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e2983c2051a44788d4064010321c7f5)
I20260709 13:10:01.671722 23838 raft_consensus.cc:515] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.677785 23552 ts_tablet_manager.cc:1434] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:10:01.683048 23838 leader_election.cc:290] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:01.683737 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cb1e511f734cf3b2669918cf9efbc7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:01.684880 23432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cb1e511f734cf3b2669918cf9efbc7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:01.685451 23552 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:01.690850 23283 raft_consensus.cc:3060] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.698352 23326 leader_election.cc:304] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:01.700404 23551 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:01.700907 23551 ts_tablet_manager.cc:1403] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.002s
I20260709 13:10:01.676654 23635 raft_consensus.cc:493] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.708343 23552 tablet_bootstrap.cc:654] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.703387 23838 raft_consensus.cc:2749] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:01.711261 23553 tablet_bootstrap.cc:492] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.711735 23553 ts_tablet_manager.cc:1403] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.021s
I20260709 13:10:01.714077 23551 raft_consensus.cc:359] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.714740 23551 raft_consensus.cc:385] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.715025 23551 raft_consensus.cc:740] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.715090 23785 raft_consensus.cc:493] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.702795 23851 consensus_queue.cc:1048] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:10:01.715679 23785 raft_consensus.cc:515] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.720157 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:01.720006 23551 consensus_queue.cc:260] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:01.721488 23401 leader_election.cc:343] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.722021 23551 ts_tablet_manager.cc:1434] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:10:01.714347 23553 raft_consensus.cc:359] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.722469 23553 raft_consensus.cc:385] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.722741 23553 raft_consensus.cc:740] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.724581 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:10:01.726044 23400 leader_election.cc:343] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.726466 23400 leader_election.cc:304] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:01.727263 23559 raft_consensus.cc:2749] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.728358 23785 leader_election.cc:290] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:01.737402 23785 raft_consensus.cc:493] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.737903 23785 raft_consensus.cc:515] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.740015 23785 leader_election.cc:290] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:01.740852 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.705066 23635 raft_consensus.cc:515] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:10:01.742321 23399 leader_election.cc:343] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.738390 23553 consensus_queue.cc:260] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.747292 23553 ts_tablet_manager.cc:1434] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:10:01.748484 23553 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.752633 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
W20260709 13:10:01.754240 23401 leader_election.cc:343] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.754668 23401 leader_election.cc:304] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:01.756189 23559 raft_consensus.cc:2749] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.758123 23636 consensus_queue.cc:1048] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.759285 23635 leader_election.cc:290] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:01.760124 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faeb76eaa46b49f398e91a6a3bbfacb1" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:01.722879 23551 tablet_bootstrap.cc:492] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:01.760769 23280 raft_consensus.cc:2468] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:01.761754 23474 leader_election.cc:304] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:01.762645 23635 raft_consensus.cc:2804] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.763051 23635 raft_consensus.cc:493] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.767540 23553 tablet_bootstrap.cc:654] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.768092 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faeb76eaa46b49f398e91a6a3bbfacb1" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.783981 23552 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:01.780639 23356 raft_consensus.cc:2468] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:01.784559 23552 ts_tablet_manager.cc:1403] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.004s
I20260709 13:10:01.783954 23838 raft_consensus.cc:493] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.787158 23838 raft_consensus.cc:515] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.787750 23552 raft_consensus.cc:359] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.788460 23552 raft_consensus.cc:385] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.788709 23552 raft_consensus.cc:740] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.789122 23838 leader_election.cc:290] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:01.790561 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:01.791316 23434 raft_consensus.cc:2393] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:10:01.792052 23555 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
W20260709 13:10:01.792002 23250 consensus_peers.cc:597] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.792624 23555 ts_tablet_manager.cc:1403] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.002s
W20260709 13:10:01.792953 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:01.793800 23669 raft_consensus.cc:493] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.794284 23669 raft_consensus.cc:515] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.794844 23851 raft_consensus.cc:493] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.795176 23555 raft_consensus.cc:359] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.795295 23851 raft_consensus.cc:515] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.795871 23555 raft_consensus.cc:385] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.796164 23555 raft_consensus.cc:740] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.796321 23669 leader_election.cc:290] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:01.797857 23851 leader_election.cc:290] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:01.798581 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:01.798729 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:10:01.800503 23474 leader_election.cc:343] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:01.801172 23474 leader_election.cc:343] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.801896 23551 tablet_bootstrap.cc:654] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.802498 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf5322b429943b79e7e871a1f61ce06" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:01.803889 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:01.802606 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
W20260709 13:10:01.805006 23473 leader_election.cc:343] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.805243 23434 raft_consensus.cc:2468] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:01.805418 23473 leader_election.cc:304] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:01.805980 23327 leader_election.cc:304] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:01.806782 23838 raft_consensus.cc:3060] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.807444 23851 raft_consensus.cc:2749] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.808030 23552 consensus_queue.cc:260] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.810176 23552 ts_tablet_manager.cc:1434] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 13:10:01.811102 23552 tablet_bootstrap.cc:492] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:01.774282 23635 raft_consensus.cc:3060] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.807391 23472 leader_election.cc:304] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:01.812302 23555 consensus_queue.cc:260] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.812628 23851 raft_consensus.cc:2804] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.813315 23851 raft_consensus.cc:493] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.813707 23851 raft_consensus.cc:3060] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.814318 23555 ts_tablet_manager.cc:1434] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:10:01.815222 23555 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:01.816141 23838 raft_consensus.cc:2749] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.829056 23552 tablet_bootstrap.cc:654] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.837764 23851 raft_consensus.cc:515] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.840746 23432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:01.841326 23432 raft_consensus.cc:3060] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.842466 23635 raft_consensus.cc:515] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.842921 23851 leader_election.cc:290] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:01.847460 23553 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.847910 23553 ts_tablet_manager.cc:1403] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.005s
I20260709 13:10:01.850471 23553 raft_consensus.cc:359] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.851055 23553 raft_consensus.cc:385] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.851300 23553 raft_consensus.cc:740] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.853489 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faeb76eaa46b49f398e91a6a3bbfacb1" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:01.853669 23635 leader_election.cc:290] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:01.854061 23280 raft_consensus.cc:3060] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.855314 23553 consensus_queue.cc:260] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.856173 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faeb76eaa46b49f398e91a6a3bbfacb1" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:01.856724 23356 raft_consensus.cc:3060] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.857581 23553 ts_tablet_manager.cc:1434] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:01.859845 23555 tablet_bootstrap.cc:654] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.868942 23553 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.869812 23552 tablet_bootstrap.cc:492] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:01.870273 23552 ts_tablet_manager.cc:1403] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.004s
I20260709 13:10:01.872718 23552 raft_consensus.cc:359] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.873435 23552 raft_consensus.cc:385] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.873689 23552 raft_consensus.cc:740] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.874375 23552 consensus_queue.cc:260] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.876904 23552 ts_tablet_manager.cc:1434] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:01.880514 23552 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:01.877486 23553 tablet_bootstrap.cc:654] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.885484 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:01.886487 23432 raft_consensus.cc:2468] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
W20260709 13:10:01.887981 23474 leader_election.cc:343] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.888509 23472 leader_election.cc:304] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:01.889362 23280 raft_consensus.cc:2468] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:01.889569 23635 raft_consensus.cc:2804] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.890046 23551 tablet_bootstrap.cc:492] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:01.890520 23551 ts_tablet_manager.cc:1403] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.168s	user 0.012s	sys 0.006s
I20260709 13:10:01.890436 23474 leader_election.cc:304] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:01.890177 23635 raft_consensus.cc:697] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:01.891724 23669 raft_consensus.cc:2804] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.891729 23635 consensus_queue.cc:237] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.892711 23669 raft_consensus.cc:697] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:01.893121 23280 raft_consensus.cc:3060] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.893121 23551 raft_consensus.cc:359] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.893879 23551 raft_consensus.cc:385] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.893517 23669 consensus_queue.cc:237] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.894141 23551 raft_consensus.cc:740] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.894793 23551 consensus_queue.cc:260] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:01.898226 23553 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.898700 23553 ts_tablet_manager.cc:1403] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:10:01.900149 23555 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:01.900631 23555 ts_tablet_manager.cc:1403] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.086s	user 0.005s	sys 0.011s
I20260709 13:10:01.902961 23555 raft_consensus.cc:359] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.903568 23555 raft_consensus.cc:385] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.903836 23555 raft_consensus.cc:740] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.906428 23356 raft_consensus.cc:2468] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:01.906692 23553 raft_consensus.cc:359] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.907353 23553 raft_consensus.cc:385] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.907617 23553 raft_consensus.cc:740] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.908339 23555 consensus_queue.cc:260] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.908921 23839 consensus_queue.cc:1048] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:01.909929 23555 ts_tablet_manager.cc:1434] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:10:01.910914 23555 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:01.916512 23551 ts_tablet_manager.cc:1434] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:10:01.916961 23552 tablet_bootstrap.cc:654] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.917438 23551 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:01.920048 23553 consensus_queue.cc:260] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:01.922379 23553 ts_tablet_manager.cc:1434] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:10:01.926373 23551 tablet_bootstrap.cc:654] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.929700 23553 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.936086 23553 tablet_bootstrap.cc:654] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.939174 23555 tablet_bootstrap.cc:654] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.944386 23551 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:01.944821 23551 ts_tablet_manager.cc:1403] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:10:01.949299 23555 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:01.949800 23555 ts_tablet_manager.cc:1403] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.003s
I20260709 13:10:01.952296 23555 raft_consensus.cc:359] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.959165 23555 raft_consensus.cc:385] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.959456 23555 raft_consensus.cc:740] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.960204 23555 consensus_queue.cc:260] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.958850 23553 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:01.962453 23553 ts_tablet_manager.cc:1403] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:10:01.965119 23552 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:01.965584 23552 ts_tablet_manager.cc:1403] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.000s
I20260709 13:10:01.966619 23553 raft_consensus.cc:359] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.967272 23553 raft_consensus.cc:385] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.967536 23553 raft_consensus.cc:740] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.955637 23182 catalog_manager.cc:5697] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.967957 23552 raft_consensus.cc:359] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.968593 23552 raft_consensus.cc:385] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.968848 23552 raft_consensus.cc:740] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.965595 23555 ts_tablet_manager.cc:1434] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:01.969427 23552 consensus_queue.cc:260] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:01.970654 23555 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:01.970914 23669 consensus_queue.cc:1048] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.979746 23553 consensus_queue.cc:260] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.983634 23553 ts_tablet_manager.cc:1434] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:10:01.960549 23551 raft_consensus.cc:359] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.971467 23552 ts_tablet_manager.cc:1434] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:01.985513 23551 raft_consensus.cc:385] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.985881 23551 raft_consensus.cc:740] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.986393 23553 tablet_bootstrap.cc:492] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:01.986681 23551 consensus_queue.cc:260] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:01.988770 23552 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:01.997756 23551 ts_tablet_manager.cc:1434] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:10:01.998728 23551 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:02.001988 23552 tablet_bootstrap.cc:654] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.003636 23555 tablet_bootstrap.cc:654] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.003509 23669 consensus_queue.cc:1048] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.990341 23181 catalog_manager.cc:5697] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.008999 23551 tablet_bootstrap.cc:654] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.012830 23553 tablet_bootstrap.cc:654] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.045411 23280 raft_consensus.cc:3060] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.053814 23552 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:02.054349 23552 ts_tablet_manager.cc:1403] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.010s
I20260709 13:10:02.056847 23553 tablet_bootstrap.cc:492] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:02.057348 23553 ts_tablet_manager.cc:1403] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 13:10:02.060026 23553 raft_consensus.cc:359] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.060665 23553 raft_consensus.cc:385] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.060916 23553 raft_consensus.cc:740] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.065743 23553 consensus_queue.cc:260] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.068048 23555 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:02.068607 23555 ts_tablet_manager.cc:1403] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.005s
I20260709 13:10:02.070894 23553 ts_tablet_manager.cc:1434] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:10:02.078688 23555 raft_consensus.cc:359] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.079507 23555 raft_consensus.cc:385] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.079778 23555 raft_consensus.cc:740] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.080987 23838 raft_consensus.cc:493] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.081482 23838 raft_consensus.cc:515] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.069008 23671 raft_consensus.cc:493] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.084105 23671 raft_consensus.cc:515] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.083720 23838 leader_election.cc:290] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.084901 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.085536 23433 raft_consensus.cc:2468] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:02.085999 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.086150 23671 leader_election.cc:290] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:02.086711 23324 leader_election.cc:304] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:02.087811 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.090361 23555 consensus_queue.cc:260] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.086617 23283 raft_consensus.cc:2468] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:02.094389 23553 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
W20260709 13:10:02.096089 23400 leader_election.cc:343] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.096827 23851 consensus_queue.cc:1048] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.087818 23838 raft_consensus.cc:2804] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.097743 23838 raft_consensus.cc:493] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.098165 23838 raft_consensus.cc:3060] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.093308 23654 raft_consensus.cc:493] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.100189 23654 raft_consensus.cc:515] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.102798 23654 leader_election.cc:290] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.103483 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.108565 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.108836 23559 raft_consensus.cc:493] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.109318 23559 raft_consensus.cc:515] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.110021 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.112035 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:02.110662 23433 raft_consensus.cc:2468] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:02.096068 23555 ts_tablet_manager.cc:1434] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
W20260709 13:10:02.115996 23401 leader_election.cc:343] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:02.116415 23399 leader_election.cc:343] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.116881 23399 leader_election.cc:304] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.117156 23249 leader_election.cc:304] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:02.117981 23654 raft_consensus.cc:2804] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.118369 23654 raft_consensus.cc:493] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.118718 23654 raft_consensus.cc:3060] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.119324 23552 raft_consensus.cc:359] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.119714 23785 raft_consensus.cc:2749] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.119839 23551 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:02.120515 23559 leader_election.cc:290] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:02.121018 23838 raft_consensus.cc:515] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.120491 23551 ts_tablet_manager.cc:1403] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.006s
I20260709 13:10:02.123023 23838 leader_election.cc:290] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.124927 23360 raft_consensus.cc:2393] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:10:02.119993 23552 raft_consensus.cc:385] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.125883 23654 raft_consensus.cc:515] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.126463 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:02.127061 23433 raft_consensus.cc:3060] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.115259 23555 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:02.128530 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:02.126474 23552 raft_consensus.cc:740] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.127260 23551 raft_consensus.cc:359] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.131172 23551 raft_consensus.cc:385] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.131896 23551 raft_consensus.cc:740] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.131253 23552 consensus_queue.cc:260] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.133543 23553 tablet_bootstrap.cc:654] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.132596 23551 consensus_queue.cc:260] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.140815 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:02.141412 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.141613 23279 raft_consensus.cc:2393] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e56d4fa89a4e41fb99476c088544e8b8 in this term.
W20260709 13:10:02.143021 23400 leader_election.cc:343] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.143450 23400 leader_election.cc:304] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:02.144500 23671 raft_consensus.cc:2749] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.145412 23552 ts_tablet_manager.cc:1434] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.001s
I20260709 13:10:02.146589 23551 ts_tablet_manager.cc:1434] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:10:02.147372 23552 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:02.152868 23551 tablet_bootstrap.cc:492] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:02.147900 23851 consensus_queue.cc:1048] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:10:02.147595 23671 raft_consensus.cc:493] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.160029 23671 raft_consensus.cc:515] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.162173 23671 leader_election.cc:290] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:02.162761 23654 leader_election.cc:290] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.152127 23433 raft_consensus.cc:2468] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:02.163141 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
W20260709 13:10:02.166577 23401 leader_election.cc:343] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.166776 23555 tablet_bootstrap.cc:654] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.164577 23324 leader_election.cc:304] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.170405 23650 raft_consensus.cc:2804] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.170842 23650 raft_consensus.cc:697] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:02.171598 23650 consensus_queue.cc:237] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.177080 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.177170 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd8bf8d048d4ad39c2f930d0606181f" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:02.178066 23433 raft_consensus.cc:2393] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:10:02.193152 23249 leader_election.cc:304] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:02.194242 23654 raft_consensus.cc:2749] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.194545 23669 raft_consensus.cc:493] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.195088 23669 raft_consensus.cc:515] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.197232 23669 leader_election.cc:290] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:02.198400 23553 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:02.198895 23553 ts_tablet_manager.cc:1403] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.003s
I20260709 13:10:02.200469 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.178217 23552 tablet_bootstrap.cc:654] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.178966 23671 raft_consensus.cc:493] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.203366 23671 raft_consensus.cc:515] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:02.179284 23399 leader_election.cc:343] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.205065 23399 leader_election.cc:304] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:02.207074 23886 raft_consensus.cc:2749] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.208657 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1af8f7f5d2f49d2a6bafad6338a0e92" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:02.209873 23551 tablet_bootstrap.cc:654] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:02.202848 23474 leader_election.cc:343] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:02.216933 23401 leader_election.cc:343] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.219317 23553 raft_consensus.cc:359] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.221256 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1af8f7f5d2f49d2a6bafad6338a0e92" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.219933 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.220127 23553 raft_consensus.cc:385] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:02.222553 23400 leader_election.cc:343] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.222816 23553 raft_consensus.cc:740] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.212922 23671 leader_election.cc:290] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
W20260709 13:10:02.223847 23473 leader_election.cc:343] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.222515 23555 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:02.223234 23400 leader_election.cc:304] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:02.228204 23473 leader_election.cc:304] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.228713 23559 raft_consensus.cc:2749] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.228443 23555 ts_tablet_manager.cc:1403] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.000s
I20260709 13:10:02.229506 23635 raft_consensus.cc:2749] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.231664 23555 raft_consensus.cc:359] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.232367 23555 raft_consensus.cc:385] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.231987 23553 consensus_queue.cc:260] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.232635 23555 raft_consensus.cc:740] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.233244 23654 raft_consensus.cc:493] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.234298 23553 ts_tablet_manager.cc:1434] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:10:02.235277 23553 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:02.234254 23654 raft_consensus.cc:515] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.234930 23555 consensus_queue.cc:260] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.237440 23552 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:02.237666 23654 leader_election.cc:290] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:02.237914 23552 ts_tablet_manager.cc:1403] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.000s
I20260709 13:10:02.238488 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.239323 23433 raft_consensus.cc:2393] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:10:02.240816 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591a48f99daf4f3ca78a90b308ab3134" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:02.241122 23552 raft_consensus.cc:359] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.241793 23552 raft_consensus.cc:385] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.242092 23552 raft_consensus.cc:740] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.241696 23555 ts_tablet_manager.cc:1434] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:10:02.242823 23552 consensus_queue.cc:260] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.243156 23252 leader_election.cc:304] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:02.246007 23552 ts_tablet_manager.cc:1434] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:02.248471 23555 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:02.249749 23654 raft_consensus.cc:3060] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.251235 23552 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:02.271339 23552 tablet_bootstrap.cc:654] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.281706 23184 catalog_manager.cc:5697] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.299386 23851 consensus_queue.cc:1048] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:10:02.309178 23553 tablet_bootstrap.cc:654] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.309794 23654 raft_consensus.cc:2749] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.299285 23650 raft_consensus.cc:493] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.310892 23650 raft_consensus.cc:515] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.313467 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.314961 23650 leader_election.cc:290] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.315742 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.317193 23551 tablet_bootstrap.cc:492] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:02.317674 23551 ts_tablet_manager.cc:1403] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.165s	user 0.018s	sys 0.007s
I20260709 13:10:02.317667 23326 leader_election.cc:304] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.314988 23555 tablet_bootstrap.cc:654] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.319207 23802 raft_consensus.cc:2749] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.319902 23802 raft_consensus.cc:493] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.320333 23802 raft_consensus.cc:515] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.320528 23551 raft_consensus.cc:359] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.321159 23551 raft_consensus.cc:385] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.321416 23551 raft_consensus.cc:740] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.322288 23551 consensus_queue.cc:260] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.322961 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:02.323588 23506 raft_consensus.cc:2468] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:02.324832 23327 leader_election.cc:304] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:02.326906 23838 raft_consensus.cc:2804] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.327260 23838 raft_consensus.cc:493] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.327558 23838 raft_consensus.cc:3060] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.329089 23551 ts_tablet_manager.cc:1434] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:02.329993 23551 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:02.335219 23551 tablet_bootstrap.cc:654] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.342393 23802 leader_election.cc:290] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:02.344234 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.345146 23283 raft_consensus.cc:2468] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:02.349131 23851 raft_consensus.cc:493] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.349630 23851 raft_consensus.cc:515] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.352753 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.353062 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.353721 23356 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:02.355863 23473 leader_election.cc:304] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:02.360105 23669 raft_consensus.cc:2804] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.360458 23669 raft_consensus.cc:493] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.360760 23669 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.369747 23433 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:02.370829 23552 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:02.371305 23552 ts_tablet_manager.cc:1403] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.120s	user 0.026s	sys 0.036s
I20260709 13:10:02.356354 23851 leader_election.cc:290] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.383142 23669 raft_consensus.cc:515] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.387549 23553 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:02.391932 23553 ts_tablet_manager.cc:1403] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.157s	user 0.016s	sys 0.002s
I20260709 13:10:02.393209 23669 leader_election.cc:290] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.387925 23551 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:02.357218 23838 raft_consensus.cc:515] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.395169 23551 ts_tablet_manager.cc:1403] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.008s
I20260709 13:10:02.396561 23553 raft_consensus.cc:359] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.397356 23553 raft_consensus.cc:385] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.397555 23553 raft_consensus.cc:740] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.399652 23553 consensus_queue.cc:260] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.401360 23553 ts_tablet_manager.cc:1434] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:10:02.402035 23553 tablet_bootstrap.cc:492] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:02.398098 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:02.404453 23360 raft_consensus.cc:3060] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.404476 23356 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.411909 23553 tablet_bootstrap.cc:654] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.416643 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:02.417310 23433 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.423285 23635 raft_consensus.cc:493] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.423764 23635 raft_consensus.cc:515] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.425164 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:02.425748 23502 raft_consensus.cc:3060] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.427106 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "800fdd40a53c4181873d9251355e0317" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.425767 23635 leader_election.cc:290] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:02.428160 23552 raft_consensus.cc:359] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:02.428436 23474 leader_election.cc:343] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.428815 23552 raft_consensus.cc:385] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.429117 23552 raft_consensus.cc:740] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.432520 23502 raft_consensus.cc:2468] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:02.433636 23327 leader_election.cc:304] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:02.434456 23650 raft_consensus.cc:2804] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.434728 23433 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:02.434919 23650 raft_consensus.cc:697] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:02.435976 23472 leader_election.cc:304] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:02.435868 23650 consensus_queue.cc:237] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.429263 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:02.438084 23283 raft_consensus.cc:3060] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.438866 23635 raft_consensus.cc:2804] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.439385 23635 raft_consensus.cc:697] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:02.440191 23635 consensus_queue.cc:237] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.442709 23851 consensus_queue.cc:1048] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.442885 23552 consensus_queue.cc:260] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.449317 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "800fdd40a53c4181873d9251355e0317" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.449927 23357 raft_consensus.cc:2468] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:02.450975 23473 leader_election.cc:304] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.452073 23636 raft_consensus.cc:2804] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.452411 23636 raft_consensus.cc:493] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.452786 23636 raft_consensus.cc:3060] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.448747 23669 raft_consensus.cc:493] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.453356 23669 raft_consensus.cc:515] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.459159 23555 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:02.459703 23555 ts_tablet_manager.cc:1403] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.211s	user 0.041s	sys 0.024s
I20260709 13:10:02.461714 23669 leader_election.cc:290] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.459450 23551 raft_consensus.cc:359] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.462636 23551 raft_consensus.cc:385] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.462956 23551 raft_consensus.cc:740] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.463116 23552 ts_tablet_manager.cc:1434] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.003s
I20260709 13:10:02.463690 23555 raft_consensus.cc:359] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.465675 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.464917 23551 consensus_queue.cc:260] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.425384 23838 leader_election.cc:290] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:02.470538 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.466054 23555 raft_consensus.cc:385] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.471676 23555 raft_consensus.cc:740] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.466352 23434 raft_consensus.cc:2468] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:02.473150 23472 leader_election.cc:304] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:02.474206 23784 raft_consensus.cc:2804] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.474584 23784 raft_consensus.cc:493] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.466065 23552 tablet_bootstrap.cc:492] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:02.474431 23551 ts_tablet_manager.cc:1434] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.000s
I20260709 13:10:02.475751 23551 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:02.477093 23784 raft_consensus.cc:3060] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.472484 23555 consensus_queue.cc:260] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.476845 23851 consensus_queue.cc:1048] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:02.478364 23671 raft_consensus.cc:493] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.479061 23555 ts_tablet_manager.cc:1434] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:10:02.478886 23671 raft_consensus.cc:515] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.480014 23555 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:02.483433 23473 leader_election.cc:343] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.477331 23886 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.486160 23886 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.487576 23671 leader_election.cc:290] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:02.489348 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.490532 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:10:02.491333 23400 leader_election.cc:343] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.490561 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.489185 23886 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:10:02.501168 23399 leader_election.cc:343] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.503338 23283 raft_consensus.cc:2468] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:02.503818 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:10:02.505357 23399 leader_election.cc:343] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.505796 23399 leader_election.cc:304] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.500170 23182 catalog_manager.cc:5697] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:02.512266 23400 leader_election.cc:343] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.509583 23559 raft_consensus.cc:2749] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.515399 23356 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:02.512777 23400 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.517830 23671 raft_consensus.cc:2749] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.495034 23636 raft_consensus.cc:515] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.527942 23636 leader_election.cc:290] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:02.529208 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "800fdd40a53c4181873d9251355e0317" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:02.529798 23281 raft_consensus.cc:3060] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.530081 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "800fdd40a53c4181873d9251355e0317" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:02.530655 23359 raft_consensus.cc:3060] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.532373 23636 consensus_queue.cc:1048] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.535707 23784 raft_consensus.cc:515] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.537737 23784 leader_election.cc:290] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.538769 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:02.525158 23552 tablet_bootstrap.cc:654] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.539364 23434 raft_consensus.cc:3060] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.544507 23838 raft_consensus.cc:493] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.544976 23838 raft_consensus.cc:515] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.548565 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.548808 23838 leader_election.cc:290] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.549132 23433 raft_consensus.cc:2468] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:02.550822 23553 tablet_bootstrap.cc:492] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:02.551314 23553 ts_tablet_manager.cc:1403] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.016s
I20260709 13:10:02.553155 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:02.553853 23553 raft_consensus.cc:359] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.554457 23553 raft_consensus.cc:385] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:02.554399 23473 leader_election.cc:343] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.555107 23553 raft_consensus.cc:740] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.555318 23281 raft_consensus.cc:2468] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:02.555881 23553 consensus_queue.cc:260] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.556401 23474 leader_election.cc:304] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:02.557623 23553 ts_tablet_manager.cc:1434] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:02.558736 23553 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:02.559451 23324 leader_election.cc:304] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:02.559949 23636 raft_consensus.cc:2804] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.560308 23650 raft_consensus.cc:2804] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.560683 23650 raft_consensus.cc:493] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.561010 23650 raft_consensus.cc:3060] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.567066 23555 tablet_bootstrap.cc:654] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.569135 23551 tablet_bootstrap.cc:654] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.554350 23434 raft_consensus.cc:2468] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:02.550772 23359 raft_consensus.cc:2468] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:02.561825 23636 raft_consensus.cc:697] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:02.578660 23181 catalog_manager.cc:5697] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.585110 23636 consensus_queue.cc:237] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:02.596711 23808 raft_consensus.cc:493] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.597255 23808 raft_consensus.cc:515] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.604235 23553 tablet_bootstrap.cc:654] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.602946 23635 raft_consensus.cc:493] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.612808 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.617236 23280 raft_consensus.cc:2468] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:02.630748 23551 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:02.631556 23551 ts_tablet_manager.cc:1403] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.156s	user 0.016s	sys 0.012s
I20260709 13:10:02.604784 23472 leader_election.cc:304] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:02.621119 23635 raft_consensus.cc:515] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:02.653889 23903 log.cc:927] Time spent T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:10:02.660878 23472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:38025, user_credentials={real_user=slave}} blocked reactor thread for 59891.5us
I20260709 13:10:02.651815 23904 consensus_queue.cc:1048] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:10:02.661830 23552 tablet_bootstrap.cc:492] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:02.662302 23552 ts_tablet_manager.cc:1403] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.196s	user 0.028s	sys 0.003s
I20260709 13:10:02.665050 23552 raft_consensus.cc:359] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.665645 23901 raft_consensus.cc:2804] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.666157 23901 raft_consensus.cc:697] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:02.666973 23901 consensus_queue.cc:237] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.668618 23808 leader_election.cc:290] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:10:02.669965 23905 log.cc:927] Time spent T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:10:02.671109 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.671532 23432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.672255 23432 raft_consensus.cc:2468] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:02.684162 23249 leader_election.cc:304] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:02.685549 23654 raft_consensus.cc:2804] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.685905 23654 raft_consensus.cc:493] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.686237 23654 raft_consensus.cc:3060] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.679216 23551 raft_consensus.cc:359] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.688261 23551 raft_consensus.cc:385] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.688715 23551 raft_consensus.cc:740] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.665691 23552 raft_consensus.cc:385] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.697911 23552 raft_consensus.cc:740] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.698552 23552 consensus_queue.cc:260] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.689415 23551 consensus_queue.cc:260] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.687026 23650 raft_consensus.cc:515] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.708557 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:02.709895 23552 ts_tablet_manager.cc:1434] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 13:10:02.725934 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1af8f7f5d2f49d2a6bafad6338a0e92" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:02.727180 23552 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:02.701090 23635 leader_election.cc:290] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:02.714986 23359 raft_consensus.cc:2393] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:10:02.736038 23184 catalog_manager.cc:5697] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.749606 23551 ts_tablet_manager.cc:1434] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:10:02.756131 23551 tablet_bootstrap.cc:492] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:02.759004 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1af8f7f5d2f49d2a6bafad6338a0e92" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.763164 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:02.763779 23431 raft_consensus.cc:3060] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.759611 23433 raft_consensus.cc:2468] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
W20260709 13:10:02.748739 23474 leader_election.cc:343] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.755115 23650 leader_election.cc:290] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.756632 23802 consensus_queue.cc:1048] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:10:02.787568 23654 raft_consensus.cc:515] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.796926 23472 leader_election.cc:304] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.799196 23285 raft_consensus.cc:2393] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e56d4fa89a4e41fb99476c088544e8b8 in this term.
I20260709 13:10:02.800328 23851 raft_consensus.cc:2804] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.800732 23851 raft_consensus.cc:493] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.801041 23851 raft_consensus.cc:3060] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.802891 23555 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:02.803368 23555 ts_tablet_manager.cc:1403] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.324s	user 0.033s	sys 0.023s
I20260709 13:10:02.792392 23431 raft_consensus.cc:2468] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:02.809782 23555 raft_consensus.cc:359] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.810494 23555 raft_consensus.cc:385] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.810745 23555 raft_consensus.cc:740] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.815059 23654 leader_election.cc:290] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.815649 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:02.816449 23360 raft_consensus.cc:2393] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:10:02.817507 23555 consensus_queue.cc:260] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.827888 23324 leader_election.cc:304] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:02.828823 23555 ts_tablet_manager.cc:1434] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:10:02.830432 23904 raft_consensus.cc:2804] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.830920 23904 raft_consensus.cc:697] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:02.831703 23904 consensus_queue.cc:237] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.833551 23552 tablet_bootstrap.cc:654] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.839273 23551 tablet_bootstrap.cc:654] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.841500 23553 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:02.842031 23553 ts_tablet_manager.cc:1403] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.283s	user 0.011s	sys 0.016s
I20260709 13:10:02.851725 23553 raft_consensus.cc:359] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.853793 23553 raft_consensus.cc:385] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.854065 23553 raft_consensus.cc:740] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.820169 23851 raft_consensus.cc:515] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.864863 23553 consensus_queue.cc:260] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.875227 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:02.876072 23431 raft_consensus.cc:2393] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate 690e3a11be554a93b36ec5017ed89787 in this term.
I20260709 13:10:02.877682 23249 leader_election.cc:304] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:02.879417 23916 raft_consensus.cc:2749] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.894409 23916 raft_consensus.cc:493] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.894935 23916 raft_consensus.cc:515] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.904695 23184 catalog_manager.cc:5697] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.905295 23555 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:02.907327 23553 ts_tablet_manager.cc:1434] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.015s
I20260709 13:10:02.908923 23669 consensus_queue.cc:1048] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:02.913620 23559 raft_consensus.cc:493] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.908239 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.913916 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.914091 23559 raft_consensus.cc:515] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.914577 23430 raft_consensus.cc:2468] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:02.916182 23559 leader_election.cc:290] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:02.918416 23916 leader_election.cc:290] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:02.919924 23356 raft_consensus.cc:2468] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:02.920841 23249 leader_election.cc:304] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:02.921523 23916 raft_consensus.cc:2804] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.921989 23916 raft_consensus.cc:493] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.920852 23552 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:02.922829 23552 ts_tablet_manager.cc:1403] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.197s	user 0.011s	sys 0.009s
I20260709 13:10:02.923619 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
W20260709 13:10:02.925087 23401 leader_election.cc:343] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.922387 23916 raft_consensus.cc:3060] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.926579 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:02.925403 23552 raft_consensus.cc:359] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:02.928426 23552 raft_consensus.cc:385] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.928686 23552 raft_consensus.cc:740] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.929324 23552 consensus_queue.cc:260] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:02.929596 23399 leader_election.cc:343] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.930662 23399 leader_election.cc:304] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:02.931999 23886 raft_consensus.cc:2749] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.932744 23669 consensus_queue.cc:1048] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.936800 23553 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:02.910698 23904 consensus_queue.cc:1048] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:10:02.938004 23838 raft_consensus.cc:493] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.938452 23838 raft_consensus.cc:515] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.939764 23802 consensus_queue.cc:1048] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.942498 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:02.944473 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:02.945199 23431 raft_consensus.cc:2393] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:10:02.949663 23324 leader_election.cc:304] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:02.949868 23552 ts_tablet_manager.cc:1434] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:10:02.952142 23552 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:02.958484 23182 catalog_manager.cc:5697] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.954811 23838 leader_election.cc:290] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:02.972256 23552 tablet_bootstrap.cc:654] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.971439 23916 raft_consensus.cc:515] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:02.990696 23551 tablet_bootstrap.cc:492] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:02.991191 23551 ts_tablet_manager.cc:1403] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.241s	user 0.023s	sys 0.007s
I20260709 13:10:02.991863 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:02.981832 23553 tablet_bootstrap.cc:654] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.992496 23356 raft_consensus.cc:3060] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.993834 23551 raft_consensus.cc:359] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:02.994483 23551 raft_consensus.cc:385] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.994728 23551 raft_consensus.cc:740] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.959988 23802 raft_consensus.cc:3060] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.997069 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:02.997665 23434 raft_consensus.cc:3060] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.989282 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1af8f7f5d2f49d2a6bafad6338a0e92" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.000928 23431 raft_consensus.cc:3060] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.005846 23851 leader_election.cc:290] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.007550 23434 raft_consensus.cc:2468] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:10:02.995322 23551 consensus_queue.cc:260] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.012984 23551 ts_tablet_manager.cc:1434] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:10:03.013885 23551 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:03.013919 23249 leader_election.cc:304] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:03.015276 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1af8f7f5d2f49d2a6bafad6338a0e92" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:03.016834 23923 raft_consensus.cc:2804] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.017352 23923 raft_consensus.cc:697] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:03.018117 23923 consensus_queue.cc:237] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.025017 23553 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.025494 23553 ts_tablet_manager.cc:1403] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.000s
I20260709 13:10:03.030593 23553 raft_consensus.cc:359] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.031225 23553 raft_consensus.cc:385] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.031491 23553 raft_consensus.cc:740] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.032827 23551 tablet_bootstrap.cc:654] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.034703 23553 consensus_queue.cc:260] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:10:03.039896 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:03.040567 23356 raft_consensus.cc:2468] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
W20260709 13:10:03.041923 23474 leader_election.cc:343] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.043673 23553 ts_tablet_manager.cc:1434] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:10:03.046789 23553 tablet_bootstrap.cc:492] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:03.054690 23555 tablet_bootstrap.cc:654] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.056535 23802 raft_consensus.cc:2749] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.010993 23431 raft_consensus.cc:2468] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.059003 23472 leader_election.cc:304] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:02.992102 23916 leader_election.cc:290] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.060896 23635 raft_consensus.cc:2804] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.061354 23635 raft_consensus.cc:697] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:03.062089 23635 consensus_queue.cc:237] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.089493 23553 tablet_bootstrap.cc:654] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.096539 23551 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:03.097057 23551 ts_tablet_manager.cc:1403] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.005s
I20260709 13:10:03.097931 23552 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:03.098392 23552 ts_tablet_manager.cc:1403] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.022s
I20260709 13:10:03.100914 23552 raft_consensus.cc:359] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.101600 23552 raft_consensus.cc:385] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.099581 23551 raft_consensus.cc:359] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.102751 23551 raft_consensus.cc:385] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.103039 23551 raft_consensus.cc:740] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.103726 23551 consensus_queue.cc:260] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.106498 23553 tablet_bootstrap.cc:492] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.106580 23551 ts_tablet_manager.cc:1434] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:03.107261 23553 ts_tablet_manager.cc:1403] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.001s
I20260709 13:10:03.102793 23184 catalog_manager.cc:5697] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.107839 23551 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:03.109745 23553 raft_consensus.cc:359] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.110707 23553 raft_consensus.cc:385] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.110963 23553 raft_consensus.cc:740] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.111613 23553 consensus_queue.cc:260] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.115340 23553 ts_tablet_manager.cc:1434] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:03.116242 23553 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:03.124598 23555 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:03.125102 23555 ts_tablet_manager.cc:1403] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.221s	user 0.018s	sys 0.009s
I20260709 13:10:03.125801 23669 consensus_queue.cc:1048] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.127501 23555 raft_consensus.cc:359] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.128204 23555 raft_consensus.cc:385] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.128459 23555 raft_consensus.cc:740] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.129101 23555 consensus_queue.cc:260] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.131928 23555 ts_tablet_manager.cc:1434] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:03.132786 23182 catalog_manager.cc:5697] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.135907 23553 tablet_bootstrap.cc:654] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.138011 23635 consensus_queue.cc:1048] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.132717 23555 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:03.101845 23552 raft_consensus.cc:740] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.143374 23552 consensus_queue.cc:260] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.148396 23551 tablet_bootstrap.cc:654] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.149621 23636 raft_consensus.cc:493] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.150069 23636 raft_consensus.cc:515] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.152482 23636 leader_election.cc:290] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.153146 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.151762 23555 tablet_bootstrap.cc:654] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.154428 23552 ts_tablet_manager.cc:1434] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:10:03.166213 23552 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
I20260709 13:10:03.153517 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.167253 23430 raft_consensus.cc:2468] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
W20260709 13:10:03.169071 23474 leader_election.cc:343] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.170648 23472 leader_election.cc:304] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:03.171610 23552 tablet_bootstrap.cc:654] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.172240 23901 raft_consensus.cc:2804] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.179819 23901 raft_consensus.cc:493] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.180171 23901 raft_consensus.cc:3060] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.188423 23901 raft_consensus.cc:515] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.190966 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.191499 23430 raft_consensus.cc:3060] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.201596 23430 raft_consensus.cc:2468] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.212255 23472 leader_election.cc:304] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.213210 23851 raft_consensus.cc:2804] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.213713 23851 raft_consensus.cc:697] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:03.214527 23851 consensus_queue.cc:237] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.219291 23901 leader_election.cc:290] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.220477 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
W20260709 13:10:03.222817 23474 leader_election.cc:343] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.226692 23669 consensus_queue.cc:1048] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.238754 23635 raft_consensus.cc:493] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.239238 23635 raft_consensus.cc:515] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.241536 23635 leader_election.cc:290] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.242923 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.243614 23431 raft_consensus.cc:2468] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:03.239164 23552 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:03.244758 23552 ts_tablet_manager.cc:1403] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.002s
I20260709 13:10:03.245057 23472 leader_election.cc:304] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.245862 23635 raft_consensus.cc:2804] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.245954 23553 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.246330 23635 raft_consensus.cc:493] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.244123 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.247779 23635 raft_consensus.cc:3060] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.246551 23553 ts_tablet_manager.cc:1403] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.130s	user 0.004s	sys 0.044s
W20260709 13:10:03.248980 23474 leader_election.cc:343] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.251511 23183 catalog_manager.cc:5697] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.252593 23553 raft_consensus.cc:359] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.253232 23553 raft_consensus.cc:385] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.253484 23553 raft_consensus.cc:740] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.254200 23553 consensus_queue.cc:260] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.257332 23802 raft_consensus.cc:493] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.257808 23802 raft_consensus.cc:515] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.259752 23802 leader_election.cc:290] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.260722 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:03.261165 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.261698 23552 raft_consensus.cc:359] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.262322 23553 ts_tablet_manager.cc:1434] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:10:03.262557 23552 raft_consensus.cc:385] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.262817 23552 raft_consensus.cc:740] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.263252 23553 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:03.255920 23555 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:03.263783 23555 ts_tablet_manager.cc:1403] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.131s	user 0.022s	sys 0.025s
I20260709 13:10:03.263425 23552 consensus_queue.cc:260] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:03.266979 23327 leader_election.cc:343] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.268981 23552 ts_tablet_manager.cc:1434] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:10:03.270187 23552 tablet_bootstrap.cc:492] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5: Bootstrap starting.
W20260709 13:10:03.269784 23326 leader_election.cc:343] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.273633 23671 raft_consensus.cc:493] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.274045 23326 leader_election.cc:304] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:03.274068 23671 raft_consensus.cc:515] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.275104 23838 raft_consensus.cc:2749] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.275522 23916 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.275995 23916 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.276278 23671 leader_election.cc:290] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.255628 23635 raft_consensus.cc:515] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.285084 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ad643f490e4b029e3b1a87544df7e7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:03.285948 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:03.283941 23555 raft_consensus.cc:359] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.286542 23555 raft_consensus.cc:385] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.286811 23555 raft_consensus.cc:740] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
W20260709 13:10:03.287391 23474 leader_election.cc:343] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.287390 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ad643f490e4b029e3b1a87544df7e7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.287031 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.288936 23431 raft_consensus.cc:3060] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.289181 23635 leader_election.cc:290] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
W20260709 13:10:03.290045 23401 leader_election.cc:343] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.290385 23916 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:10:03.290604 23400 leader_election.cc:343] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.291347 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.292129 23430 raft_consensus.cc:2468] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 0.
I20260709 13:10:03.287443 23555 consensus_queue.cc:260] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.293780 23249 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:03.294328 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:03.296005 23916 raft_consensus.cc:2804] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.296345 23916 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.296679 23916 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:03.299255 23250 leader_election.cc:343] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.299769 23555 ts_tablet_manager.cc:1434] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:10:03.291412 23400 leader_election.cc:304] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:03.300833 23555 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:03.302693 23559 raft_consensus.cc:2749] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.303020 23802 consensus_queue.cc:1048] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.303148 23916 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.311152 23553 tablet_bootstrap.cc:654] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.312295 23555 tablet_bootstrap.cc:654] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.314524 23551 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:03.314985 23551 ts_tablet_manager.cc:1403] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.207s	user 0.015s	sys 0.017s
I20260709 13:10:03.312009 23671 raft_consensus.cc:493] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.317523 23551 raft_consensus.cc:359] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.318176 23551 raft_consensus.cc:385] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.318429 23551 raft_consensus.cc:740] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.317337 23904 raft_consensus.cc:493] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.319411 23551 consensus_queue.cc:260] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.320044 23904 raft_consensus.cc:515] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.322098 23671 raft_consensus.cc:515] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.322818 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:03.323465 23502 raft_consensus.cc:2468] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:03.324889 23671 leader_election.cc:290] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.326371 23551 ts_tablet_manager.cc:1434] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:03.327291 23551 tablet_bootstrap.cc:492] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:03.327657 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.325045 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:03.328536 23901 raft_consensus.cc:493] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.328999 23901 raft_consensus.cc:515] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
W20260709 13:10:03.329347 23400 leader_election.cc:343] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:03.329876 23401 leader_election.cc:343] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.330291 23401 leader_election.cc:304] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:03.331013 23431 raft_consensus.cc:2468] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.331400 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:03.332113 23360 raft_consensus.cc:2468] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:03.332413 23472 leader_election.cc:304] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:03.332578 23559 raft_consensus.cc:2749] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.333331 23473 leader_election.cc:304] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.333622 23669 raft_consensus.cc:2804] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.334169 23636 raft_consensus.cc:2804] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.334604 23636 raft_consensus.cc:493] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.334928 23636 raft_consensus.cc:3060] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.335309 23916 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.338339 23432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.338915 23432 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.339591 23552 tablet_bootstrap.cc:654] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.339977 23669 raft_consensus.cc:697] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:03.333338 23901 leader_election.cc:290] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.343406 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:03.345613 23635 consensus_queue.cc:1048] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.346469 23636 raft_consensus.cc:515] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.340108 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.335421 23327 leader_election.cc:304] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.352535 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:03.352275 23669 consensus_queue.cc:237] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.353096 23359 raft_consensus.cc:3060] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.351708 23636 leader_election.cc:290] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.358789 23551 tablet_bootstrap.cc:654] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.357262 23802 raft_consensus.cc:2804] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.366302 23802 raft_consensus.cc:493] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.366658 23802 raft_consensus.cc:3060] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.352780 23431 raft_consensus.cc:2468] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:03.369720 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:10:03.372519 23250 leader_election.cc:343] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:03.373236 23326 leader_election.cc:343] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.374202 23432 raft_consensus.cc:2468] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 1.
I20260709 13:10:03.374368 23359 raft_consensus.cc:2468] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.366734 23904 leader_election.cc:290] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.375633 23249 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:03.376834 23923 raft_consensus.cc:2804] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.377290 23923 raft_consensus.cc:697] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:03.378064 23923 consensus_queue.cc:237] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.384560 23473 leader_election.cc:304] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.385421 23635 raft_consensus.cc:2804] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.391013 23635 raft_consensus.cc:697] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:03.374588 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.392844 23435 raft_consensus.cc:3060] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.395668 23802 raft_consensus.cc:515] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.401458 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:03.402011 23502 raft_consensus.cc:3060] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.402251 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:03.397135 23635 consensus_queue.cc:237] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
W20260709 13:10:03.404605 23326 leader_election.cc:343] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.412542 23802 leader_election.cc:290] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.463465 23553 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.464059 23553 ts_tablet_manager.cc:1403] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.002s
I20260709 13:10:03.466719 23553 raft_consensus.cc:359] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:03.450289 23326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.1:44223, user_credentials={real_user=slave}} blocked reactor thread for 46136.4us
I20260709 13:10:03.472724 23802 consensus_queue.cc:1048] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.472203 23181 catalog_manager.cc:5697] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.477164 23555 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:03.477705 23555 ts_tablet_manager.cc:1403] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.177s	user 0.017s	sys 0.004s
I20260709 13:10:03.483577 23555 raft_consensus.cc:359] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.484258 23555 raft_consensus.cc:385] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.484536 23555 raft_consensus.cc:740] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.485430 23555 consensus_queue.cc:260] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.487526 23555 ts_tablet_manager.cc:1434] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:03.488482 23555 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:03.491858 23553 raft_consensus.cc:385] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.492956 23553 raft_consensus.cc:740] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.493801 23553 consensus_queue.cc:260] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.507484 23552 tablet_bootstrap.cc:492] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5: No bootstrap required, opened a new log
I20260709 13:10:03.512019 23553 ts_tablet_manager.cc:1434] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 13:10:03.515836 23435 raft_consensus.cc:2468] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.530685 23553 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:03.513816 23552 ts_tablet_manager.cc:1403] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5: Time spent bootstrapping tablet: real 0.244s	user 0.011s	sys 0.006s
I20260709 13:10:03.515266 23502 raft_consensus.cc:2468] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:03.541396 23555 tablet_bootstrap.cc:654] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:03.547464 23401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:38341, user_credentials={real_user=slave}} blocked reactor thread for 50173.8us
I20260709 13:10:03.552224 23552 raft_consensus.cc:359] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.553692 23281 raft_consensus.cc:3060] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.553836 23552 raft_consensus.cc:385] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.556497 23552 raft_consensus.cc:740] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.556474 23923 consensus_queue.cc:1048] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.558853 23327 leader_election.cc:304] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:03.560011 23802 raft_consensus.cc:2804] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.560487 23802 raft_consensus.cc:697] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:03.561266 23802 consensus_queue.cc:237] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.562758 23552 consensus_queue.cc:260] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.566397 23552 ts_tablet_manager.cc:1434] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:10:03.568346 23551 tablet_bootstrap.cc:492] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:03.569676 23551 ts_tablet_manager.cc:1403] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.243s	user 0.016s	sys 0.002s
I20260709 13:10:03.573522 23551 raft_consensus.cc:359] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.574184 23551 raft_consensus.cc:385] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.573755 23182 catalog_manager.cc:5697] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.591188 23553 tablet_bootstrap.cc:654] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.605475 23959 raft_consensus.cc:493] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.605633 23669 consensus_queue.cc:1048] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.606032 23959 raft_consensus.cc:515] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.608105 23959 leader_election.cc:290] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:03.609794 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.610656 23669 consensus_queue.cc:1048] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:03.611214 23400 leader_election.cc:343] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.612097 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:10:03.613237 23399 leader_election.cc:343] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.613669 23399 leader_election.cc:304] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:03.614480 23959 raft_consensus.cc:2749] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.638765 23281 raft_consensus.cc:3060] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.574474 23551 raft_consensus.cc:740] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.643076 23808 consensus_queue.cc:1048] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.651415 23636 consensus_queue.cc:1048] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.643545 23551 consensus_queue.cc:260] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.671662 23559 raft_consensus.cc:493] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.672142 23559 raft_consensus.cc:515] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.673544 23553 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.673920 23559 leader_election.cc:290] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:03.674014 23553 ts_tablet_manager.cc:1403] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.003s
I20260709 13:10:03.675742 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:03.676043 23184 catalog_manager.cc:5697] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:03.677412 23399 leader_election.cc:343] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.678442 23553 raft_consensus.cc:359] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.679217 23553 raft_consensus.cc:385] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.679529 23553 raft_consensus.cc:740] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.680260 23553 consensus_queue.cc:260] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.683177 23553 ts_tablet_manager.cc:1434] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:03.684727 23636 raft_consensus.cc:493] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.685194 23636 raft_consensus.cc:515] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.686928 23636 leader_election.cc:290] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.689848 23553 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:03.694298 23434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.694952 23434 raft_consensus.cc:2468] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:03.697343 23901 raft_consensus.cc:493] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.697840 23901 raft_consensus.cc:515] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.700060 23901 leader_election.cc:290] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:03.700917 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:03.701537 23359 raft_consensus.cc:2468] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:03.701937 23802 raft_consensus.cc:493] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.702419 23802 raft_consensus.cc:515] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.702994 23473 leader_election.cc:304] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.703189 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.703725 23901 raft_consensus.cc:2804] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.704114 23901 raft_consensus.cc:493] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.704430 23901 raft_consensus.cc:3060] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.707443 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.708055 23430 raft_consensus.cc:2468] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
W20260709 13:10:03.704531 23474 leader_election.cc:343] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.709980 23324 leader_election.cc:304] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:03.710764 23904 raft_consensus.cc:2804] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.711112 23904 raft_consensus.cc:493] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.711437 23904 raft_consensus.cc:3060] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.715195 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:03.698207 23472 leader_election.cc:304] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.720391 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.721830 23912 raft_consensus.cc:2804] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.722185 23912 raft_consensus.cc:493] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.722510 23912 raft_consensus.cc:3060] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.725306 23851 consensus_queue.cc:1048] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.727059 23901 raft_consensus.cc:515] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.729050 23901 leader_election.cc:290] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:10:03.734969 23326 leader_election.cc:343] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.736132 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:03.704337 23802 leader_election.cc:290] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:10:03.747087 23474 leader_election.cc:343] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.720299 23551 ts_tablet_manager.cc:1434] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.150s	user 0.006s	sys 0.001s
I20260709 13:10:03.749490 23551 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
W20260709 13:10:03.749732 23474 consensus_peers.cc:597] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.756124 23473 leader_election.cc:343] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.757988 23551 tablet_bootstrap.cc:654] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.759375 23553 tablet_bootstrap.cc:654] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:03.761366 23473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.2:43361, user_credentials={real_user=slave}} blocked reactor thread for 44773us
I20260709 13:10:03.769851 23923 consensus_queue.cc:1048] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.773813 23838 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.774309 23838 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.775764 23551 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:03.776149 23553 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.776309 23838 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.776245 23551 ts_tablet_manager.cc:1403] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 13:10:03.776614 23553 ts_tablet_manager.cc:1403] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.002s
I20260709 13:10:03.782856 23551 raft_consensus.cc:359] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.781893 23553 raft_consensus.cc:359] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.783622 23551 raft_consensus.cc:385] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.784065 23551 raft_consensus.cc:740] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.784302 23553 raft_consensus.cc:385] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.785049 23553 raft_consensus.cc:740] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.783538 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.786108 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.784756 23551 consensus_queue.cc:260] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.786845 23553 consensus_queue.cc:260] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.788918 23551 ts_tablet_manager.cc:1434] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:03.787386 23326 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:03.790042 23551 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:03.691298 23555 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:03.790627 23555 ts_tablet_manager.cc:1403] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.302s	user 0.010s	sys 0.029s
I20260709 13:10:03.791977 23838 raft_consensus.cc:2749] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.796033 23360 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.797896 23553 ts_tablet_manager.cc:1434] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:10:03.799261 23553 tablet_bootstrap.cc:492] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:03.805279 23551 tablet_bootstrap.cc:654] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.809803 23901 raft_consensus.cc:493] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.810273 23901 raft_consensus.cc:515] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.812260 23901 leader_election.cc:290] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:03.813944 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ad643f490e4b029e3b1a87544df7e7" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.814582 23435 raft_consensus.cc:2468] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:03.815569 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ad643f490e4b029e3b1a87544df7e7" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:03.816388 23472 leader_election.cc:304] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.817147 23901 raft_consensus.cc:2804] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.817830 23901 raft_consensus.cc:493] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.818161 23901 raft_consensus.cc:3060] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.821426 23553 tablet_bootstrap.cc:654] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:03.828918 23474 leader_election.cc:343] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.768011 23904 raft_consensus.cc:515] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.833084 23551 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:03.833576 23551 ts_tablet_manager.cc:1403] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.015s
I20260709 13:10:03.836277 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:03.836215 23551 raft_consensus.cc:359] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.836903 23359 raft_consensus.cc:3060] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.837128 23553 tablet_bootstrap.cc:492] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.837719 23553 ts_tablet_manager.cc:1403] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.005s
I20260709 13:10:03.840283 23553 raft_consensus.cc:359] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.840893 23553 raft_consensus.cc:385] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.841140 23553 raft_consensus.cc:740] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.841789 23553 consensus_queue.cc:260] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.844982 23359 raft_consensus.cc:2468] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.836879 23551 raft_consensus.cc:385] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.845944 23551 raft_consensus.cc:740] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.846643 23551 consensus_queue.cc:260] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.848908 23551 ts_tablet_manager.cc:1434] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:03.849510 23916 consensus_queue.cc:1048] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.853312 23553 ts_tablet_manager.cc:1434] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:10:03.849764 23551 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:03.766110 23912 raft_consensus.cc:515] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.866207 23912 leader_election.cc:290] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.868203 23838 raft_consensus.cc:493] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.868566 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.868757 23838 raft_consensus.cc:515] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.869232 23435 raft_consensus.cc:3060] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.875417 23838 leader_election.cc:290] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:03.875589 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:03.878322 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:03.879117 23502 raft_consensus.cc:2393] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 690e3a11be554a93b36ec5017ed89787 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:10:03.880754 23324 leader_election.cc:304] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:03.881587 23551 tablet_bootstrap.cc:654] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.882378 23650 raft_consensus.cc:3060] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.887840 23553 tablet_bootstrap.cc:492] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:03.892246 23435 raft_consensus.cc:2468] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.893576 23472 leader_election.cc:304] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.893811 23650 raft_consensus.cc:2749] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.894367 23912 raft_consensus.cc:2804] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.894972 23912 raft_consensus.cc:697] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:03.895754 23912 consensus_queue.cc:237] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.901809 23904 leader_election.cc:290] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:03.901822 23553 tablet_bootstrap.cc:654] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.902697 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.903452 23435 raft_consensus.cc:3060] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.905342 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:03.909039 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:03.827443 23901 raft_consensus.cc:515] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.918237 23553 tablet_bootstrap.cc:492] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:03.918151 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ad643f490e4b029e3b1a87544df7e7" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:03.918756 23431 raft_consensus.cc:3060] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.920492 23361 raft_consensus.cc:2468] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.918737 23553 ts_tablet_manager.cc:1403] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.006s
I20260709 13:10:03.924664 23431 raft_consensus.cc:2468] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:03.925797 23472 leader_election.cc:304] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:03.926568 23635 raft_consensus.cc:2804] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.926983 23635 raft_consensus.cc:697] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:03.926864 23553 raft_consensus.cc:359] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.927539 23553 raft_consensus.cc:385] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.927840 23553 raft_consensus.cc:740] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.927780 23635 consensus_queue.cc:237] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:03.928751 23553 consensus_queue.cc:260] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:03.919780 23435 raft_consensus.cc:2468] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:03.931296 23553 ts_tablet_manager.cc:1434] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:03.931823 23324 leader_election.cc:304] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:03.932567 23838 raft_consensus.cc:2804] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.933076 23838 raft_consensus.cc:697] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:03.933890 23838 consensus_queue.cc:237] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:03.934381 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:03.932265 23553 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
W20260709 13:10:03.944465 23326 leader_election.cc:343] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.943526 23555 raft_consensus.cc:359] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:03.947881 23555 raft_consensus.cc:385] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.948146 23555 raft_consensus.cc:740] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.948789 23555 consensus_queue.cc:260] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:10:03.953670 23401 leader_election.cc:343] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.954146 23401 leader_election.cc:304] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:03.955603 23559 raft_consensus.cc:2749] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.957213 23553 tablet_bootstrap.cc:654] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.960779 23851 consensus_queue.cc:1048] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.972586 23901 leader_election.cc:290] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:04.002454 23636 consensus_queue.cc:1048] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.013238 23838 consensus_queue.cc:1048] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.028146 23473 leader_election.cc:304] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:04.030767 23669 raft_consensus.cc:2804] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.032552 23669 raft_consensus.cc:697] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:04.033367 23669 consensus_queue.cc:237] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.112021 23916 raft_consensus.cc:493] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.112583 23916 raft_consensus.cc:515] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.114662 23916 leader_election.cc:290] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:04.116606 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:04.121726 23181 catalog_manager.cc:5697] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.131718 23506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f593b2e24c4ec29a2710db6dbde323" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:04.133759 23252 leader_election.cc:304] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:04.134892 23916 raft_consensus.cc:2749] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.138420 23555 ts_tablet_manager.cc:1434] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.348s	user 0.006s	sys 0.000s
I20260709 13:10:04.159896 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ad643f490e4b029e3b1a87544df7e7" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:04.161461 23555 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:04.163192 23183 catalog_manager.cc:5697] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:04.165068 23473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:43361, user_credentials={real_user=slave}} blocked reactor thread for 134500us
I20260709 13:10:04.173941 23551 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:04.174913 23551 ts_tablet_manager.cc:1403] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.325s	user 0.047s	sys 0.044s
I20260709 13:10:04.177512 23551 raft_consensus.cc:359] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.178150 23551 raft_consensus.cc:385] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.178406 23551 raft_consensus.cc:740] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.179040 23551 consensus_queue.cc:260] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:10:04.180334 23977 log.cc:927] Time spent T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:10:04.184443 23984 log.cc:927] Time spent T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: Append to log took a long time: real 0.106s	user 0.008s	sys 0.017s
I20260709 13:10:04.186372 23838 raft_consensus.cc:493] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.186975 23838 raft_consensus.cc:515] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.192065 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6889af10f54526b070fa81c53b6b92" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:04.192672 23502 raft_consensus.cc:2468] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:04.193091 23551 ts_tablet_manager.cc:1434] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:10:04.194098 23551 tablet_bootstrap.cc:492] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:04.194291 23327 leader_election.cc:304] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:04.195098 23802 raft_consensus.cc:2804] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.195457 23802 raft_consensus.cc:493] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.195750 23802 raft_consensus.cc:3060] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.197078 23555 tablet_bootstrap.cc:654] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.205757 23802 raft_consensus.cc:515] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.208513 23838 leader_election.cc:290] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:04.208647 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6889af10f54526b070fa81c53b6b92" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:04.209209 23502 raft_consensus.cc:3060] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:04.211411 23474 leader_election.cc:343] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.215720 23502 raft_consensus.cc:2468] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:04.216645 23551 tablet_bootstrap.cc:654] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.216902 23327 leader_election.cc:304] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:04.217823 23838 raft_consensus.cc:2804] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.218827 23838 raft_consensus.cc:697] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:04.219478 23802 leader_election.cc:290] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:04.219605 23838 consensus_queue.cc:237] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.227679 23279 raft_consensus.cc:3060] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.229732 23553 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:04.230271 23553 ts_tablet_manager.cc:1403] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.298s	user 0.057s	sys 0.035s
I20260709 13:10:04.238773 23555 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:04.239254 23555 ts_tablet_manager.cc:1403] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.002s
I20260709 13:10:04.233234 23553 raft_consensus.cc:359] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:04.241700 23553 raft_consensus.cc:385] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.241991 23553 raft_consensus.cc:740] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.248093 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6889af10f54526b070fa81c53b6b92" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:04.255100 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6889af10f54526b070fa81c53b6b92" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:04.267261 23851 consensus_queue.cc:1048] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.274547 23555 raft_consensus.cc:359] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.275249 23555 raft_consensus.cc:385] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.275502 23555 raft_consensus.cc:740] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.277451 23551 tablet_bootstrap.cc:492] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:04.277935 23551 ts_tablet_manager.cc:1403] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.012s
I20260709 13:10:04.279299 23555 consensus_queue.cc:260] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:10:04.284909 23326 leader_election.cc:343] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.266542 23553 consensus_queue.cc:260] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:04.287820 23231 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:04.288560 23553 ts_tablet_manager.cc:1434] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:10:04.289258 23904 consensus_queue.cc:1048] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:04.288656 23326 leader_election.cc:343] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.297724 23553 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787: Bootstrap starting.
I20260709 13:10:04.299299 23555 ts_tablet_manager.cc:1434] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 13:10:04.301721 23551 raft_consensus.cc:359] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:04.302393 23551 raft_consensus.cc:385] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.302656 23551 raft_consensus.cc:740] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.303771 23553 tablet_bootstrap.cc:654] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.303661 23182 catalog_manager.cc:5697] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.309818 23916 raft_consensus.cc:493] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.310333 23555 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:04.310281 23916 raft_consensus.cc:515] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.313367 23916 leader_election.cc:290] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:04.314342 23802 raft_consensus.cc:493] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.314791 23802 raft_consensus.cc:515] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:04.314862 23551 consensus_queue.cc:260] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:04.315882 23636 consensus_queue.cc:1048] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.314903 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:04.316779 23802 leader_election.cc:290] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:04.323197 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:04.323833 23501 raft_consensus.cc:2468] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:04.323974 23551 ts_tablet_manager.cc:1434] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:10:04.324966 23551 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d: Bootstrap starting.
I20260709 13:10:04.327710 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:04.328299 23435 raft_consensus.cc:2468] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:04.328487 23327 leader_election.cc:304] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:04.327495 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:04.329653 23360 raft_consensus.cc:2393] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:10:04.329715 23838 raft_consensus.cc:2804] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.330825 23250 leader_election.cc:304] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:04.331467 23555 tablet_bootstrap.cc:654] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.330235 23838 raft_consensus.cc:493] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.332134 23838 raft_consensus.cc:3060] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.332296 23916 raft_consensus.cc:3060] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.335723 23181 catalog_manager.cc:5697] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.338377 23181 catalog_manager.cc:5697] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.341863 23916 raft_consensus.cc:2749] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.340035 23181 catalog_manager.cc:5697] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.344668 23838 raft_consensus.cc:515] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:04.347226 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:04.347761 23435 raft_consensus.cc:3060] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.350775 23636 raft_consensus.cc:493] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.351281 23551 tablet_bootstrap.cc:654] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.351193 23636 raft_consensus.cc:515] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.353577 23636 leader_election.cc:290] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:04.354192 23435 raft_consensus.cc:2468] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:04.354919 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:04.355304 23324 leader_election.cc:304] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:04.356467 23802 raft_consensus.cc:2804] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.356974 23802 raft_consensus.cc:697] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:04.357977 23802 consensus_queue.cc:237] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
W20260709 13:10:04.364382 23473 leader_election.cc:343] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.366679 23838 leader_election.cc:290] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:04.367175 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:04.367779 23502 raft_consensus.cc:3060] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.372328 23553 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787: No bootstrap required, opened a new log
I20260709 13:10:04.372859 23553 ts_tablet_manager.cc:1403] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787: Time spent bootstrapping tablet: real 0.075s	user 0.007s	sys 0.009s
I20260709 13:10:04.375378 23551 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d: No bootstrap required, opened a new log
I20260709 13:10:04.376004 23551 ts_tablet_manager.cc:1403] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 13:10:04.375391 23553 raft_consensus.cc:359] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.376436 23553 raft_consensus.cc:385] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.376747 23553 raft_consensus.cc:740] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.377547 23553 consensus_queue.cc:260] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.379666 23553 ts_tablet_manager.cc:1434] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:04.381785 23502 raft_consensus.cc:2468] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:04.385421 23551 raft_consensus.cc:359] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.387362 23551 raft_consensus.cc:385] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:04.388484 23326 consensus_peers.cc:597] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.387616 23551 raft_consensus.cc:740] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.389315 23182 catalog_manager.cc:5697] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.389734 23551 consensus_queue.cc:260] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.393626 23551 ts_tablet_manager.cc:1434] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:10:04.394635 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:04.397150 23636 consensus_queue.cc:1048] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:04.399092 23474 leader_election.cc:343] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.400233 23474 leader_election.cc:304] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:04.401360 23636 raft_consensus.cc:2749] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.417876 23802 raft_consensus.cc:493] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.418462 23802 raft_consensus.cc:515] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:04.420534 23802 leader_election.cc:290] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:04.421880 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:04.422531 23431 raft_consensus.cc:2468] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:04.424069 23324 leader_election.cc:304] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:04.424779 23802 raft_consensus.cc:2804] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.425144 23802 raft_consensus.cc:493] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.425447 23802 raft_consensus.cc:3060] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.425838 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
W20260709 13:10:04.426983 23326 leader_election.cc:343] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.426658 23555 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:04.428155 23555 ts_tablet_manager.cc:1403] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.012s
I20260709 13:10:04.431233 23555 raft_consensus.cc:359] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.432008 23636 consensus_queue.cc:1048] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.431878 23555 raft_consensus.cc:385] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.433764 23555 raft_consensus.cc:740] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.434461 23555 consensus_queue.cc:260] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.436636 23555 ts_tablet_manager.cc:1434] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:04.437471 23555 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:04.437367 23838 consensus_queue.cc:1048] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.437930 23904 raft_consensus.cc:493] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.438398 23904 raft_consensus.cc:515] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.440405 23904 leader_election.cc:290] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:04.443750 23802 raft_consensus.cc:515] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:04.448824 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:04.450496 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:04.451028 23502 raft_consensus.cc:2468] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 0.
I20260709 13:10:04.459304 23327 leader_election.cc:304] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:04.460961 23802 leader_election.cc:290] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:04.462237 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:04.462805 23435 raft_consensus.cc:3060] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.461455 23904 raft_consensus.cc:2804] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.464210 23904 raft_consensus.cc:493] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.464397 23279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
W20260709 13:10:04.462853 23326 leader_election.cc:343] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:04.469199 23326 leader_election.cc:343] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.469681 23904 raft_consensus.cc:3060] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.471354 23555 tablet_bootstrap.cc:654] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.482899 23904 raft_consensus.cc:515] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.484720 23904 leader_election.cc:290] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:04.478657 23435 raft_consensus.cc:2468] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:04.485409 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:04.485982 23502 raft_consensus.cc:3060] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.490196 23324 leader_election.cc:304] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:04.491874 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
I20260709 13:10:04.492048 23502 raft_consensus.cc:2468] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:04.493204 23327 leader_election.cc:304] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:04.493541 23904 raft_consensus.cc:2804] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:04.493938 23326 leader_election.cc:343] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.494699 23904 raft_consensus.cc:697] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:04.495549 23904 consensus_queue.cc:237] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:04.501070 23851 consensus_queue.cc:1048] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.493927 23802 raft_consensus.cc:2804] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.493763 23555 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:04.503057 23555 ts_tablet_manager.cc:1403] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.005s
I20260709 13:10:04.503772 23802 raft_consensus.cc:697] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:04.504573 23802 consensus_queue.cc:237] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.510413 23555 raft_consensus.cc:359] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:04.511126 23555 raft_consensus.cc:385] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.511377 23555 raft_consensus.cc:740] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.515816 23555 consensus_queue.cc:260] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:04.518090 23474 consensus_peers.cc:597] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.520041 23555 ts_tablet_manager.cc:1434] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:04.521507 23555 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:04.531499 23912 consensus_queue.cc:1048] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:04.551716 23555 tablet_bootstrap.cc:654] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.551250 23184 catalog_manager.cc:5697] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.580701 23923 raft_consensus.cc:493] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.581157 23923 raft_consensus.cc:515] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.583773 23923 leader_election.cc:290] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:04.584093 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:04.585256 23555 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:04.585755 23555 ts_tablet_manager.cc:1403] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.010s
I20260709 13:10:04.586089 23851 raft_consensus.cc:493] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.586269 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b3b6fe106647af871885230d191f65" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:04.586712 23851 raft_consensus.cc:515] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.587554 23252 leader_election.cc:304] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:04.588304 23555 raft_consensus.cc:359] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.588973 23555 raft_consensus.cc:385] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.589221 23555 raft_consensus.cc:740] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.589823 23555 consensus_queue.cc:260] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.591261 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8" is_pre_election: true
I20260709 13:10:04.592020 23555 ts_tablet_manager.cc:1434] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
W20260709 13:10:04.592677 23474 leader_election.cc:343] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.592932 23555 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:04.588397 23923 raft_consensus.cc:2749] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.595943 23851 leader_election.cc:290] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:04.602751 23555 tablet_bootstrap.cc:654] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.607100 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:04.607618 23435 raft_consensus.cc:2468] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 0.
I20260709 13:10:04.607851 23555 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:04.608359 23555 ts_tablet_manager.cc:1403] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:10:04.611140 23555 raft_consensus.cc:359] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.611758 23555 raft_consensus.cc:385] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.612021 23555 raft_consensus.cc:740] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.612712 23555 consensus_queue.cc:260] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.614617 23555 ts_tablet_manager.cc:1434] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:04.615846 23555 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:04.617897 23183 catalog_manager.cc:5697] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 0 to 1, leader changed from <none> to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.621043 23555 tablet_bootstrap.cc:654] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.628077 23472 leader_election.cc:304] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:04.629068 23912 raft_consensus.cc:2804] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.629424 23912 raft_consensus.cc:493] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.629737 23912 raft_consensus.cc:3060] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.638404 23912 raft_consensus.cc:515] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.641572 23912 leader_election.cc:290] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:04.642098 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
W20260709 13:10:04.643501 23474 leader_election.cc:343] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.645352 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:04.645931 23431 raft_consensus.cc:3060] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.648228 23555 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:04.648711 23555 ts_tablet_manager.cc:1403] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.006s
I20260709 13:10:04.651201 23555 raft_consensus.cc:359] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.651832 23555 raft_consensus.cc:385] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.652076 23555 raft_consensus.cc:740] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.652874 23555 consensus_queue.cc:260] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:04.655026 23555 ts_tablet_manager.cc:1434] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:04.655889 23555 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:04.656461 23431 raft_consensus.cc:2468] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:04.657516 23472 leader_election.cc:304] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:04.659756 23912 raft_consensus.cc:2804] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.661685 23555 tablet_bootstrap.cc:654] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.669714 23912 raft_consensus.cc:697] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:04.672438 23912 consensus_queue.cc:237] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.674608 23555 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:04.783809 23555 ts_tablet_manager.cc:1403] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.009s
I20260709 13:10:04.822847 23285 raft_consensus.cc:3060] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.824769 23555 raft_consensus.cc:359] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:04.825505 23555 raft_consensus.cc:385] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.825776 23555 raft_consensus.cc:740] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.826411 23555 consensus_queue.cc:260] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:04.852762 23324 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:38025, user_credentials={real_user=slave}} blocked reactor thread for 53100.5us
I20260709 13:10:04.865206 23650 consensus_queue.cc:1048] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.865399 23838 consensus_queue.cc:1048] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.900633 23555 ts_tablet_manager.cc:1434] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.116s	user 0.011s	sys 0.013s
W20260709 13:10:04.939620 23250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:43361, user_credentials={real_user=slave}} blocked reactor thread for 127346us
I20260709 13:10:04.943877 23281 raft_consensus.cc:3060] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.999902 23650 consensus_queue.cc:1048] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.002058 23650 consensus_queue.cc:1048] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:05.005908 23923 raft_consensus.cc:493] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.008249 23923 raft_consensus.cc:515] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:05.022930 24013 consensus_queue.cc:1048] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.023936 24012 consensus_queue.cc:1048] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.029543 24014 raft_consensus.cc:493] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.030294 23282 raft_consensus.cc:3060] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:05.035224 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:05.030288 24014 raft_consensus.cc:515] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:05.037633 23555 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:05.013332 23923 leader_election.cc:290] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:05.038558 24014 leader_election.cc:290] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:05.057765 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:05.093513 23278 raft_consensus.cc:3060] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:05.137401 23184 catalog_manager.cc:5697] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 0 to 1, leader changed from <none> to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 1 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.147833 24019 raft_consensus.cc:493] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.152184 23401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:38341, user_credentials={real_user=slave}} blocked reactor thread for 54162.4us
W20260709 13:10:05.155505 23326 consensus_peers.cc:597] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.149019 24019 raft_consensus.cc:515] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:05.174198 24019 leader_election.cc:290] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:05.177256 23555 tablet_bootstrap.cc:654] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:05.177393 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedf4afe97a74466b70b3190f1c0c1de" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:05.193861 23283 raft_consensus.cc:3060] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:05.242033 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:05.243944 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:05.258291 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56283a2404464c0bb214e90b06fdea8c" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:05.260079 23435 raft_consensus.cc:2393] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e56d4fa89a4e41fb99476c088544e8b8 in current term 1: Already voted for candidate e971a25f8dfb42fcb1afb9ecf74f760d in this term.
I20260709 13:10:05.273567 23635 consensus_queue.cc:1048] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.281035 23252 leader_election.cc:304] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:05.282148 24014 raft_consensus.cc:2749] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:05.298390 23249 leader_election.cc:304] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787
W20260709 13:10:05.299611 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.6.3:38025, user_credentials={real_user=slave}} blocked reactor thread for 96681.8us
I20260709 13:10:05.320052 23650 consensus_queue.cc:1048] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:05.324084 23249 leader_election.cc:304] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:05.325845 24016 raft_consensus.cc:3060] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:05.335294 23555 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: No bootstrap required, opened a new log
I20260709 13:10:05.335872 23555 ts_tablet_manager.cc:1403] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.299s	user 0.015s	sys 0.016s
I20260709 13:10:05.343931 23555 raft_consensus.cc:359] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:05.351905 23555 raft_consensus.cc:385] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:05.364244 24016 raft_consensus.cc:2749] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:05.365396 23555 raft_consensus.cc:740] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:05.375960 23555 consensus_queue.cc:260] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:05.400739 23555 ts_tablet_manager.cc:1434] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:10:05.409984 24011 raft_consensus.cc:493] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.410583 24011 raft_consensus.cc:515] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:05.415438 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:05.416033 23636 consensus_queue.cc:1048] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.412883 24011 leader_election.cc:290] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:05.433311 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:05.436208 24019 raft_consensus.cc:2749] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:05.455034 23249 leader_election.cc:304] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8; no voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:05.466276 24019 raft_consensus.cc:2749] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:05.485457 23282 raft_consensus.cc:3060] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.263413 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
W20260709 13:10:06.275336 23326 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:10:06.281092 23326 consensus_peers.cc:597] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.292096 23474 consensus_peers.cc:597] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.294765 23474 consensus_peers.cc:597] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.323289 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:06.323571 23400 consensus_peers.cc:597] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.324456 15384 tablet_replica.cc:333] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.325414 15384 raft_consensus.cc:2243] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.325946 15384 raft_consensus.cc:2272] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.328962 15384 tablet_replica.cc:333] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.329793 15384 raft_consensus.cc:2243] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.330302 15384 raft_consensus.cc:2272] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.333158 15384 tablet_replica.cc:333] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.333974 15384 raft_consensus.cc:2243] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.334437 15384 raft_consensus.cc:2272] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.336988 15384 tablet_replica.cc:333] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.337702 15384 raft_consensus.cc:2243] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.338363 15384 raft_consensus.cc:2272] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.341452 15384 tablet_replica.cc:333] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.342420 15384 raft_consensus.cc:2243] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.342970 15384 raft_consensus.cc:2272] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.343621 23474 consensus_peers.cc:597] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.346168 15384 tablet_replica.cc:333] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.346882 15384 raft_consensus.cc:2243] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.347319 15384 raft_consensus.cc:2272] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.349541 15384 tablet_replica.cc:333] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.350351 15384 raft_consensus.cc:2243] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.351565 15384 raft_consensus.cc:2272] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.356415 15384 tablet_replica.cc:333] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.357183 15384 raft_consensus.cc:2243] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.357764 15384 raft_consensus.cc:2272] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.359519 23474 consensus_peers.cc:597] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.360430 15384 tablet_replica.cc:333] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.361474 15384 raft_consensus.cc:2243] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.363176 15384 raft_consensus.cc:2272] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.365720 15384 tablet_replica.cc:333] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.366298 15384 raft_consensus.cc:2243] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.366719 15384 raft_consensus.cc:2272] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.368887 15384 tablet_replica.cc:333] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.369540 15384 raft_consensus.cc:2243] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.369993 15384 raft_consensus.cc:2272] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.372396 15384 tablet_replica.cc:333] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.373209 15384 raft_consensus.cc:2243] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.373668 15384 raft_consensus.cc:2272] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.375972 15384 tablet_replica.cc:333] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.376574 15384 raft_consensus.cc:2243] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.377065 15384 raft_consensus.cc:2272] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.379642 23474 consensus_peers.cc:597] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.379813 15384 tablet_replica.cc:333] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.380602 15384 raft_consensus.cc:2243] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.381078 15384 raft_consensus.cc:2272] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.383590 15384 tablet_replica.cc:333] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.384200 15384 raft_consensus.cc:2243] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.384606 15384 raft_consensus.cc:2272] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.387156 15384 tablet_replica.cc:333] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.387914 15384 raft_consensus.cc:2243] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.388358 15384 raft_consensus.cc:2272] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.392928 15384 tablet_replica.cc:333] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.393574 15384 raft_consensus.cc:2243] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.394546 15384 raft_consensus.cc:2272] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.396763 15384 tablet_replica.cc:333] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.397305 15384 raft_consensus.cc:2243] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.397732 15384 raft_consensus.cc:2272] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.400177 15384 tablet_replica.cc:333] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.400727 15384 raft_consensus.cc:2243] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.401688 15384 raft_consensus.cc:2272] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.404023 15384 tablet_replica.cc:333] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.404878 15384 raft_consensus.cc:2243] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.405431 15384 raft_consensus.cc:2272] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.407784 23326 consensus_peers.cc:597] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.408308 15384 tablet_replica.cc:333] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.409149 15384 raft_consensus.cc:2243] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.409648 15384 raft_consensus.cc:2272] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.412178 15384 tablet_replica.cc:333] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.412815 15384 raft_consensus.cc:2243] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.413228 15384 raft_consensus.cc:2272] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.415575 15384 tablet_replica.cc:333] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.416124 15384 raft_consensus.cc:2243] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.416553 15384 raft_consensus.cc:2272] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.418480 15384 tablet_replica.cc:333] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.419063 15384 raft_consensus.cc:2243] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.419484 15384 raft_consensus.cc:2272] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.421566 15384 tablet_replica.cc:333] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.422083 15384 raft_consensus.cc:2243] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.422458 15384 raft_consensus.cc:2272] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.425025 15384 tablet_replica.cc:333] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.425666 15384 raft_consensus.cc:2243] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.426514 15384 raft_consensus.cc:2272] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.429116 15384 tablet_replica.cc:333] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.429590 15384 raft_consensus.cc:2243] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.430032 15384 raft_consensus.cc:2272] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.432642 15384 tablet_replica.cc:333] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.433358 15384 raft_consensus.cc:2243] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.433825 15384 raft_consensus.cc:2272] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.436626 15384 tablet_replica.cc:333] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.437322 15384 raft_consensus.cc:2243] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.437875 15384 raft_consensus.cc:2272] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.440984 15384 tablet_replica.cc:333] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.441766 15384 raft_consensus.cc:2243] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.442764 15384 raft_consensus.cc:2272] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.445070 15384 tablet_replica.cc:333] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.445708 15384 raft_consensus.cc:2243] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.446194 15384 raft_consensus.cc:2272] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.448400 23474 consensus_peers.cc:597] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.448997 15384 tablet_replica.cc:333] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
W20260709 13:10:06.449116 23474 consensus_peers.cc:597] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.449879 15384 raft_consensus.cc:2243] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.450400 15384 raft_consensus.cc:2272] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.453428 15384 tablet_replica.cc:333] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.454185 15384 raft_consensus.cc:2243] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.454753 15384 raft_consensus.cc:2272] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.457743 15384 tablet_replica.cc:333] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.458453 15384 raft_consensus.cc:2243] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.458992 15384 raft_consensus.cc:2272] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.461738 15384 tablet_replica.cc:333] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.462675 15384 raft_consensus.cc:2243] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.463716 15384 raft_consensus.cc:2272] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.464934 23326 consensus_peers.cc:597] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.466343 15384 tablet_replica.cc:333] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.467132 15384 raft_consensus.cc:2243] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.468195 15384 raft_consensus.cc:2272] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.470901 15384 tablet_replica.cc:333] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.471593 15384 raft_consensus.cc:2243] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:06.461690 23474 consensus_peers.cc:597] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.472432 23474 consensus_peers.cc:597] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.472697 15384 raft_consensus.cc:2272] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.474749 23474 consensus_peers.cc:597] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.475404 15384 tablet_replica.cc:333] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.476051 15384 raft_consensus.cc:2243] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.476497 15384 raft_consensus.cc:2272] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.479076 15384 tablet_replica.cc:333] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.479631 15384 raft_consensus.cc:2243] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.480177 15384 raft_consensus.cc:2272] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.482746 15384 tablet_replica.cc:333] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.483425 15384 raft_consensus.cc:2243] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.483912 15384 raft_consensus.cc:2272] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.486718 15384 tablet_replica.cc:333] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
W20260709 13:10:06.486739 23474 consensus_peers.cc:597] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.487396 15384 raft_consensus.cc:2243] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.488006 15384 raft_consensus.cc:2272] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.490916 15384 tablet_replica.cc:333] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
W20260709 13:10:06.491535 23326 consensus_peers.cc:597] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.491573 15384 raft_consensus.cc:2243] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.492455 15384 raft_consensus.cc:2272] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.495193 23326 consensus_peers.cc:597] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.495450 15384 tablet_replica.cc:333] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.496188 15384 raft_consensus.cc:2243] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.496728 15384 raft_consensus.cc:2272] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.499321 15384 tablet_replica.cc:333] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.499958 15384 raft_consensus.cc:2243] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.500468 15384 raft_consensus.cc:2272] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.502982 15384 tablet_replica.cc:333] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: stopping tablet replica
I20260709 13:10:06.503445 15384 raft_consensus.cc:2243] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.504441 15384 raft_consensus.cc:2272] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.505730 23474 consensus_peers.cc:597] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.525842 23326 consensus_peers.cc:597] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.541816 23326 consensus_peers.cc:597] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.555155 23326 consensus_peers.cc:597] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.582700 23474 consensus_peers.cc:597] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.583245 23400 consensus_peers.cc:597] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.608142 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
W20260709 13:10:06.622109 23326 consensus_peers.cc:597] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.622260 23474 consensus_peers.cc:597] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.625197 23326 consensus_peers.cc:597] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.627259 23400 consensus_peers.cc:597] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.632032 23400 consensus_peers.cc:597] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.651645 23400 consensus_peers.cc:597] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.655153 23400 consensus_peers.cc:597] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.679630 23474 consensus_peers.cc:597] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.688467 23326 consensus_peers.cc:597] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.712606 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:06.720170 23326 consensus_peers.cc:597] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.721309 24052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.734356 24053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.737215 23400 consensus_peers.cc:597] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.738888 24055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:06.740284 15384 server_base.cc:1061] running on GCE node
W20260709 13:10:06.743775 23326 consensus_peers.cc:597] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.744984 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:06.745236 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:06.745417 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602606745398 us; error 0 us; skew 500 ppm
I20260709 13:10:06.746006 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:06.760667 15384 webserver.cc:533] Webserver started at http://127.15.6.1:35021/ using document root <none> and password file <none>
I20260709 13:10:06.761315 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:06.761569 15384 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:06.767047 15384 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
W20260709 13:10:06.792407 23400 consensus_peers.cc:597] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.795104 24061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.796028 15384 fs_manager.cc:730] Time spent opening block manager: real 0.013s	user 0.002s	sys 0.008s
I20260709 13:10:06.796380 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "e56d4fa89a4e41fb99476c088544e8b8"
format_stamp: "Formatted at 2026-07-09 13:09:52 on dist-test-slave-pqzm"
I20260709 13:10:06.796761 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:10:06.823587 23326 consensus_peers.cc:597] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.827489 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:06.828857 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:06.830361 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:06.859947 24068 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:10:07.122653 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:10:07.122928 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.287s	user 0.009s	sys 0.019s
I20260709 13:10:07.123238 15384 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:10:07.127344 24068 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.148034 24068 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.149024 24068 tablet_bootstrap.cc:492] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.149611 24068 ts_tablet_manager.cc:1403] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:10:07.152086 24068 raft_consensus.cc:359] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.152724 24068 raft_consensus.cc:740] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.153528 24068 consensus_queue.cc:260] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.218936 24068 ts_tablet_manager.cc:1434] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.069s	user 0.030s	sys 0.040s
I20260709 13:10:07.219748 24068 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.239704 24068 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.240595 24068 tablet_bootstrap.cc:492] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.241186 24068 ts_tablet_manager.cc:1403] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:10:07.243441 24068 raft_consensus.cc:359] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.244099 24068 raft_consensus.cc:740] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.244912 24068 consensus_queue.cc:260] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.246603 24068 ts_tablet_manager.cc:1434] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:07.247315 24068 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.258533 24068 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.259181 24068 tablet_bootstrap.cc:492] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.259622 24068 ts_tablet_manager.cc:1403] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:07.261713 24068 raft_consensus.cc:359] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.262311 24068 raft_consensus.cc:740] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.263013 24068 consensus_queue.cc:260] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.264919 24068 ts_tablet_manager.cc:1434] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:10:07.265638 24068 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.417734 23636 raft_consensus.cc:493] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.418279 23636 raft_consensus.cc:515] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.420162 23636 leader_election.cc:290] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:07.423199 24068 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.424116 24068 tablet_bootstrap.cc:492] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.424721 24068 ts_tablet_manager.cc:1403] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.159s	user 0.059s	sys 0.082s
I20260709 13:10:07.427155 24068 raft_consensus.cc:359] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.427735 24068 raft_consensus.cc:740] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
W20260709 13:10:07.428027 23474 leader_election.cc:336] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.428378 24068 consensus_queue.cc:260] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.430274 24068 ts_tablet_manager.cc:1434] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:07.430987 24068 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.437971 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:07.440205 23473 leader_election.cc:304] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.441910 23912 raft_consensus.cc:2749] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.462643 24068 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.463336 24068 tablet_bootstrap.cc:492] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.463901 24068 ts_tablet_manager.cc:1403] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.003s
I20260709 13:10:07.466302 24068 raft_consensus.cc:359] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.466909 24068 raft_consensus.cc:740] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.467592 24068 consensus_queue.cc:260] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.469238 24068 ts_tablet_manager.cc:1434] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:07.469939 24068 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.478777 23912 raft_consensus.cc:493] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.480166 23912 raft_consensus.cc:515] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.483336 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:07.490520 24068 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.491367 24068 tablet_bootstrap.cc:492] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.491997 24068 ts_tablet_manager.cc:1403] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 13:10:07.494290 24068 raft_consensus.cc:359] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.494871 24068 raft_consensus.cc:740] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.500295 24068 consensus_queue.cc:260] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.502475 24068 ts_tablet_manager.cc:1434] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:07.503156 24068 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:07.515714 23474 leader_election.cc:336] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.516664 23474 leader_election.cc:304] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.517988 23636 raft_consensus.cc:2749] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.516215 23912 leader_election.cc:290] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:07.526021 24068 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.526728 24068 tablet_bootstrap.cc:492] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.527243 24068 ts_tablet_manager.cc:1403] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 13:10:07.528949 24068 raft_consensus.cc:359] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.529384 24068 raft_consensus.cc:740] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.529897 24068 consensus_queue.cc:260] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.531433 24068 ts_tablet_manager.cc:1434] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:07.532145 24068 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.543147 24078 raft_consensus.cc:493] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.543716 24078 raft_consensus.cc:515] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.548097 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:07.549806 24078 leader_election.cc:290] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:10:07.549820 23326 leader_election.cc:336] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.550812 23326 leader_election.cc:304] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.551916 24078 raft_consensus.cc:2749] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.555318 24068 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.556226 24068 tablet_bootstrap.cc:492] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.556806 24068 ts_tablet_manager.cc:1403] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:10:07.559128 24068 raft_consensus.cc:359] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.559728 24068 raft_consensus.cc:740] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.560597 24068 consensus_queue.cc:260] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.562634 24068 ts_tablet_manager.cc:1434] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:07.563324 24068 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.573982 15384 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:10:07.574319 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.451s	user 0.223s	sys 0.009s
I20260709 13:10:07.591095 24068 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.592012 24068 tablet_bootstrap.cc:492] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.592598 24068 ts_tablet_manager.cc:1403] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 13:10:07.595906 24068 raft_consensus.cc:359] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.596522 24068 raft_consensus.cc:740] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.597240 24068 consensus_queue.cc:260] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.599406 24068 ts_tablet_manager.cc:1434] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:07.600106 24068 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.608708 24076 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.609369 24076 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.612600 24068 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.614634 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:07.614784 24076 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
W20260709 13:10:07.618649 23400 leader_election.cc:336] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.619107 23400 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d
I20260709 13:10:07.620404 24076 raft_consensus.cc:2749] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.620946 24078 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.621466 24078 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.624328 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:07.620644 24059 raft_consensus.cc:493] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.643010 24059 raft_consensus.cc:515] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.645125 24059 leader_election.cc:290] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:07.651276 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
W20260709 13:10:07.654868 23400 leader_election.cc:336] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.655272 23400 leader_election.cc:304] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.656327 24059 raft_consensus.cc:2749] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.657011 24078 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
W20260709 13:10:07.658392 23326 leader_election.cc:336] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.658867 23326 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.660928 24078 raft_consensus.cc:2749] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.668876 24068 tablet_bootstrap.cc:492] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.669615 24068 ts_tablet_manager.cc:1403] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.004s
I20260709 13:10:07.670955 24078 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.672140 24078 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:07.679961 23326 leader_election.cc:336] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.681516 24078 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:07.690157 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:07.691532 23324 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.692274 24078 raft_consensus.cc:2749] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.694309 24078 raft_consensus.cc:493] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.694782 24078 raft_consensus.cc:515] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.672941 24068 raft_consensus.cc:359] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.696134 24068 raft_consensus.cc:740] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.696986 24068 consensus_queue.cc:260] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:07.704727 23326 leader_election.cc:336] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.709546 24078 leader_election.cc:290] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:07.710557 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:07.711272 23430 raft_consensus.cc:2468] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:07.712448 23324 leader_election.cc:304] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.713173 24078 raft_consensus.cc:2804] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.713616 24078 raft_consensus.cc:493] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.714025 24078 raft_consensus.cc:3060] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.716923 24068 ts_tablet_manager.cc:1434] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:10:07.717757 24068 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:07.731626 24078 raft_consensus.cc:515] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.734706 24068 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.735577 24068 tablet_bootstrap.cc:492] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.736362 24059 raft_consensus.cc:493] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.736897 24059 raft_consensus.cc:515] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.738852 24059 leader_election.cc:290] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:10:07.739919 23326 leader_election.cc:336] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.740767 24078 leader_election.cc:290] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:07.741717 24068 ts_tablet_manager.cc:1403] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 13:10:07.742667 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:07.744146 23430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f687663b31c40fea5a41eff18c7b6d5" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:07.744700 23430 raft_consensus.cc:3060] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.744580 24068 raft_consensus.cc:359] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.746731 24068 raft_consensus.cc:740] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.747555 24068 consensus_queue.cc:260] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.750854 24068 ts_tablet_manager.cc:1434] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:07.751653 24068 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:07.753999 23400 leader_election.cc:336] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.759851 23400 leader_election.cc:304] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.761422 24076 raft_consensus.cc:2749] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.768296 23430 raft_consensus.cc:2468] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:10:07.769516 23324 leader_election.cc:304] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.770241 24078 raft_consensus.cc:2804] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.770742 24078 raft_consensus.cc:697] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:07.771687 24078 consensus_queue.cc:237] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.772692 24059 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.773259 24059 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.776051 24059 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:07.779341 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:07.779954 23356 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:10:07.783221 23399 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:07.786160 24076 raft_consensus.cc:2804] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.786559 24076 raft_consensus.cc:493] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.786646 24043 raft_consensus.cc:493] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.787043 24076 raft_consensus.cc:3060] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.787163 24043 raft_consensus.cc:515] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.790587 24043 leader_election.cc:290] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:07.792320 24077 raft_consensus.cc:493] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.792815 24077 raft_consensus.cc:515] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.794790 24077 leader_election.cc:290] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:07.796164 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:07.796818 23501 raft_consensus.cc:2468] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:07.797696 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:07.798257 23356 raft_consensus.cc:2468] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:10:07.799535 23327 leader_election.cc:304] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:07.800328 24077 raft_consensus.cc:2804] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.800712 24077 raft_consensus.cc:493] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.801424 24077 raft_consensus.cc:3060] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.800805 23184 catalog_manager.cc:5697] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:07.803941 23326 leader_election.cc:336] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.808367 23399 leader_election.cc:304] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:07.813598 23904 raft_consensus.cc:493] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
W20260709 13:10:07.813756 23400 leader_election.cc:336] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.814257 23904 raft_consensus.cc:515] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.816493 23904 leader_election.cc:290] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:07.818367 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" is_pre_election: true
I20260709 13:10:07.819070 23501 raft_consensus.cc:2468] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:07.820317 23327 leader_election.cc:304] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:07.821235 24048 raft_consensus.cc:2804] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.821610 24048 raft_consensus.cc:493] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.821954 24048 raft_consensus.cc:3060] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:07.814743 23400 leader_election.cc:336] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.824350 23636 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.824872 23636 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.826309 24077 raft_consensus.cc:515] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.826752 23636 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:07.828608 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:07.829180 23431 raft_consensus.cc:2468] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 1.
I20260709 13:10:07.830293 23472 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:07.831110 23669 raft_consensus.cc:2804] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.831418 23669 raft_consensus.cc:493] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
W20260709 13:10:07.831445 23474 leader_election.cc:336] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.831858 23669 raft_consensus.cc:3060] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.842120 24059 raft_consensus.cc:2804] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.845140 23669 raft_consensus.cc:515] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.847497 23669 leader_election.cc:290] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:07.847848 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106c7f82b57a430e8e9c9d0c209d5a5a" candidate_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:07.849843 23431 raft_consensus.cc:3060] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.851207 24077 leader_election.cc:290] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:07.848371 24068 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.854564 24048 raft_consensus.cc:515] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.848404 23904 raft_consensus.cc:493] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.847517 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2603a30eb24f32a97306bcfe46d1ec" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
W20260709 13:10:07.852607 23474 leader_election.cc:336] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.856040 23501 raft_consensus.cc:3060] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:07.869833 23326 leader_election.cc:336] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.855774 23904 raft_consensus.cc:515] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.874045 23904 leader_election.cc:290] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:07.875041 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5" is_pre_election: true
I20260709 13:10:07.875626 23435 raft_consensus.cc:2468] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 1.
I20260709 13:10:07.878028 23324 leader_election.cc:304] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:07.845599 24059 raft_consensus.cc:493] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.879256 24059 raft_consensus.cc:3060] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.881251 24077 raft_consensus.cc:2804] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.881675 24077 raft_consensus.cc:493] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.882025 24077 raft_consensus.cc:3060] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:07.884162 23326 leader_election.cc:336] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.885830 24048 leader_election.cc:290] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:07.887322 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc99a8f26574b5e9d7a7d91000bf4a2" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:07.887907 23502 raft_consensus.cc:3060] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.893114 24076 raft_consensus.cc:515] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.895051 24076 leader_election.cc:290] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:07.895064 23502 raft_consensus.cc:2468] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:10:07.899117 24068 tablet_bootstrap.cc:492] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:07.899927 24068 ts_tablet_manager.cc:1403] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.148s	user 0.029s	sys 0.015s
I20260709 13:10:07.900338 23431 raft_consensus.cc:2468] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e971a25f8dfb42fcb1afb9ecf74f760d in term 2.
I20260709 13:10:07.905635 23472 leader_election.cc:304] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.901782 24077 raft_consensus.cc:515] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.907299 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca9f11103cd4818baf567c36c6d7ce7" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:07.907277 23327 leader_election.cc:304] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:07.907709 23669 raft_consensus.cc:2804] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.909788 23669 raft_consensus.cc:697] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Becoming Leader. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:07.912454 24068 raft_consensus.cc:359] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.913160 24068 raft_consensus.cc:740] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.913599 23669 consensus_queue.cc:237] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:07.909161 23361 raft_consensus.cc:3060] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:07.912782 23326 leader_election.cc:336] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.913879 24068 consensus_queue.cc:260] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.919297 24077 leader_election.cc:290] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:07.910468 24078 raft_consensus.cc:2804] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.926483 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26380e16f1a247e4b9a611e57faafdf9" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:07.927140 23435 raft_consensus.cc:3060] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.928000 24068 ts_tablet_manager.cc:1434] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:07.934851 23435 raft_consensus.cc:2468] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
W20260709 13:10:07.936368 23326 leader_election.cc:336] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.943452 23324 leader_election.cc:304] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:07.946578 24078 raft_consensus.cc:697] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:07.925479 23501 raft_consensus.cc:2468] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:10:07.947515 24078 consensus_queue.cc:237] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:07.953687 24010 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:07.954777 24068 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:07.956154 23327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.4:38341, user_credentials={real_user=slave}} blocked reactor thread for 44050.7us
I20260709 13:10:07.964332 23361 raft_consensus.cc:2468] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:07.954213 24010 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.961467 24113 raft_consensus.cc:2804] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.966347 24010 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:07.967309 23327 leader_election.cc:304] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.968713 24077 raft_consensus.cc:2804] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.969183 24077 raft_consensus.cc:697] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:07.969966 24077 consensus_queue.cc:237] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
W20260709 13:10:07.967306 23326 leader_election.cc:336] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
W20260709 13:10:07.967711 23400 leader_election.cc:336] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:07.966136 24113 raft_consensus.cc:697] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:07.979334 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787" is_pre_election: true
I20260709 13:10:07.982722 23400 leader_election.cc:304] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:07.982461 23361 raft_consensus.cc:2468] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 1.
I20260709 13:10:07.982026 24059 raft_consensus.cc:515] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:07.987599 24010 raft_consensus.cc:2804] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.988078 24010 raft_consensus.cc:697] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:07.988921 24010 consensus_queue.cc:237] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.006150 23399 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:08.007987 24076 raft_consensus.cc:2804] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:08.008421 24076 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:08.008822 24076 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.013876 24059 leader_election.cc:290] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:08.018069 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223cb5b87c546029aaf855836b6e545" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:08.018688 23361 raft_consensus.cc:3060] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.027997 23361 raft_consensus.cc:2468] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:08.028999 23399 leader_election.cc:304] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:08.029739 24059 raft_consensus.cc:2804] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.030236 24059 raft_consensus.cc:697] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:08.031032 24059 consensus_queue.cc:237] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.013044 24113 consensus_queue.cc:237] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.038061 24068 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.039325 24068 tablet_bootstrap.cc:492] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.039983 24068 ts_tablet_manager.cc:1403] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.013s
I20260709 13:10:08.039558 23182 catalog_manager.cc:5697] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4). New cstate: current_term: 2 leader_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.047206 24068 raft_consensus.cc:359] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.047930 24068 raft_consensus.cc:740] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.048663 24068 consensus_queue.cc:260] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.050870 24068 ts_tablet_manager.cc:1434] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.002s
I20260709 13:10:08.053547 24068 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.051452 24076 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.068112 24076 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:08.070163 23361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:08.070819 23361 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.071542 23182 catalog_manager.cc:5697] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.077471 23361 raft_consensus.cc:2468] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:08.079413 23399 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:08.087703 24076 raft_consensus.cc:2804] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.086987 23182 catalog_manager.cc:5697] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.088485 24076 raft_consensus.cc:697] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:08.088964 23182 catalog_manager.cc:5697] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.104462 23184 catalog_manager.cc:5697] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.110749 24068 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.111653 24068 tablet_bootstrap.cc:492] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.112273 24068 ts_tablet_manager.cc:1403] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.002s
I20260709 13:10:08.089327 24076 consensus_queue.cc:237] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:08.121107 23400 leader_election.cc:336] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
W20260709 13:10:08.121770 23400 leader_election.cc:336] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:08.114737 24068 raft_consensus.cc:359] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.128636 24068 raft_consensus.cc:740] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.129467 24068 consensus_queue.cc:260] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.131444 24068 ts_tablet_manager.cc:1434] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:10:08.132156 24068 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:08.132617 23400 leader_election.cc:336] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:08.157348 23184 catalog_manager.cc:5697] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.162534 23184 catalog_manager.cc:5697] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.168012 24068 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.168931 24068 tablet_bootstrap.cc:492] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.169540 24068 ts_tablet_manager.cc:1403] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.009s
I20260709 13:10:08.172015 24068 raft_consensus.cc:359] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.172631 24068 raft_consensus.cc:740] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.173377 24068 consensus_queue.cc:260] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.175388 24068 ts_tablet_manager.cc:1434] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:08.176113 24068 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.200186 24068 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.201028 24068 tablet_bootstrap.cc:492] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.201565 24068 ts_tablet_manager.cc:1403] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:10:08.203830 24068 raft_consensus.cc:359] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.204468 24068 raft_consensus.cc:740] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.205075 24068 consensus_queue.cc:260] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.206508 24068 ts_tablet_manager.cc:1434] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:08.207126 24068 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.222877 24068 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.223819 24068 tablet_bootstrap.cc:492] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.224465 24068 ts_tablet_manager.cc:1403] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:10:08.226994 24068 raft_consensus.cc:359] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.227658 24068 raft_consensus.cc:740] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.228396 24068 consensus_queue.cc:260] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.230861 24068 ts_tablet_manager.cc:1434] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:08.231572 24068 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.233994 23431 raft_consensus.cc:1275] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.236366 24077 consensus_queue.cc:1048] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:08.260411 23326 consensus_peers.cc:597] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:08.274137 24068 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.275199 24068 tablet_bootstrap.cc:492] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.276057 24068 ts_tablet_manager.cc:1403] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.004s
I20260709 13:10:08.278627 24068 raft_consensus.cc:359] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.279361 24068 raft_consensus.cc:740] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.280036 24068 consensus_queue.cc:260] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.280829 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:44223
I20260709 13:10:08.281347 24168 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:44223 every 8 connection(s)
I20260709 13:10:08.281980 24068 ts_tablet_manager.cc:1434] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:08.282816 24068 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.317544 24068 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.323511 24068 tablet_bootstrap.cc:492] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.328313 24068 ts_tablet_manager.cc:1403] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 13:10:08.331418 24068 raft_consensus.cc:359] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.332083 24068 raft_consensus.cc:740] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.332644 24068 consensus_queue.cc:260] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.334107 24068 ts_tablet_manager.cc:1434] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:08.334857 24068 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.365464 24068 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.367134 24068 tablet_bootstrap.cc:492] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.368733 24068 ts_tablet_manager.cc:1403] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.001s
I20260709 13:10:08.371122 24068 raft_consensus.cc:359] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.371850 24068 raft_consensus.cc:740] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
W20260709 13:10:08.373831 23474 consensus_peers.cc:597] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:08.373404 24068 consensus_queue.cc:260] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.376521 24068 ts_tablet_manager.cc:1434] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:08.377138 24068 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.380662 24169 heartbeater.cc:344] Connected to a master server at 127.15.6.62:38693
I20260709 13:10:08.381109 24169 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.382004 24169 heartbeater.cc:507] Master 127.15.6.62:38693 requested a full tablet report, sending...
I20260709 13:10:08.388803 24068 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.389451 24068 tablet_bootstrap.cc:492] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.389945 24068 ts_tablet_manager.cc:1403] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 13:10:08.391657 24068 raft_consensus.cc:359] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.392253 24068 raft_consensus.cc:740] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.392942 24068 consensus_queue.cc:260] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.394909 24068 ts_tablet_manager.cc:1434] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.006s
I20260709 13:10:08.396117 24068 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.398380 23184 ts_manager.cc:194] Re-registered known tserver with Master: e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:08.421746 23502 raft_consensus.cc:1275] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.423314 24113 consensus_queue.cc:1048] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.430789 24068 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.431629 24068 tablet_bootstrap.cc:492] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.433881 24068 ts_tablet_manager.cc:1403] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.013s
I20260709 13:10:08.436605 24068 raft_consensus.cc:359] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.437301 24068 raft_consensus.cc:740] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.437969 24068 consensus_queue.cc:260] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.447649 24068 ts_tablet_manager.cc:1434] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:08.448450 24068 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.486362 24140 raft_consensus.cc:3060] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.492285 23431 raft_consensus.cc:1275] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.494233 23361 raft_consensus.cc:1275] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.498773 23431 raft_consensus.cc:1275] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e971a25f8dfb42fcb1afb9ecf74f760d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.502264 23356 raft_consensus.cc:1275] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.503929 24076 consensus_queue.cc:1048] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.506451 24048 consensus_queue.cc:1048] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.509179 24125 consensus_queue.cc:1048] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:08.513206 24068 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.514237 24068 tablet_bootstrap.cc:492] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.514854 24068 ts_tablet_manager.cc:1403] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.011s
I20260709 13:10:08.517472 24068 raft_consensus.cc:359] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.518059 24068 raft_consensus.cc:740] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
W20260709 13:10:08.518262 23326 consensus_peers.cc:597] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:08.518823 24068 consensus_queue.cc:260] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.521070 24068 ts_tablet_manager.cc:1434] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:10:08.521771 24068 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.527684 23636 consensus_queue.cc:1048] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.538808 24137 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.539951 23184 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41286
I20260709 13:10:08.556887 24068 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.559362 24138 raft_consensus.cc:3060] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.565322 23501 raft_consensus.cc:1275] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.566836 24078 consensus_queue.cc:1048] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.569372 24140 raft_consensus.cc:1275] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.570817 24078 consensus_queue.cc:1048] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.584216 24137 raft_consensus.cc:1275] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.597143 24068 tablet_bootstrap.cc:492] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.598968 24068 ts_tablet_manager.cc:1403] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.006s
I20260709 13:10:08.593206 24076 consensus_queue.cc:1048] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:10:08.622001 24068 raft_consensus.cc:359] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.623781 24068 raft_consensus.cc:740] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.624490 24068 consensus_queue.cc:260] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:08.625221 23400 consensus_peers.cc:597] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:08.625887 23400 consensus_peers.cc:597] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:08.626044 24068 ts_tablet_manager.cc:1434] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:10:08.626974 24068 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.638132 24138 raft_consensus.cc:1275] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.644167 24078 consensus_queue.cc:1048] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.653704 24169 heartbeater.cc:499] Master 127.15.6.62:38693 was elected leader, sending a full tablet report...
I20260709 13:10:08.681401 24068 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.682514 24068 tablet_bootstrap.cc:492] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.682875 23361 raft_consensus.cc:1275] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.683197 24068 ts_tablet_manager.cc:1403] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.004s
I20260709 13:10:08.685330 24125 consensus_queue.cc:1048] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.686744 24068 raft_consensus.cc:359] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.687422 24068 raft_consensus.cc:740] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.688278 24068 consensus_queue.cc:260] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.690857 24068 ts_tablet_manager.cc:1434] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:08.691622 24068 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:08.707103 23474 consensus_peers.cc:597] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.732412 24068 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.733276 24068 tablet_bootstrap.cc:492] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.733901 24068 ts_tablet_manager.cc:1403] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.014s
I20260709 13:10:08.736238 24068 raft_consensus.cc:359] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.736871 24068 raft_consensus.cc:740] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.737588 24068 consensus_queue.cc:260] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.739719 24068 ts_tablet_manager.cc:1434] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:08.740437 24068 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:08.747227 23326 consensus_peers.cc:597] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.784847 24068 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.785794 24068 tablet_bootstrap.cc:492] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.786785 24068 ts_tablet_manager.cc:1403] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.010s
I20260709 13:10:08.789259 24068 raft_consensus.cc:359] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.789909 24068 raft_consensus.cc:740] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.790707 24068 consensus_queue.cc:260] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.792634 24068 ts_tablet_manager.cc:1434] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:08.793340 24068 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:08.800539 23474 consensus_peers.cc:597] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.805140 24140 raft_consensus.cc:3060] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:08.848323 23326 consensus_peers.cc:597] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:08.861444 23400 consensus_peers.cc:597] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:08.867774 23400 consensus_peers.cc:597] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.893388 24068 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.894364 24068 tablet_bootstrap.cc:492] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.895018 24068 ts_tablet_manager.cc:1403] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.102s	user 0.056s	sys 0.030s
I20260709 13:10:08.897359 24068 raft_consensus.cc:359] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.897996 24068 raft_consensus.cc:740] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.898707 24068 consensus_queue.cc:260] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
W20260709 13:10:08.899741 23474 consensus_peers.cc:597] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.900838 24068 ts_tablet_manager.cc:1434] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:08.901633 24068 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:08.920843 24068 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.921705 24068 tablet_bootstrap.cc:492] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.922313 24068 ts_tablet_manager.cc:1403] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.008s
I20260709 13:10:08.925631 24068 raft_consensus.cc:359] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.926273 24068 raft_consensus.cc:740] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.926999 24068 consensus_queue.cc:260] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:08.928519 24068 ts_tablet_manager.cc:1434] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:08.929409 24068 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:08.958608 23474 consensus_peers.cc:597] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.972225 24068 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.973196 24068 tablet_bootstrap.cc:492] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.973824 24068 ts_tablet_manager.cc:1403] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.021s
I20260709 13:10:08.976192 24068 raft_consensus.cc:359] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.976924 24068 raft_consensus.cc:740] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.977586 24068 consensus_queue.cc:260] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:08.979528 24068 ts_tablet_manager.cc:1434] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:08.980885 24068 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:08.989935 23400 consensus_peers.cc:597] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:08.994225 24068 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.994930 24068 tablet_bootstrap.cc:492] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:08.995384 24068 ts_tablet_manager.cc:1403] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:10:08.997488 24068 raft_consensus.cc:359] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:08.998083 24068 raft_consensus.cc:740] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.998952 24068 consensus_queue.cc:260] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:09.000685 24068 ts_tablet_manager.cc:1434] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.005s
I20260709 13:10:09.001969 24068 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.019598 24068 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.020519 24068 tablet_bootstrap.cc:492] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.021154 24068 ts_tablet_manager.cc:1403] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:10:09.023416 24068 raft_consensus.cc:359] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.024046 24068 raft_consensus.cc:740] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.025084 24068 consensus_queue.cc:260] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.026993 24068 ts_tablet_manager.cc:1434] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:09.027721 24068 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.046310 24068 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.047252 24068 tablet_bootstrap.cc:492] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.047921 24068 ts_tablet_manager.cc:1403] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:10:09.050304 24068 raft_consensus.cc:359] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.050993 24068 raft_consensus.cc:740] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.051685 24068 consensus_queue.cc:260] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.055173 24068 ts_tablet_manager.cc:1434] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:09.056119 24068 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
W20260709 13:10:09.062301 23326 consensus_peers.cc:597] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:09.071393 23474 consensus_peers.cc:597] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:09.086977 23326 consensus_peers.cc:597] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:09.092069 24068 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.092800 24068 tablet_bootstrap.cc:492] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.093274 24068 ts_tablet_manager.cc:1403] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.010s
I20260709 13:10:09.095100 24068 raft_consensus.cc:359] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.095710 24068 raft_consensus.cc:740] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.096387 24068 consensus_queue.cc:260] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.098320 24068 ts_tablet_manager.cc:1434] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:09.099435 24068 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.102991 24140 raft_consensus.cc:3060] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.114347 24139 raft_consensus.cc:3060] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.135315 24068 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.136294 24068 tablet_bootstrap.cc:492] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.136926 24068 ts_tablet_manager.cc:1403] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.016s
I20260709 13:10:09.139331 24068 raft_consensus.cc:359] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.139993 24068 raft_consensus.cc:740] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.140641 24068 consensus_queue.cc:260] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.142684 24068 ts_tablet_manager.cc:1434] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:10:09.143421 24068 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.157382 24135 raft_consensus.cc:3060] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.238785 24068 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.231233 24138 raft_consensus.cc:3060] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:09.248948 23326 consensus_peers.cc:597] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:09.239734 24068 tablet_bootstrap.cc:492] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.250269 24068 ts_tablet_manager.cc:1403] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.036s
I20260709 13:10:09.264842 24068 raft_consensus.cc:359] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:09.265558 24068 raft_consensus.cc:740] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.266259 24068 consensus_queue.cc:260] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:09.269886 24068 ts_tablet_manager.cc:1434] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:10:09.272809 24068 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.292765 24068 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.293658 24068 tablet_bootstrap.cc:492] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.294272 24068 ts_tablet_manager.cc:1403] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:10:09.296290 24068 raft_consensus.cc:359] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.296767 24068 raft_consensus.cc:740] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.297335 24068 consensus_queue.cc:260] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.312623 24068 ts_tablet_manager.cc:1434] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:10:09.313468 24068 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.341676 24068 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.342393 24068 tablet_bootstrap.cc:492] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.342891 24068 ts_tablet_manager.cc:1403] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 13:10:09.344919 24068 raft_consensus.cc:359] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.345404 24068 raft_consensus.cc:740] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.345948 24068 consensus_queue.cc:260] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.348994 24068 ts_tablet_manager.cc:1434] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:09.349776 24068 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.376132 24068 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.377139 24068 tablet_bootstrap.cc:492] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.377943 24068 ts_tablet_manager.cc:1403] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.004s
I20260709 13:10:09.380439 24068 raft_consensus.cc:359] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.381021 24068 raft_consensus.cc:740] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.381669 24068 consensus_queue.cc:260] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.383551 24068 ts_tablet_manager.cc:1434] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:10:09.384557 24068 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.398984 24068 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.399947 24068 tablet_bootstrap.cc:492] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.402086 24068 ts_tablet_manager.cc:1403] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:10:09.404469 24068 raft_consensus.cc:359] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.405213 24068 raft_consensus.cc:740] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.406018 24068 consensus_queue.cc:260] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.407984 24068 ts_tablet_manager.cc:1434] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:09.409224 24068 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.447499 24068 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.448482 24068 tablet_bootstrap.cc:492] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.449458 24068 ts_tablet_manager.cc:1403] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.040s	user 0.027s	sys 0.011s
I20260709 13:10:09.452123 24068 raft_consensus.cc:359] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.452826 24068 raft_consensus.cc:740] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.453575 24068 consensus_queue.cc:260] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:09.456131 24068 ts_tablet_manager.cc:1434] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:09.456882 24068 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.470358 24068 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.471196 24068 tablet_bootstrap.cc:492] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.471768 24068 ts_tablet_manager.cc:1403] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:10:09.473902 24068 raft_consensus.cc:359] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.474354 24068 raft_consensus.cc:740] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.474927 24068 consensus_queue.cc:260] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.476490 24068 ts_tablet_manager.cc:1434] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:09.477154 24068 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.489528 24068 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.490387 24068 tablet_bootstrap.cc:492] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.490998 24068 ts_tablet_manager.cc:1403] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:10:09.493063 24068 raft_consensus.cc:359] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:09.493599 24068 raft_consensus.cc:740] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.494236 24068 consensus_queue.cc:260] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:09.495383 24068 ts_tablet_manager.cc:1434] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:09.496021 24068 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.515909 24068 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.516753 24068 tablet_bootstrap.cc:492] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.517393 24068 ts_tablet_manager.cc:1403] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:10:09.519703 24068 raft_consensus.cc:359] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.520457 24068 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.521147 24068 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:09.522601 24068 ts_tablet_manager.cc:1434] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:09.523308 24068 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap starting.
I20260709 13:10:09.655491 24068 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=1 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.656404 24068 tablet_bootstrap.cc:492] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Bootstrap complete.
I20260709 13:10:09.657025 24068 ts_tablet_manager.cc:1403] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Time spent bootstrapping tablet: real 0.134s	user 0.046s	sys 0.071s
I20260709 13:10:09.659399 24068 raft_consensus.cc:359] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:09.660045 24068 raft_consensus.cc:740] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.660677 24068 consensus_queue.cc:260] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:09.662593 24068 ts_tablet_manager.cc:1434] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:18.322299 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.382277 23360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:36712
I20260709 13:10:18.382946 23360 raft_consensus.cc:606] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:18.385411 23360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:36712
I20260709 13:10:18.385933 23360 raft_consensus.cc:606] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:18.399932 23501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:18.400367 23501 raft_consensus.cc:606] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:18.402526 23360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
mode: GRACEFUL
new_leader_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:36712
I20260709 13:10:18.402915 23360 raft_consensus.cc:606] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Received request to transfer leadership to TS 5e2983c2051a44788d4064010321c7f5
I20260709 13:10:18.405025 23359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:36712
I20260709 13:10:18.405499 23359 raft_consensus.cc:606] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:18.406455 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:18.407666 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:18.565690 24233 raft_consensus.cc:993] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.568506 24249 raft_consensus.cc:1081] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.570816 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48954
I20260709 13:10:18.571310 24138 raft_consensus.cc:493] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.571681 24138 raft_consensus.cc:3060] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.578399 24138 raft_consensus.cc:515] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:18.580485 24138 leader_election.cc:290] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:18.590507 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:18.591089 23359 raft_consensus.cc:3055] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.591372 23359 raft_consensus.cc:740] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:18.594038 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9252e3ece10448a9a6b9a2a9c39e109" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:18.594594 23435 raft_consensus.cc:3060] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.594540 23359 consensus_queue.cc:260] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:18.595781 23359 raft_consensus.cc:3060] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.601560 23359 raft_consensus.cc:2468] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:18.602029 23435 raft_consensus.cc:2468] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:18.602849 24063 leader_election.cc:304] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:18.604857 24253 raft_consensus.cc:2804] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.608111 24253 raft_consensus.cc:697] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:18.609095 24253 consensus_queue.cc:237] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:18.619472 23182 catalog_manager.cc:5697] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.620873 24233 raft_consensus.cc:993] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.621394 24249 raft_consensus.cc:1081] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.622718 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48954
I20260709 13:10:18.623128 24138 raft_consensus.cc:493] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.623389 24138 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.630298 24138 raft_consensus.cc:515] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:18.631485 24244 raft_consensus.cc:993] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.632054 24244 raft_consensus.cc:1081] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.633070 24138 leader_election.cc:290] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 5 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:18.635159 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:18.635767 23359 raft_consensus.cc:3055] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:18.636081 23359 raft_consensus.cc:740] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:18.636880 23359 consensus_queue.cc:260] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:18.637822 23359 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.641741 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:10:18.642167 24138 raft_consensus.cc:493] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.642379 24138 raft_consensus.cc:3060] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.643925 23359 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 5.
I20260709 13:10:18.644816 24063 leader_election.cc:304] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:18.645116 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b942ac249aa46ec842c3d763c4c5716" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:18.645738 23501 raft_consensus.cc:3060] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.645901 24253 raft_consensus.cc:2804] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:18.646420 24253 raft_consensus.cc:697] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 5 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:18.647243 24253 consensus_queue.cc:237] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:18.650748 24138 raft_consensus.cc:515] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:18.652828 23501 raft_consensus.cc:2468] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 5.
I20260709 13:10:18.653463 23431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:18.654960 23431 raft_consensus.cc:3060] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.655509 24138 leader_election.cc:290] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:18.656898 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562f6ac7d8f4b459a477422faee3ad5" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:18.657281 23501 raft_consensus.cc:3055] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.657485 23501 raft_consensus.cc:740] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:18.658066 23501 consensus_queue.cc:260] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:18.658970 23501 raft_consensus.cc:3060] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.661181 23431 raft_consensus.cc:2468] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:18.662290 24062 leader_election.cc:304] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:18.663080 24253 raft_consensus.cc:2804] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.663516 24253 raft_consensus.cc:697] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:18.663586 23501 raft_consensus.cc:2468] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:18.664044 23182 catalog_manager.cc:5697] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 4 to 5, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 5 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.664559 24253 consensus_queue.cc:237] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:18.678782 23182 catalog_manager.cc:5697] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.739976 24249 raft_consensus.cc:993] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.740366 24233 raft_consensus.cc:1081] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:18.741613 24135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48954
I20260709 13:10:18.742105 24135 raft_consensus.cc:493] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.742425 24135 raft_consensus.cc:3060] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.744936 24233 raft_consensus.cc:993] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787: : Instructing follower 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:18.745456 24249 raft_consensus.cc:1081] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Signalling peer 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:18.746901 23431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:10:18.747371 23431 raft_consensus.cc:493] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.747979 23431 raft_consensus.cc:3060] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.749048 24135 raft_consensus.cc:515] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:18.750962 24135 leader_election.cc:290] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:18.751940 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:18.752418 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8184122e504defbfcc6fbc81b06ab3" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:18.752499 23435 raft_consensus.cc:3060] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.752928 23359 raft_consensus.cc:3055] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.753189 23359 raft_consensus.cc:740] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:18.753121 23431 raft_consensus.cc:515] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:18.753988 23359 consensus_queue.cc:260] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:18.754908 23359 raft_consensus.cc:3060] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.756368 23431 leader_election.cc:290] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:18.756263 23360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:18.756567 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2d8f4b8d8446f6bf9822988a72557e" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:18.756908 23360 raft_consensus.cc:3055] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.757198 23501 raft_consensus.cc:3060] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.757230 23360 raft_consensus.cc:740] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:18.759138 23360 consensus_queue.cc:260] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:18.759927 23435 raft_consensus.cc:2468] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:18.760411 23360 raft_consensus.cc:3060] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.760892 23359 raft_consensus.cc:2468] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:18.760968 24062 leader_election.cc:304] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:18.761966 24253 raft_consensus.cc:2804] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.762619 24253 raft_consensus.cc:697] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:18.763499 24253 consensus_queue.cc:237] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:18.764102 23501 raft_consensus.cc:2468] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:18.765350 23401 leader_election.cc:304] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:18.766211 24010 raft_consensus.cc:2804] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.766626 24010 raft_consensus.cc:697] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:18.767330 24010 consensus_queue.cc:237] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:18.767768 23360 raft_consensus.cc:2468] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:18.776708 23182 catalog_manager.cc:5697] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.777954 23183 catalog_manager.cc:5697] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.006129 23360 raft_consensus.cc:1275] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.007225 24253 consensus_queue.cc:1048] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.031620 23435 raft_consensus.cc:1275] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.032471 23501 raft_consensus.cc:1275] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 5 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:19.033120 24253 consensus_queue.cc:1048] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.034262 24254 consensus_queue.cc:1048] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:19.073249 23360 raft_consensus.cc:1275] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 5 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:19.075047 24266 consensus_queue.cc:1048] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:19.226622 23435 raft_consensus.cc:1275] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.227650 24266 consensus_queue.cc:1048] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.233747 23501 raft_consensus.cc:1275] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.235100 24010 consensus_queue.cc:1048] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.236650 23501 raft_consensus.cc:1275] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.238272 24274 consensus_queue.cc:1048] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:19.254864 23359 raft_consensus.cc:1275] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.256196 24010 consensus_queue.cc:1048] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.263082 23360 raft_consensus.cc:1275] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.264514 24254 consensus_queue.cc:1048] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.283649 23430 raft_consensus.cc:1275] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.289167 24274 consensus_queue.cc:1048] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.408524 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.495744 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.531106 23508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:19.531577 23508 raft_consensus.cc:606] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:19.542925 23435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:10:19.543357 23435 raft_consensus.cc:606] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:19.545699 23508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:19.546119 23508 raft_consensus.cc:606] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS 5e2983c2051a44788d4064010321c7f5
I20260709 13:10:19.548064 23508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b321c32adbbf498ab098332acdde971b"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:19.548429 23508 raft_consensus.cc:606] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:19.550227 23508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4dd509182394fe29d31851c23847034"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:19.550580 23508 raft_consensus.cc:606] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:19.551402 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:19.552428 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:19.565932 24076 raft_consensus.cc:993] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.566399 24010 raft_consensus.cc:1081] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.567703 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48952
I20260709 13:10:19.568166 24138 raft_consensus.cc:493] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.568481 24138 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.573282 24138 raft_consensus.cc:515] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:19.575016 24138 leader_election.cc:290] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:19.575261 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:19.575480 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfeaf4ca4744c74bb5c73cef813d119" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:19.575848 23359 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.575979 23435 raft_consensus.cc:3055] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.576340 23435 raft_consensus.cc:740] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:19.577111 23435 consensus_queue.cc:260] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:19.578359 23435 raft_consensus.cc:3060] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.583134 23359 raft_consensus.cc:2468] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 3.
I20260709 13:10:19.584672 23435 raft_consensus.cc:2468] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 3.
I20260709 13:10:19.585465 24241 raft_consensus.cc:993] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:19.585876 24241 raft_consensus.cc:1081] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:19.586342 24062 leader_election.cc:304] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:19.587559 24254 raft_consensus.cc:2804] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:19.588012 24254 raft_consensus.cc:697] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:19.588814 24254 consensus_queue.cc:237] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:19.594177 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:53290
I20260709 13:10:19.595635 23435 raft_consensus.cc:493] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.596112 23435 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.602352 23435 raft_consensus.cc:515] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:19.604504 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:19.604758 23435 leader_election.cc:290] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:19.605017 23359 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.605646 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:19.606063 23508 raft_consensus.cc:3055] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.606320 23508 raft_consensus.cc:740] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:19.605971 23182 catalog_manager.cc:5697] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 2 to 3, leader changed from 5e2983c2051a44788d4064010321c7f5 (127.15.6.3) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 3 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.607214 23508 consensus_queue.cc:260] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:19.609309 23508 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.611960 23359 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:19.613581 23399 leader_election.cc:304] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:19.614301 24010 raft_consensus.cc:2804] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.614753 24010 raft_consensus.cc:697] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:19.615562 24010 consensus_queue.cc:237] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:19.625818 23508 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:19.629051 23183 catalog_manager.cc:5697] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.633917 24244 raft_consensus.cc:993] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.634553 24241 raft_consensus.cc:1081] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.636313 24135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b321c32adbbf498ab098332acdde971b"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:10:19.636806 24135 raft_consensus.cc:493] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.637140 24135 raft_consensus.cc:3060] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.642529 24135 raft_consensus.cc:515] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:19.645089 24244 raft_consensus.cc:993] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.645569 24241 raft_consensus.cc:1081] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.646963 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:10:19.647421 24139 raft_consensus.cc:493] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.647660 24139 raft_consensus.cc:3060] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.653534 24135 leader_election.cc:290] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:19.653694 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:19.653082 24139 raft_consensus.cc:515] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:19.654280 23359 raft_consensus.cc:3060] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.656262 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:19.656524 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441e0cae71fc45e4b1f2c0b4aa958cf9" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:19.656841 23435 raft_consensus.cc:3060] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.657109 23501 raft_consensus.cc:3055] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.657387 23501 raft_consensus.cc:740] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:19.658092 23501 consensus_queue.cc:260] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:19.653671 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b321c32adbbf498ab098332acdde971b" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:19.658941 23508 raft_consensus.cc:3055] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.659080 23501 raft_consensus.cc:3060] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.660877 23359 raft_consensus.cc:2468] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:19.659230 23508 raft_consensus.cc:740] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:19.661981 24063 leader_election.cc:304] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:19.662274 23508 consensus_queue.cc:260] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:19.662891 24254 raft_consensus.cc:2804] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.663340 24254 raft_consensus.cc:697] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:19.663476 23435 raft_consensus.cc:2468] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:19.664181 24254 consensus_queue.cc:237] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:19.664584 24062 leader_election.cc:304] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:19.665069 23501 raft_consensus.cc:2468] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:19.665387 24253 raft_consensus.cc:2804] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.665796 24139 leader_election.cc:290] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:19.665866 24253 raft_consensus.cc:697] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:19.667165 24253 consensus_queue.cc:237] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:19.669307 23508 raft_consensus.cc:3060] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.675089 23508 raft_consensus.cc:2468] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:19.678506 23183 catalog_manager.cc:5697] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.687256 24244 raft_consensus.cc:993] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.687671 24241 raft_consensus.cc:1081] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:19.689085 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4dd509182394fe29d31851c23847034"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:10:19.689596 24139 raft_consensus.cc:493] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.689965 24139 raft_consensus.cc:3060] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.691813 23183 catalog_manager.cc:5697] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.696012 24139 raft_consensus.cc:515] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:19.697613 24139 leader_election.cc:290] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:19.698764 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dd509182394fe29d31851c23847034" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:19.699265 23435 raft_consensus.cc:3060] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.699481 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4dd509182394fe29d31851c23847034" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:19.700042 23508 raft_consensus.cc:3055] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.700301 23508 raft_consensus.cc:740] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:19.703142 23435 raft_consensus.cc:2468] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:19.703635 23508 consensus_queue.cc:260] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:19.704780 23508 raft_consensus.cc:3060] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.705062 24062 leader_election.cc:304] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:19.708494 24254 raft_consensus.cc:2804] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.708963 24254 raft_consensus.cc:697] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:19.709712 24254 consensus_queue.cc:237] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:19.710261 23508 raft_consensus.cc:2468] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:19.718384 23183 catalog_manager.cc:5697] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.005818 23435 raft_consensus.cc:1275] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.006942 24254 consensus_queue.cc:1048] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.016773 23359 raft_consensus.cc:1275] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.018072 24266 consensus_queue.cc:1048] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.056051 23501 raft_consensus.cc:1275] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.057312 24277 consensus_queue.cc:1048] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.069707 23359 raft_consensus.cc:1275] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.071348 24277 consensus_queue.cc:1048] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.113300 23435 raft_consensus.cc:1275] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.114357 24266 consensus_queue.cc:1048] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.124104 23501 raft_consensus.cc:1275] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.125752 24254 consensus_queue.cc:1048] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.155704 23359 raft_consensus.cc:1275] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.156683 24254 consensus_queue.cc:1048] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.167433 23501 raft_consensus.cc:1275] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.169384 24254 consensus_queue.cc:1048] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.300608 23435 raft_consensus.cc:1275] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.301780 24254 consensus_queue.cc:1048] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.309597 23501 raft_consensus.cc:1275] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.310967 24254 consensus_queue.cc:1048] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.553201 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:20.591161 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:20.625067 23501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:20.625630 23501 raft_consensus.cc:606] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:20.628219 23501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:20.628718 23501 raft_consensus.cc:606] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS 5e2983c2051a44788d4064010321c7f5
I20260709 13:10:20.630863 23501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:20.631237 23501 raft_consensus.cc:606] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:20.633374 23435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:10:20.633886 23435 raft_consensus.cc:606] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:20.636868 23501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97060878042843a39d96aa2725227238"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "690e3a11be554a93b36ec5017ed89787"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:20.637336 23501 raft_consensus.cc:606] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:20.638942 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:20.640399 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:20.646929 24241 raft_consensus.cc:993] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:20.647385 24308 raft_consensus.cc:1081] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:20.648694 24241 raft_consensus.cc:993] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:20.648873 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:53290
I20260709 13:10:20.649080 24308 raft_consensus.cc:1081] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:20.649363 23435 raft_consensus.cc:493] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.649710 23435 raft_consensus.cc:3060] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.650453 24135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:10:20.650830 24135 raft_consensus.cc:493] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.651057 24135 raft_consensus.cc:3060] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.654484 23435 raft_consensus.cc:515] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:20.656031 24135 raft_consensus.cc:515] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:20.656486 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:20.657105 23359 raft_consensus.cc:3060] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.658548 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:20.659056 23501 raft_consensus.cc:3055] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.659404 23501 raft_consensus.cc:740] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:20.660198 23501 consensus_queue.cc:260] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:20.661198 23501 raft_consensus.cc:3060] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.662972 23359 raft_consensus.cc:2468] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:20.664341 23399 leader_election.cc:304] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:20.665658 24010 raft_consensus.cc:2804] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.666059 24010 raft_consensus.cc:697] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:20.667122 24135 leader_election.cc:290] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:20.666761 24010 consensus_queue.cc:237] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:20.666785 23501 raft_consensus.cc:2468] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:20.669376 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd495d63c648ff8364f543e4da9901" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:20.669893 23359 raft_consensus.cc:3060] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.669989 24065 leader_election.cc:304] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e56d4fa89a4e41fb99476c088544e8b8, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:20.672690 24254 raft_consensus.cc:2804] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.673131 24254 raft_consensus.cc:697] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:20.673919 24254 consensus_queue.cc:237] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:20.676678 23359 raft_consensus.cc:2468] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:20.679953 23435 leader_election.cc:290] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:20.684340 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab56513b0d44631b1b0258f31989b62" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:20.684902 23501 raft_consensus.cc:3055] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.685184 23501 raft_consensus.cc:740] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:20.685868 23501 consensus_queue.cc:260] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:20.687018 23501 raft_consensus.cc:3060] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.686540 23183 catalog_manager.cc:5697] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.687151 23182 catalog_manager.cc:5697] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.693568 23501 raft_consensus.cc:2468] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:20.886584 24241 raft_consensus.cc:993] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower 690e3a11be554a93b36ec5017ed89787 to start an election
I20260709 13:10:20.887065 24241 raft_consensus.cc:1081] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer 690e3a11be554a93b36ec5017ed89787 to start an election
I20260709 13:10:20.889076 23355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97060878042843a39d96aa2725227238"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
 from {username='slave'} at 127.0.0.1:44308
I20260709 13:10:20.889672 23355 raft_consensus.cc:493] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.890916 23355 raft_consensus.cc:3060] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.896204 23355 raft_consensus.cc:515] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:20.898418 23355 leader_election.cc:290] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:20.898643 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:20.898928 23508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97060878042843a39d96aa2725227238" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:20.899222 23435 raft_consensus.cc:3060] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.899492 23508 raft_consensus.cc:3055] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.899869 23508 raft_consensus.cc:740] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:20.900571 23508 consensus_queue.cc:260] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:20.901660 23508 raft_consensus.cc:3060] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.907639 23508 raft_consensus.cc:2468] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:10:20.907655 23435 raft_consensus.cc:2468] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 2.
I20260709 13:10:20.908929 23327 leader_election.cc:304] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:20.909689 24249 raft_consensus.cc:2804] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.910128 24249 raft_consensus.cc:697] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:20.911119 24249 consensus_queue.cc:237] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:20.914506 24308 raft_consensus.cc:993] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:20.915067 24241 raft_consensus.cc:1081] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:20.916361 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:10:20.916760 24139 raft_consensus.cc:493] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.917075 24139 raft_consensus.cc:3060] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.922832 23182 catalog_manager.cc:5697] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.929430 24139 raft_consensus.cc:515] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:20.932600 24139 leader_election.cc:290] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:20.933108 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:20.933817 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dd0b5483a44bcba9b20f703b4f9588" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:20.934319 23502 raft_consensus.cc:3055] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.934538 23502 raft_consensus.cc:740] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:20.935079 23502 consensus_queue.cc:260] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:20.936086 23435 raft_consensus.cc:3060] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.936218 23502 raft_consensus.cc:3060] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.940110 23435 raft_consensus.cc:2468] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:20.940586 23502 raft_consensus.cc:2468] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:20.941059 24062 leader_election.cc:304] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:20.941779 24254 raft_consensus.cc:2804] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.942238 24254 raft_consensus.cc:697] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:20.942940 24254 consensus_queue.cc:237] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:20.950804 23182 catalog_manager.cc:5697] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.061617 24010 raft_consensus.cc:993] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:21.061992 24277 raft_consensus.cc:1081] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:21.063225 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48952
I20260709 13:10:21.063611 24139 raft_consensus.cc:493] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.063861 24139 raft_consensus.cc:3060] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.067561 23359 raft_consensus.cc:1275] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.068614 24277 consensus_queue.cc:1048] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.068661 24139 raft_consensus.cc:515] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.070382 24139 leader_election.cc:290] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:21.070968 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:21.071169 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8bad3e990a48568e879ecb570caa29" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:21.071593 23355 raft_consensus.cc:3060] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.071729 23435 raft_consensus.cc:3055] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.072192 23435 raft_consensus.cc:740] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:21.075977 23435 consensus_queue.cc:260] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.076769 23355 raft_consensus.cc:2468] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:21.077167 23435 raft_consensus.cc:3060] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.078186 24063 leader_election.cc:304] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:21.079191 24254 raft_consensus.cc:2804] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.079721 24254 raft_consensus.cc:697] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:21.080516 24254 consensus_queue.cc:237] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.083137 23435 raft_consensus.cc:2468] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:21.088531 23502 raft_consensus.cc:1275] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.089895 24277 consensus_queue.cc:1048] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.091207 23182 catalog_manager.cc:5697] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from 5e2983c2051a44788d4064010321c7f5 (127.15.6.3) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.197705 23501 raft_consensus.cc:1275] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.198818 24254 consensus_queue.cc:1048] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.209576 23355 raft_consensus.cc:1275] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.210829 24254 consensus_queue.cc:1048] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.341068 23501 raft_consensus.cc:1275] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.342067 24315 consensus_queue.cc:1048] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.353855 23431 raft_consensus.cc:1275] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.356643 24315 consensus_queue.cc:1048] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.436853 23431 raft_consensus.cc:1275] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.438052 24254 consensus_queue.cc:1048] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.446105 23502 raft_consensus.cc:1275] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.447424 24253 consensus_queue.cc:1048] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.472376 23355 raft_consensus.cc:1275] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.473470 24253 consensus_queue.cc:1048] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.491091 23431 raft_consensus.cc:1275] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.492354 24254 consensus_queue.cc:1048] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.641160 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:21.680192 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:21.712474 23435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:10:21.712926 23435 raft_consensus.cc:606] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:21.715312 23355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a86340eab4214c8faa598315e8097257"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:36712
I20260709 13:10:21.715952 23355 raft_consensus.cc:606] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:21.722011 23501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4"
dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
mode: GRACEFUL
new_leader_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:59248
I20260709 13:10:21.722544 23501 raft_consensus.cc:606] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Received request to transfer leadership to TS 5e2983c2051a44788d4064010321c7f5
I20260709 13:10:21.723663 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:21.725239 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:21.754151 24249 raft_consensus.cc:993] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:21.754709 24249 raft_consensus.cc:1081] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:21.756068 24135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a86340eab4214c8faa598315e8097257"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48954
I20260709 13:10:21.756626 24135 raft_consensus.cc:493] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.756976 24135 raft_consensus.cc:3060] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.766492 24135 raft_consensus.cc:515] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.768080 24135 leader_election.cc:290] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:21.768765 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:21.769359 23355 raft_consensus.cc:3055] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.769451 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86340eab4214c8faa598315e8097257" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:21.769675 23355 raft_consensus.cc:740] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:21.769992 23435 raft_consensus.cc:3060] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.770576 23355 consensus_queue.cc:260] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.771538 23355 raft_consensus.cc:3060] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.775900 23435 raft_consensus.cc:2468] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:21.776898 24062 leader_election.cc:304] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:21.777628 24266 raft_consensus.cc:2804] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.777684 23355 raft_consensus.cc:2468] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:21.778167 24266 raft_consensus.cc:697] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:21.778949 24266 consensus_queue.cc:237] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.786365 24307 raft_consensus.cc:993] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:21.786775 24277 raft_consensus.cc:1081] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:21.787981 24135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48952
I20260709 13:10:21.787775 23182 catalog_manager.cc:5697] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.788470 24135 raft_consensus.cc:493] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.788822 24135 raft_consensus.cc:3060] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.793692 24135 raft_consensus.cc:515] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.795548 24135 leader_election.cc:290] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025)
I20260709 13:10:21.795750 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:21.796433 23355 raft_consensus.cc:3060] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.796804 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efa2c7bd75b49468d45b6a49ad005fc" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:21.797255 23435 raft_consensus.cc:3055] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.797473 23435 raft_consensus.cc:740] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:21.798102 23435 consensus_queue.cc:260] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.799063 23435 raft_consensus.cc:3060] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.802980 23355 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:21.804206 24063 leader_election.cc:304] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:21.803574 23435 raft_consensus.cc:2468] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:21.804905 24266 raft_consensus.cc:2804] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.805351 24266 raft_consensus.cc:697] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:21.806176 24266 consensus_queue.cc:237] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } }
I20260709 13:10:21.822201 23182 catalog_manager.cc:5697] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from 5e2983c2051a44788d4064010321c7f5 (127.15.6.3) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.933391 24308 raft_consensus.cc:993] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: : Instructing follower 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:21.933811 24241 raft_consensus.cc:1081] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Signalling peer 5e2983c2051a44788d4064010321c7f5 to start an election
I20260709 13:10:21.934978 23435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
 from {username='slave'} at 127.0.0.1:53290
I20260709 13:10:21.935338 23435 raft_consensus.cc:493] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.935571 23435 raft_consensus.cc:3060] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.940109 23435 raft_consensus.cc:515] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:21.941746 23435 leader_election.cc:290] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:21.942126 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:21.942288 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c98c482f2e46369c59ac866488c0e4" candidate_uuid: "5e2983c2051a44788d4064010321c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:21.942896 23501 raft_consensus.cc:3055] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.943183 23501 raft_consensus.cc:740] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e971a25f8dfb42fcb1afb9ecf74f760d, State: Running, Role: LEADER
I20260709 13:10:21.943922 23501 consensus_queue.cc:260] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:21.944475 23359 raft_consensus.cc:3060] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.945062 23501 raft_consensus.cc:3060] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.951579 23359 raft_consensus.cc:2468] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:21.952957 23399 leader_election.cc:304] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2983c2051a44788d4064010321c7f5, 690e3a11be554a93b36ec5017ed89787; no voters: 
I20260709 13:10:21.953784 24307 raft_consensus.cc:2804] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.961232 24307 raft_consensus.cc:697] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:21.962015 23501 raft_consensus.cc:2468] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2983c2051a44788d4064010321c7f5 in term 2.
I20260709 13:10:21.962615 24307 consensus_queue.cc:237] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:21.970777 23182 catalog_manager.cc:5697] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 reported cstate change: term changed from 1 to 2, leader changed from e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4) to 5e2983c2051a44788d4064010321c7f5 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "5e2983c2051a44788d4064010321c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.192216 23359 raft_consensus.cc:1275] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.193627 24254 consensus_queue.cc:1048] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.199692 23431 raft_consensus.cc:1275] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.202123 24266 consensus_queue.cc:1048] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.257364 23359 raft_consensus.cc:1275] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.258545 24266 consensus_queue.cc:1048] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.267665 23431 raft_consensus.cc:1275] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.269527 24253 consensus_queue.cc:1048] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.476830 23359 raft_consensus.cc:1275] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.477978 24277 consensus_queue.cc:1048] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.485884 23501 raft_consensus.cc:1275] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer 5e2983c2051a44788d4064010321c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.489580 24307 consensus_queue.cc:1048] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.726030 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.769853 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.805714 23435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60"
dest_uuid: "5e2983c2051a44788d4064010321c7f5"
mode: GRACEFUL
new_leader_uuid: "690e3a11be554a93b36ec5017ed89787"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:10:22.806284 23435 raft_consensus.cc:606] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Received request to transfer leadership to TS 690e3a11be554a93b36ec5017ed89787
I20260709 13:10:22.808104 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:22.809557 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:23.028827 24357 raft_consensus.cc:993] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5: : Instructing follower 690e3a11be554a93b36ec5017ed89787 to start an election
I20260709 13:10:23.029269 24357 raft_consensus.cc:1081] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Signalling peer 690e3a11be554a93b36ec5017ed89787 to start an election
I20260709 13:10:23.031113 23361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
 from {username='slave'} at 127.0.0.1:44318
I20260709 13:10:23.032205 23361 raft_consensus.cc:493] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.032554 23361 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.037575 23361 raft_consensus.cc:515] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:23.039283 23361 leader_election.cc:290] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 3 election: Requested vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341)
I20260709 13:10:23.039891 23435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e2983c2051a44788d4064010321c7f5"
I20260709 13:10:23.040155 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8570fd3d81f4448587060878fe3c4a60" candidate_uuid: "690e3a11be554a93b36ec5017ed89787" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:23.040506 23435 raft_consensus.cc:3055] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:23.040771 23501 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.040859 23435 raft_consensus.cc:740] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e2983c2051a44788d4064010321c7f5, State: Running, Role: LEADER
I20260709 13:10:23.041651 23435 consensus_queue.cc:260] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:23.042833 23435 raft_consensus.cc:3060] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.046859 23501 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 3.
I20260709 13:10:23.048000 23327 leader_election.cc:304] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 
I20260709 13:10:23.048575 24249 raft_consensus.cc:2804] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:23.048691 23435 raft_consensus.cc:2468] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 690e3a11be554a93b36ec5017ed89787 in term 3.
I20260709 13:10:23.048929 24249 raft_consensus.cc:697] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 3 LEADER]: Becoming Leader. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:23.050089 24249 consensus_queue.cc:237] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } }
I20260709 13:10:23.058808 23184 catalog_manager.cc:5697] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 reported cstate change: term changed from 2 to 3, leader changed from 5e2983c2051a44788d4064010321c7f5 (127.15.6.3) to 690e3a11be554a93b36ec5017ed89787 (127.15.6.2). New cstate: current_term: 3 leader_uuid: "690e3a11be554a93b36ec5017ed89787" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.489959 23431 raft_consensus.cc:1275] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:23.491110 24363 consensus_queue.cc:1048] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.507496 23501 raft_consensus.cc:1275] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Refusing update from remote peer 690e3a11be554a93b36ec5017ed89787: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:23.509672 24315 consensus_queue.cc:1048] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.810281 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.864166 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.899992 23361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574"
dest_uuid: "690e3a11be554a93b36ec5017ed89787"
mode: GRACEFUL
new_leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:36712
I20260709 13:10:23.900429 23361 raft_consensus.cc:606] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Received request to transfer leadership to TS e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:23.901329 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:23.902526 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:24.153077 24249 raft_consensus.cc:993] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787: : Instructing follower e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:24.153546 24315 raft_consensus.cc:1081] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Signalling peer e56d4fa89a4e41fb99476c088544e8b8 to start an election
I20260709 13:10:24.154781 24135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574"
dest_uuid: "e56d4fa89a4e41fb99476c088544e8b8"
 from {username='slave'} at 127.0.0.1:48954
I20260709 13:10:24.155176 24135 raft_consensus.cc:493] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.155390 24135 raft_consensus.cc:3060] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.161381 24135 raft_consensus.cc:515] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:24.163599 24135 leader_election.cc:290] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Requested vote from peers e971a25f8dfb42fcb1afb9ecf74f760d (127.15.6.4:38341), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:24.163774 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "690e3a11be554a93b36ec5017ed89787"
I20260709 13:10:24.164374 23359 raft_consensus.cc:3055] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.164624 23359 raft_consensus.cc:740] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 690e3a11be554a93b36ec5017ed89787, State: Running, Role: LEADER
I20260709 13:10:24.165302 23359 consensus_queue.cc:260] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:24.166268 23359 raft_consensus.cc:3060] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.166862 23501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c812f930c747ba8d2e17253818f574" candidate_uuid: "e56d4fa89a4e41fb99476c088544e8b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d"
I20260709 13:10:24.167515 23501 raft_consensus.cc:3060] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.172235 23359 raft_consensus.cc:2468] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:24.173348 24063 leader_election.cc:304] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8; no voters: 
I20260709 13:10:24.173839 23501 raft_consensus.cc:2468] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56d4fa89a4e41fb99476c088544e8b8 in term 2.
I20260709 13:10:24.174062 24349 raft_consensus.cc:2804] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.174568 24349 raft_consensus.cc:697] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Becoming Leader. State: Replica: e56d4fa89a4e41fb99476c088544e8b8, State: Running, Role: LEADER
I20260709 13:10:24.175375 24349 consensus_queue.cc:237] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:24.190488 23184 catalog_manager.cc:5697] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 reported cstate change: term changed from 1 to 2, leader changed from 690e3a11be554a93b36ec5017ed89787 (127.15.6.2) to e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56d4fa89a4e41fb99476c088544e8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.602294 23502 raft_consensus.cc:1275] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.603245 24254 consensus_queue.cc:1048] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.621513 23359 raft_consensus.cc:1275] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Refusing update from remote peer e56d4fa89a4e41fb99476c088544e8b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.622753 24376 consensus_queue.cc:1048] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.903345 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:24.939079 15384 tablet_server.cc:179] TabletServer@127.15.6.1:44223 shutting down...
W20260709 13:10:24.960788 23400 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 169 similar messages]
W20260709 13:10:24.964061 23400 consensus_peers.cc:597] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.969553 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:24.970485 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.971306 15384 raft_consensus.cc:2243] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.971845 15384 raft_consensus.cc:2272] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.974010 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.974771 15384 raft_consensus.cc:2243] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.975157 15384 raft_consensus.cc:2272] T 56283a2404464c0bb214e90b06fdea8c P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.977681 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.978488 15384 raft_consensus.cc:2243] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.979018 15384 raft_consensus.cc:2272] T ac5e3b8a31e54e7186eff3a07ae3dcae P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.981805 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.982537 15384 raft_consensus.cc:2243] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.983071 15384 raft_consensus.cc:2272] T 106c7f82b57a430e8e9c9d0c209d5a5a P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:24.984885 23326 consensus_peers.cc:597] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.985440 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.986111 15384 raft_consensus.cc:2243] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.986459 15384 raft_consensus.cc:2272] T 5ba0176229a34f60bf5899d36f898fe5 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.988448 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.988966 15384 raft_consensus.cc:2243] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.989346 15384 raft_consensus.cc:2272] T 9223cb5b87c546029aaf855836b6e545 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.991137 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.991597 15384 raft_consensus.cc:2243] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.991966 15384 raft_consensus.cc:2272] T 34ad643f490e4b029e3b1a87544df7e7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.993727 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.994396 15384 raft_consensus.cc:2243] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.994832 15384 raft_consensus.cc:2272] T e383f298f23f4ba8bb47a27742f0bff0 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.997262 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:24.997816 15384 raft_consensus.cc:2243] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.998258 15384 raft_consensus.cc:2272] T 295ce00aba194098a6b6e3736a7c7b8d P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.000825 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.001346 15384 raft_consensus.cc:2243] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.002017 15384 raft_consensus.cc:2272] T 2efa2c7bd75b49468d45b6a49ad005fc P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.003769 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.004309 15384 raft_consensus.cc:2243] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.004673 15384 raft_consensus.cc:2272] T 22769b9fbe4642f185da6c9a4f36aa30 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.006817 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.007314 15384 raft_consensus.cc:2243] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.008015 15384 raft_consensus.cc:2272] T f4dd509182394fe29d31851c23847034 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.009719 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.010252 15384 raft_consensus.cc:2243] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.010895 15384 raft_consensus.cc:2272] T 7c8bad3e990a48568e879ecb570caa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.012714 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.013198 15384 raft_consensus.cc:2243] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.013556 15384 raft_consensus.cc:2272] T bfd8bf8d048d4ad39c2f930d0606181f P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.015213 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.015812 15384 raft_consensus.cc:2243] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.016227 15384 raft_consensus.cc:2272] T b0b3b6fe106647af871885230d191f65 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.018079 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.018669 15384 raft_consensus.cc:2243] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.019057 15384 raft_consensus.cc:2272] T 4b9c9fb771764a4bb12fbf71035e081b P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.021064 23326 consensus_peers.cc:597] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.021422 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.021993 15384 raft_consensus.cc:2243] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.022642 15384 raft_consensus.cc:2272] T 7562f6ac7d8f4b459a477422faee3ad5 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.024673 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.025173 15384 raft_consensus.cc:2243] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.025516 15384 raft_consensus.cc:2272] T 15f593b2e24c4ec29a2710db6dbde323 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.027522 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.028118 15384 raft_consensus.cc:2243] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.028543 15384 raft_consensus.cc:2272] T d5348b6264474d048efc80da425fee14 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.030685 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.031167 15384 raft_consensus.cc:2243] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.031492 15384 raft_consensus.cc:2272] T bedf4afe97a74466b70b3190f1c0c1de P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.033463 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.033981 15384 raft_consensus.cc:2243] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.034808 15384 raft_consensus.cc:2272] T 3c8184122e504defbfcc6fbc81b06ab3 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.037318 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.038048 15384 raft_consensus.cc:2243] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.038552 15384 raft_consensus.cc:2272] T a3eb2b6228254ee6bc99789c42b8fa29 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.041141 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.041689 15384 raft_consensus.cc:2243] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:25.041795 23326 consensus_peers.cc:597] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.042289 15384 raft_consensus.cc:2272] T faeb76eaa46b49f398e91a6a3bbfacb1 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.044478 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.044950 15384 raft_consensus.cc:2243] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.045265 15384 raft_consensus.cc:2272] T 800fdd40a53c4181873d9251355e0317 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.046835 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.047282 15384 raft_consensus.cc:2243] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.047636 15384 raft_consensus.cc:2272] T aa2603a30eb24f32a97306bcfe46d1ec P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.049459 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.050042 15384 raft_consensus.cc:2243] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.050421 15384 raft_consensus.cc:2272] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.052450 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.053061 15384 raft_consensus.cc:2243] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.053579 15384 raft_consensus.cc:2272] T dca9f11103cd4818baf567c36c6d7ce7 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.056015 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.056679 15384 raft_consensus.cc:2243] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.057227 15384 raft_consensus.cc:2272] T 591a48f99daf4f3ca78a90b308ab3134 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.059274 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.059865 15384 raft_consensus.cc:2243] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:25.155195 23474 consensus_peers.cc:597] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.155766 23326 consensus_peers.cc:597] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.157866 23326 consensus_peers.cc:597] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.158617 23326 consensus_peers.cc:597] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.164239 23474 consensus_peers.cc:597] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.165541 23400 consensus_peers.cc:597] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.166340 23400 consensus_peers.cc:597] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.168517 15384 raft_consensus.cc:2272] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.174062 15384 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:25.179958 23400 consensus_peers.cc:597] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.181114 15384 raft_consensus.cc:2243] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.184114 15384 raft_consensus.cc:2272] T 1cdd495d63c648ff8364f543e4da9901 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.188551 23326 consensus_peers.cc:597] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.189323 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.191039 15384 raft_consensus.cc:2243] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.193955 15384 raft_consensus.cc:2272] T 6cfeaf4ca4744c74bb5c73cef813d119 P e56d4fa89a4e41fb99476c088544e8b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.204193 15384 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:25.204912 23400 consensus_peers.cc:597] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.205317 15384 raft_consensus.cc:2243] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.206514 15384 raft_consensus.cc:2272] T 6f687663b31c40fea5a41eff18c7b6d5 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.210335 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.211563 15384 raft_consensus.cc:2243] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.212881 15384 raft_consensus.cc:2272] T f0c812f930c747ba8d2e17253818f574 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.215955 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.216570 15384 raft_consensus.cc:2243] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.217018 15384 raft_consensus.cc:2272] T 7eb2904c2354438697ad5ed0013f8479 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.219885 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.221004 15384 raft_consensus.cc:2243] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.222476 15384 raft_consensus.cc:2272] T b321c32adbbf498ab098332acdde971b P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.222747 23326 consensus_peers.cc:597] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.225646 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.226413 15384 raft_consensus.cc:2243] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.227715 15384 raft_consensus.cc:2272] T 65dd0b5483a44bcba9b20f703b4f9588 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.230379 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.231197 15384 raft_consensus.cc:2243] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.232455 15384 raft_consensus.cc:2272] T 4b942ac249aa46ec842c3d763c4c5716 P e56d4fa89a4e41fb99476c088544e8b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.235970 15384 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:25.236272 23474 consensus_peers.cc:597] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.236819 15384 raft_consensus.cc:2243] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.237342 15384 raft_consensus.cc:2272] T b6cb1e511f734cf3b2669918cf9efbc7 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.240310 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.241240 15384 raft_consensus.cc:2243] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.242079 15384 raft_consensus.cc:2272] T d84edc3d80d547aba534dc0d00486d96 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.243489 23400 consensus_peers.cc:597] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.244469 23326 consensus_peers.cc:597] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.245688 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.246248 15384 raft_consensus.cc:2243] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.247872 15384 raft_consensus.cc:2272] T c9252e3ece10448a9a6b9a2a9c39e109 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.250861 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.251350 15384 raft_consensus.cc:2243] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.252868 15384 raft_consensus.cc:2272] T a86340eab4214c8faa598315e8097257 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.256592 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.257472 15384 raft_consensus.cc:2243] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.258355 15384 raft_consensus.cc:2272] T ad6889af10f54526b070fa81c53b6b92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.258697 23474 consensus_peers.cc:597] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.259905 23326 consensus_peers.cc:597] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.262271 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.263155 15384 raft_consensus.cc:2243] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.263974 15384 raft_consensus.cc:2272] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.264993 23326 consensus_peers.cc:597] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.265391 23400 consensus_peers.cc:597] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.266867 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.267405 15384 raft_consensus.cc:2243] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.267956 15384 raft_consensus.cc:2272] T 26380e16f1a247e4b9a611e57faafdf9 P e56d4fa89a4e41fb99476c088544e8b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.270407 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:25.270848 15384 raft_consensus.cc:2243] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.271296 15384 raft_consensus.cc:2272] T cdbe8c884d0146eab6e90a8245b86fe3 P e56d4fa89a4e41fb99476c088544e8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.294546 23474 consensus_peers.cc:597] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.318230 23400 consensus_peers.cc:597] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.346221 23474 consensus_peers.cc:597] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.354982 23326 consensus_peers.cc:597] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.358670 23474 consensus_peers.cc:597] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.359323 24064 connection.cc:466] server connection from 127.0.0.1:48942 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 499) could send its response
W20260709 13:10:25.360756 23474 consensus_peers.cc:597] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.361315 23474 consensus_peers.cc:597] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.379700 15384 tablet_server.cc:196] TabletServer@127.15.6.1:44223 shutdown complete.
W20260709 13:10:25.436474 23474 consensus_peers.cc:597] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.477766 23326 consensus_peers.cc:597] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 -> Peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Couldn't send request to peer e56d4fa89a4e41fb99476c088544e8b8. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.483825 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
W20260709 13:10:25.496536 23399 consensus_peers.cc:597] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.503741 23399 consensus_peers.cc:597] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.509513 23473 consensus_peers.cc:597] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.525106 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.526237 15384 tablet_replica.cc:333] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.527208 15384 raft_consensus.cc:2243] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:25.527920 23473 consensus_peers.cc:597] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.528422 15384 raft_consensus.cc:2272] T 56283a2404464c0bb214e90b06fdea8c P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.530926 15384 tablet_replica.cc:333] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.531545 15384 raft_consensus.cc:2243] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.532097 15384 raft_consensus.cc:2272] T 9d2d8f4b8d8446f6bf9822988a72557e P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.534785 15384 tablet_replica.cc:333] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.535570 15384 raft_consensus.cc:2243] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.536697 15384 raft_consensus.cc:2272] T ad6889af10f54526b070fa81c53b6b92 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.539572 15384 tablet_replica.cc:333] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.540228 15384 raft_consensus.cc:2243] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.540622 15384 raft_consensus.cc:2272] T 3c8184122e504defbfcc6fbc81b06ab3 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.542441 15384 tablet_replica.cc:333] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.543017 15384 raft_consensus.cc:2243] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.544029 15384 raft_consensus.cc:2272] T bedf4afe97a74466b70b3190f1c0c1de P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.546504 15384 tablet_replica.cc:333] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.547057 15384 raft_consensus.cc:2243] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.547672 15384 raft_consensus.cc:2272] T b321c32adbbf498ab098332acdde971b P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.550271 15384 tablet_replica.cc:333] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.550895 15384 raft_consensus.cc:2243] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.551688 15384 raft_consensus.cc:2272] T 97060878042843a39d96aa2725227238 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.553578 15384 tablet_replica.cc:333] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.554109 15384 raft_consensus.cc:2243] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.554908 15384 raft_consensus.cc:2272] T 15f593b2e24c4ec29a2710db6dbde323 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.557025 15384 tablet_replica.cc:333] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.557814 15384 raft_consensus.cc:2243] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.558408 15384 raft_consensus.cc:2272] T 2ab56513b0d44631b1b0258f31989b62 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.561051 15384 tablet_replica.cc:333] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.561553 15384 raft_consensus.cc:2243] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.562278 15384 raft_consensus.cc:2272] T 8570fd3d81f4448587060878fe3c4a60 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.564172 15384 tablet_replica.cc:333] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.564715 15384 raft_consensus.cc:2243] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.565554 15384 raft_consensus.cc:2272] T bfd8bf8d048d4ad39c2f930d0606181f P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.567909 15384 tablet_replica.cc:333] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.568396 15384 raft_consensus.cc:2243] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.568783 15384 raft_consensus.cc:2272] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.570663 15384 tablet_replica.cc:333] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.571158 15384 raft_consensus.cc:2243] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.571574 15384 raft_consensus.cc:2272] T 4b942ac249aa46ec842c3d763c4c5716 P 690e3a11be554a93b36ec5017ed89787 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.573387 15384 tablet_replica.cc:333] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.573834 15384 raft_consensus.cc:2243] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.574198 15384 raft_consensus.cc:2272] T b6cb1e511f734cf3b2669918cf9efbc7 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.575990 15384 tablet_replica.cc:333] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.576455 15384 raft_consensus.cc:2243] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.576813 15384 raft_consensus.cc:2272] T 800fdd40a53c4181873d9251355e0317 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.578660 15384 tablet_replica.cc:333] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.579174 15384 raft_consensus.cc:2243] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.579536 15384 raft_consensus.cc:2272] T a7494d11a71a4d9a93693fc53b5d2421 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.581490 15384 tablet_replica.cc:333] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.582010 15384 raft_consensus.cc:2243] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.582412 15384 raft_consensus.cc:2272] T 075558731b7c4293accc5598016e108e P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.585005 23399 consensus_peers.cc:597] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.585095 15384 tablet_replica.cc:333] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.585824 15384 raft_consensus.cc:2243] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.586724 15384 raft_consensus.cc:2272] T 26380e16f1a247e4b9a611e57faafdf9 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.587055 23473 consensus_peers.cc:597] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.588953 15384 tablet_replica.cc:333] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.589659 15384 raft_consensus.cc:2243] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.590317 15384 raft_consensus.cc:2272] T cdbe8c884d0146eab6e90a8245b86fe3 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.593394 15384 tablet_replica.cc:333] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.594184 15384 raft_consensus.cc:2243] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.594704 15384 raft_consensus.cc:2272] T d9b34184164445d4bf8bb87b3e76b22d P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.595531 23399 consensus_peers.cc:597] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.597482 15384 tablet_replica.cc:333] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.598258 15384 raft_consensus.cc:2243] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.599224 15384 raft_consensus.cc:2272] T d5348b6264474d048efc80da425fee14 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.601954 15384 tablet_replica.cc:333] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.602665 15384 raft_consensus.cc:2243] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.603205 15384 raft_consensus.cc:2272] T 7c8bad3e990a48568e879ecb570caa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.605844 15384 tablet_replica.cc:333] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.606491 15384 raft_consensus.cc:2243] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.607039 15384 raft_consensus.cc:2272] T 5cc9b65add704609837229927a148b95 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.609751 15384 tablet_replica.cc:333] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.610386 15384 raft_consensus.cc:2243] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.610924 15384 raft_consensus.cc:2272] T 6cfeaf4ca4744c74bb5c73cef813d119 P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.613701 15384 tablet_replica.cc:333] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
W20260709 13:10:25.614283 23399 consensus_peers.cc:597] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.614387 15384 raft_consensus.cc:2243] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.615656 15384 raft_consensus.cc:2272] T 6f687663b31c40fea5a41eff18c7b6d5 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.617779 15384 tablet_replica.cc:333] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.618283 15384 raft_consensus.cc:2243] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.618714 15384 raft_consensus.cc:2272] T 1cdd495d63c648ff8364f543e4da9901 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.620551 15384 tablet_replica.cc:333] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.621034 15384 raft_consensus.cc:2243] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.621429 15384 raft_consensus.cc:2272] T 30b043244b784f45b564c43cf1477286 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.623407 15384 tablet_replica.cc:333] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.623946 15384 raft_consensus.cc:2243] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.624317 15384 raft_consensus.cc:2272] T faeb76eaa46b49f398e91a6a3bbfacb1 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.626204 15384 tablet_replica.cc:333] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.626693 15384 raft_consensus.cc:2243] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.627501 15384 raft_consensus.cc:2272] T a3eb2b6228254ee6bc99789c42b8fa29 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.630303 15384 tablet_replica.cc:333] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.631037 15384 raft_consensus.cc:2243] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.631570 15384 raft_consensus.cc:2272] T f0c812f930c747ba8d2e17253818f574 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.636408 15384 tablet_replica.cc:333] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.637141 15384 raft_consensus.cc:2243] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.638171 15384 raft_consensus.cc:2272] T 7eb2904c2354438697ad5ed0013f8479 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.640530 15384 tablet_replica.cc:333] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.641065 15384 raft_consensus.cc:2243] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.641501 15384 raft_consensus.cc:2272] T d7300cd12cfb435b920f7079d2605e20 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.643615 15384 tablet_replica.cc:333] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.644130 15384 raft_consensus.cc:2243] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.644583 15384 raft_consensus.cc:2272] T c9252e3ece10448a9a6b9a2a9c39e109 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.646612 15384 tablet_replica.cc:333] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.647351 15384 raft_consensus.cc:2243] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.647861 15384 raft_consensus.cc:2272] T a86340eab4214c8faa598315e8097257 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.649967 15384 tablet_replica.cc:333] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.650413 15384 raft_consensus.cc:2243] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.651149 15384 raft_consensus.cc:2272] T 295ce00aba194098a6b6e3736a7c7b8d P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.652958 15384 tablet_replica.cc:333] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.653424 15384 raft_consensus.cc:2243] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.653857 15384 raft_consensus.cc:2272] T 2efa2c7bd75b49468d45b6a49ad005fc P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.655668 15384 tablet_replica.cc:333] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.656322 15384 raft_consensus.cc:2243] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.656813 15384 raft_consensus.cc:2272] T c9c98c482f2e46369c59ac866488c0e4 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.659265 15384 tablet_replica.cc:333] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.659775 15384 raft_consensus.cc:2243] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.660388 15384 raft_consensus.cc:2272] T 9223cb5b87c546029aaf855836b6e545 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.662472 15384 tablet_replica.cc:333] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.663146 15384 raft_consensus.cc:2243] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.663663 15384 raft_consensus.cc:2272] T 524a9d5200604a8183ccae982b284bac P 690e3a11be554a93b36ec5017ed89787 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.665985 15384 tablet_replica.cc:333] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.666433 15384 raft_consensus.cc:2243] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.666808 15384 raft_consensus.cc:2272] T 846d941237a64689b8c0a9604d7635d9 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.669055 15384 tablet_replica.cc:333] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.669667 15384 raft_consensus.cc:2243] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.670115 15384 raft_consensus.cc:2272] T abf5322b429943b79e7e871a1f61ce06 P 690e3a11be554a93b36ec5017ed89787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.672667 15384 tablet_replica.cc:333] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.673278 15384 raft_consensus.cc:2243] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.674417 15384 raft_consensus.cc:2272] T ddc99a8f26574b5e9d7a7d91000bf4a2 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.677291 15384 tablet_replica.cc:333] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.677954 15384 raft_consensus.cc:2243] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.679222 15384 raft_consensus.cc:2272] T aa2603a30eb24f32a97306bcfe46d1ec P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.682050 15384 tablet_replica.cc:333] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787: stopping tablet replica
I20260709 13:10:25.682590 15384 raft_consensus.cc:2243] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.683096 15384 raft_consensus.cc:2272] T dca9f11103cd4818baf567c36c6d7ce7 P 690e3a11be554a93b36ec5017ed89787 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.683670 23399 consensus_peers.cc:597] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.683876 23473 consensus_peers.cc:597] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.685905 23473 consensus_peers.cc:597] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.698065 23399 consensus_peers.cc:597] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.716898 23473 consensus_peers.cc:597] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.760986 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
W20260709 13:10:25.779604 23473 consensus_peers.cc:597] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.782495 23399 consensus_peers.cc:597] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.825521 23399 consensus_peers.cc:597] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:25.828217 23473 consensus_peers.cc:597] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.842406 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
W20260709 13:10:25.869585 23472 consensus_peers.cc:597] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.885109 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.885845 15384 tablet_replica.cc:333] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.886452 15384 raft_consensus.cc:2243] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.887267 15384 raft_consensus.cc:2272] T 9d2d8f4b8d8446f6bf9822988a72557e P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.889858 15384 tablet_replica.cc:333] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.890511 15384 raft_consensus.cc:2243] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.891055 15384 raft_consensus.cc:2272] T 34ad643f490e4b029e3b1a87544df7e7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.892207 23473 consensus_peers.cc:597] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.893869 15384 tablet_replica.cc:333] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.894441 15384 raft_consensus.cc:2243] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.894814 15384 raft_consensus.cc:2272] T 3c8184122e504defbfcc6fbc81b06ab3 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.896643 15384 tablet_replica.cc:333] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.897209 15384 raft_consensus.cc:2243] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.897578 15384 raft_consensus.cc:2272] T bedf4afe97a74466b70b3190f1c0c1de P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.899471 15384 tablet_replica.cc:333] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.899981 15384 raft_consensus.cc:2243] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.900334 15384 raft_consensus.cc:2272] T 97060878042843a39d96aa2725227238 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.902089 15384 tablet_replica.cc:333] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.902663 15384 raft_consensus.cc:2243] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.903199 15384 raft_consensus.cc:2272] T 65dd0b5483a44bcba9b20f703b4f9588 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.905778 15384 tablet_replica.cc:333] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.906477 15384 raft_consensus.cc:2243] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.907545 15384 raft_consensus.cc:2272] T 2ab56513b0d44631b1b0258f31989b62 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.910120 15384 tablet_replica.cc:333] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.910826 15384 raft_consensus.cc:2243] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.911376 15384 raft_consensus.cc:2272] T 8570fd3d81f4448587060878fe3c4a60 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.913532 23472 consensus_peers.cc:597] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.913686 15384 tablet_replica.cc:333] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.914342 15384 raft_consensus.cc:2243] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.914757 15384 raft_consensus.cc:2272] T b0b3b6fe106647af871885230d191f65 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.916656 15384 tablet_replica.cc:333] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.917131 15384 raft_consensus.cc:2243] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.917520 15384 raft_consensus.cc:2272] T bfd8bf8d048d4ad39c2f930d0606181f P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.919376 15384 tablet_replica.cc:333] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.919916 15384 raft_consensus.cc:2243] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.920302 15384 raft_consensus.cc:2272] T abf5322b429943b79e7e871a1f61ce06 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.922145 15384 tablet_replica.cc:333] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.922674 15384 raft_consensus.cc:2243] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.923064 15384 raft_consensus.cc:2272] T 7562f6ac7d8f4b459a477422faee3ad5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.924897 15384 tablet_replica.cc:333] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.925447 15384 raft_consensus.cc:2243] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.925853 15384 raft_consensus.cc:2272] T 4b9c9fb771764a4bb12fbf71035e081b P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.927767 15384 tablet_replica.cc:333] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.928305 15384 raft_consensus.cc:2243] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.929036 15384 raft_consensus.cc:2272] T ac5e3b8a31e54e7186eff3a07ae3dcae P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.931000 15384 tablet_replica.cc:333] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.931722 15384 raft_consensus.cc:2243] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.932377 15384 raft_consensus.cc:2272] T 26380e16f1a247e4b9a611e57faafdf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.934762 15384 tablet_replica.cc:333] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.935333 15384 raft_consensus.cc:2243] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.935746 15384 raft_consensus.cc:2272] T 075558731b7c4293accc5598016e108e P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.937668 15384 tablet_replica.cc:333] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.938192 15384 raft_consensus.cc:2243] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.938573 15384 raft_consensus.cc:2272] T d5348b6264474d048efc80da425fee14 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.940440 15384 tablet_replica.cc:333] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.941175 15384 raft_consensus.cc:2243] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.941637 15384 raft_consensus.cc:2272] T d9b34184164445d4bf8bb87b3e76b22d P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.943557 15384 tablet_replica.cc:333] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.944113 15384 raft_consensus.cc:2243] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:25.944325 23399 consensus_peers.cc:597] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 -> Peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Couldn't send request to peer 690e3a11be554a93b36ec5017ed89787. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.944530 15384 raft_consensus.cc:2272] T 591a48f99daf4f3ca78a90b308ab3134 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.946424 15384 tablet_replica.cc:333] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.946913 15384 raft_consensus.cc:2243] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.947615 15384 raft_consensus.cc:2272] T dca9f11103cd4818baf567c36c6d7ce7 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.949393 15384 tablet_replica.cc:333] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.949858 15384 raft_consensus.cc:2243] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.950549 15384 raft_consensus.cc:2272] T d7300cd12cfb435b920f7079d2605e20 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.952436 15384 tablet_replica.cc:333] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.952924 15384 raft_consensus.cc:2243] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.953321 15384 raft_consensus.cc:2272] T c9252e3ece10448a9a6b9a2a9c39e109 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.955128 15384 tablet_replica.cc:333] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.955597 15384 raft_consensus.cc:2243] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.956027 15384 raft_consensus.cc:2272] T a86340eab4214c8faa598315e8097257 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.957957 15384 tablet_replica.cc:333] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.958421 15384 raft_consensus.cc:2243] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.959196 15384 raft_consensus.cc:2272] T d84edc3d80d547aba534dc0d00486d96 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.960945 15384 tablet_replica.cc:333] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.961405 15384 raft_consensus.cc:2243] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.962119 15384 raft_consensus.cc:2272] T c9c98c482f2e46369c59ac866488c0e4 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.963855 15384 tablet_replica.cc:333] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.964308 15384 raft_consensus.cc:2243] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.964970 15384 raft_consensus.cc:2272] T 9223cb5b87c546029aaf855836b6e545 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.966643 15384 tablet_replica.cc:333] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.967149 15384 raft_consensus.cc:2243] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.968075 15384 raft_consensus.cc:2272] T 5ba0176229a34f60bf5899d36f898fe5 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.970517 15384 tablet_replica.cc:333] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.971120 15384 raft_consensus.cc:2243] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.972075 15384 raft_consensus.cc:2272] T 524a9d5200604a8183ccae982b284bac P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.974191 15384 tablet_replica.cc:333] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.974673 15384 raft_consensus.cc:2243] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.975468 15384 raft_consensus.cc:2272] T e383f298f23f4ba8bb47a27742f0bff0 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.977381 15384 tablet_replica.cc:333] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.977829 15384 raft_consensus.cc:2243] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.978191 15384 raft_consensus.cc:2272] T 2efa2c7bd75b49468d45b6a49ad005fc P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.979985 15384 tablet_replica.cc:333] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.980417 15384 raft_consensus.cc:2243] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.980751 15384 raft_consensus.cc:2272] T b1af8f7f5d2f49d2a6bafad6338a0e92 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.982400 15384 tablet_replica.cc:333] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.982843 15384 raft_consensus.cc:2243] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.983192 15384 raft_consensus.cc:2272] T 30b043244b784f45b564c43cf1477286 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.984931 15384 tablet_replica.cc:333] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.985342 15384 raft_consensus.cc:2243] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.985699 15384 raft_consensus.cc:2272] T 6cfeaf4ca4744c74bb5c73cef813d119 P 5e2983c2051a44788d4064010321c7f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.987416 15384 tablet_replica.cc:333] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.987871 15384 raft_consensus.cc:2243] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.988219 15384 raft_consensus.cc:2272] T 6f687663b31c40fea5a41eff18c7b6d5 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.990046 15384 tablet_replica.cc:333] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.990464 15384 raft_consensus.cc:2243] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.990927 15384 raft_consensus.cc:2272] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.993251 15384 tablet_replica.cc:333] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.993845 15384 raft_consensus.cc:2243] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.994751 15384 raft_consensus.cc:2272] T 5cc9b65add704609837229927a148b95 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.996845 15384 tablet_replica.cc:333] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:25.997323 15384 raft_consensus.cc:2243] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.997983 15384 raft_consensus.cc:2272] T 22769b9fbe4642f185da6c9a4f36aa30 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.999881 15384 tablet_replica.cc:333] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:26.000293 15384 raft_consensus.cc:2243] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.000633 15384 raft_consensus.cc:2272] T 7eb2904c2354438697ad5ed0013f8479 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.002521 15384 tablet_replica.cc:333] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:26.003095 15384 raft_consensus.cc:2243] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.004030 15384 raft_consensus.cc:2272] T 846d941237a64689b8c0a9604d7635d9 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:26.004297 23472 consensus_peers.cc:597] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.005916 15384 tablet_replica.cc:333] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:26.006470 15384 raft_consensus.cc:2243] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.006937 15384 raft_consensus.cc:2272] T f4dd509182394fe29d31851c23847034 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.008674 15384 tablet_replica.cc:333] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:26.009119 15384 raft_consensus.cc:2243] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.009501 15384 raft_consensus.cc:2272] T 7c8bad3e990a48568e879ecb570caa29 P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.011202 15384 tablet_replica.cc:333] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:26.011647 15384 raft_consensus.cc:2243] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.012410 15384 raft_consensus.cc:2272] T b6cb1e511f734cf3b2669918cf9efbc7 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.014170 15384 tablet_replica.cc:333] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:26.014601 15384 raft_consensus.cc:2243] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.015005 15384 raft_consensus.cc:2272] T a7494d11a71a4d9a93693fc53b5d2421 P 5e2983c2051a44788d4064010321c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.017004 15384 tablet_replica.cc:333] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5: stopping tablet replica
I20260709 13:10:26.017436 15384 raft_consensus.cc:2243] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.017830 15384 raft_consensus.cc:2272] T 106c7f82b57a430e8e9c9d0c209d5a5a P 5e2983c2051a44788d4064010321c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.272982 24391 raft_consensus.cc:493] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:26.273586 24391 raft_consensus.cc:515] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:26.275206 24391 leader_election.cc:290] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
W20260709 13:10:26.319541 23472 consensus_peers.cc:597] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:26.319662 23398 connection.cc:466] server connection from 127.0.0.1:53290 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 894) could send its response
W20260709 13:10:26.320657 23398 connection.cc:466] server connection from 127.0.0.1:53290 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 895) could send its response
I20260709 13:10:26.323122 24241 raft_consensus.cc:493] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:26.324023 24241 raft_consensus.cc:515] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:26.325893 24241 leader_election.cc:290] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
W20260709 13:10:26.323154 23472 consensus_peers.cc:597] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Network error: recv got EOF from 127.15.6.3:38025 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:26.328296 23472 leader_election.cc:336] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Network error: recv got EOF from 127.15.6.3:38025 (error 108)
W20260709 13:10:26.335827 23472 consensus_peers.cc:597] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:26.336292 23472 consensus_peers.cc:597] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:26.336704 23472 leader_election.cc:336] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111)
W20260709 13:10:26.337162 23472 consensus_peers.cc:597] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.345197 24391 raft_consensus.cc:493] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:26.345722 24368 raft_consensus.cc:493] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:26.345844 24391 raft_consensus.cc:515] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
I20260709 13:10:26.346320 24368 raft_consensus.cc:515] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:26.348265 24368 leader_election.cc:290] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
I20260709 13:10:26.349146 24391 leader_election.cc:290] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
W20260709 13:10:26.353149 23473 leader_election.cc:336] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111)
I20260709 13:10:26.354609 24394 raft_consensus.cc:493] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
W20260709 13:10:26.359490 23474 leader_election.cc:336] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:26.359853 23474 leader_election.cc:304] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:26.360379 24391 raft_consensus.cc:2749] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:26.360848 23474 leader_election.cc:336] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:26.361253 23474 leader_election.cc:304] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
W20260709 13:10:26.361541 23472 consensus_peers.cc:597] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:26.361966 23472 consensus_peers.cc:597] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:26.362250 23474 leader_election.cc:336] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:26.362651 23474 leader_election.cc:304] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:26.363162 24391 raft_consensus.cc:2749] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.355645 24394 raft_consensus.cc:515] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2983c2051a44788d4064010321c7f5" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38025 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } }
W20260709 13:10:26.363920 23472 leader_election.cc:336] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111)
I20260709 13:10:26.365046 24394 leader_election.cc:290] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025), e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223)
I20260709 13:10:26.365618 24368 raft_consensus.cc:2749] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:26.365762 23474 leader_election.cc:336] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:26.366192 23474 leader_election.cc:304] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:26.366796 24394 raft_consensus.cc:2749] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:26.368722 23472 leader_election.cc:336] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111)
W20260709 13:10:26.372114 23474 leader_election.cc:336] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
I20260709 13:10:26.372618 23474 leader_election.cc:304] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 5e2983c2051a44788d4064010321c7f5, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:26.373628 24391 raft_consensus.cc:2749] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:26.385596 23472 consensus_peers.cc:597] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d -> Peer 5e2983c2051a44788d4064010321c7f5 (127.15.6.3:38025): Couldn't send request to peer 5e2983c2051a44788d4064010321c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.3:38025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.386736 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
I20260709 13:10:26.397024 24391 raft_consensus.cc:493] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e56d4fa89a4e41fb99476c088544e8b8)
I20260709 13:10:26.397514 24391 raft_consensus.cc:515] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56d4fa89a4e41fb99476c088544e8b8" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 44223 } } peers { permanent_uuid: "e971a25f8dfb42fcb1afb9ecf74f760d" member_type: VOTER last_known_addr { host: "127.15.6.4" port: 38341 } } peers { permanent_uuid: "690e3a11be554a93b36ec5017ed89787" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 43361 } }
I20260709 13:10:26.399380 24391 leader_election.cc:290] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223), 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361)
W20260709 13:10:26.403316 23474 leader_election.cc:336] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e56d4fa89a4e41fb99476c088544e8b8 (127.15.6.1:44223): Network error: Client connection negotiation failed: client connection to 127.15.6.1:44223: connect: Connection refused (error 111)
W20260709 13:10:26.403957 23473 leader_election.cc:336] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 690e3a11be554a93b36ec5017ed89787 (127.15.6.2:43361): Network error: Client connection negotiation failed: client connection to 127.15.6.2:43361: connect: Connection refused (error 111)
I20260709 13:10:26.404279 23473 leader_election.cc:304] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e971a25f8dfb42fcb1afb9ecf74f760d; no voters: 690e3a11be554a93b36ec5017ed89787, e56d4fa89a4e41fb99476c088544e8b8
I20260709 13:10:26.404865 24391 raft_consensus.cc:2749] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.454735 15384 tablet_server.cc:179] TabletServer@127.15.6.4:0 shutting down...
I20260709 13:10:26.494288 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:26.494915 15384 tablet_replica.cc:333] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.495519 15384 raft_consensus.cc:2243] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.495965 15384 raft_consensus.cc:2272] T 9d2d8f4b8d8446f6bf9822988a72557e P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.497946 15384 tablet_replica.cc:333] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.498438 15384 raft_consensus.cc:2243] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.498829 15384 raft_consensus.cc:2272] T 56283a2404464c0bb214e90b06fdea8c P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.500590 15384 tablet_replica.cc:333] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.501106 15384 raft_consensus.cc:2243] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.501449 15384 raft_consensus.cc:2272] T ad6889af10f54526b070fa81c53b6b92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.503145 15384 tablet_replica.cc:333] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.503618 15384 raft_consensus.cc:2243] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.504299 15384 raft_consensus.cc:2272] T 34ad643f490e4b029e3b1a87544df7e7 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.506042 15384 tablet_replica.cc:333] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.506561 15384 raft_consensus.cc:2243] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.507242 15384 raft_consensus.cc:2272] T b0b3b6fe106647af871885230d191f65 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.509090 15384 tablet_replica.cc:333] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.509593 15384 raft_consensus.cc:2243] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.509953 15384 raft_consensus.cc:2272] T 97060878042843a39d96aa2725227238 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.511677 15384 tablet_replica.cc:333] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.512205 15384 raft_consensus.cc:2243] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.512575 15384 raft_consensus.cc:2272] T b321c32adbbf498ab098332acdde971b P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.514469 15384 tablet_replica.cc:333] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.514966 15384 raft_consensus.cc:2243] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.515326 15384 raft_consensus.cc:2272] T 65dd0b5483a44bcba9b20f703b4f9588 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.517176 15384 tablet_replica.cc:333] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.517676 15384 raft_consensus.cc:2243] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.518041 15384 raft_consensus.cc:2272] T 2ab56513b0d44631b1b0258f31989b62 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.520001 15384 tablet_replica.cc:333] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.520485 15384 raft_consensus.cc:2243] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.520831 15384 raft_consensus.cc:2272] T 15f593b2e24c4ec29a2710db6dbde323 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.522651 15384 tablet_replica.cc:333] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.523118 15384 raft_consensus.cc:2243] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.523491 15384 raft_consensus.cc:2272] T 8570fd3d81f4448587060878fe3c4a60 P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.525358 15384 tablet_replica.cc:333] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.525794 15384 raft_consensus.cc:2243] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.526475 15384 raft_consensus.cc:2272] T 591a48f99daf4f3ca78a90b308ab3134 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.528359 15384 tablet_replica.cc:333] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.528858 15384 raft_consensus.cc:2243] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.529309 15384 raft_consensus.cc:2272] T f0c812f930c747ba8d2e17253818f574 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.531311 15384 tablet_replica.cc:333] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.531903 15384 raft_consensus.cc:2243] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:26.532398 23475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.532574 15384 raft_consensus.cc:2272] T 1f5153ef78cf4bf89ae5eb12f0f475b4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.534547 15384 tablet_replica.cc:333] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.535024 15384 raft_consensus.cc:2243] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.535666 15384 raft_consensus.cc:2272] T 075558731b7c4293accc5598016e108e P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.537511 15384 tablet_replica.cc:333] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.537992 15384 raft_consensus.cc:2243] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.538363 15384 raft_consensus.cc:2272] T 7562f6ac7d8f4b459a477422faee3ad5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.540283 15384 tablet_replica.cc:333] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.540738 15384 raft_consensus.cc:2243] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.541375 15384 raft_consensus.cc:2272] T 4b9c9fb771764a4bb12fbf71035e081b P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.543072 15384 tablet_replica.cc:333] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.543552 15384 raft_consensus.cc:2243] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.543938 15384 raft_consensus.cc:2272] T a3eb2b6228254ee6bc99789c42b8fa29 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.545732 15384 tablet_replica.cc:333] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.546190 15384 raft_consensus.cc:2243] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.546844 15384 raft_consensus.cc:2272] T faeb76eaa46b49f398e91a6a3bbfacb1 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.548632 15384 tablet_replica.cc:333] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.549083 15384 raft_consensus.cc:2243] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.549436 15384 raft_consensus.cc:2272] T ac5e3b8a31e54e7186eff3a07ae3dcae P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.551112 15384 tablet_replica.cc:333] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.551594 15384 raft_consensus.cc:2243] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.552285 15384 raft_consensus.cc:2272] T cdbe8c884d0146eab6e90a8245b86fe3 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.554118 15384 tablet_replica.cc:333] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.554610 15384 raft_consensus.cc:2243] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.555256 15384 raft_consensus.cc:2272] T d9b34184164445d4bf8bb87b3e76b22d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.556990 15384 tablet_replica.cc:333] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.557480 15384 raft_consensus.cc:2243] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.557821 15384 raft_consensus.cc:2272] T 441e0cae71fc45e4b1f2c0b4aa958cf9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.559607 15384 tablet_replica.cc:333] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.560119 15384 raft_consensus.cc:2243] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.560488 15384 raft_consensus.cc:2272] T 1cdd495d63c648ff8364f543e4da9901 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.562255 15384 tablet_replica.cc:333] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.562748 15384 raft_consensus.cc:2243] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.563074 15384 raft_consensus.cc:2272] T 5cc9b65add704609837229927a148b95 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.564836 15384 tablet_replica.cc:333] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.565294 15384 raft_consensus.cc:2243] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.565639 15384 raft_consensus.cc:2272] T f4dd509182394fe29d31851c23847034 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.567258 15384 tablet_replica.cc:333] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.567703 15384 raft_consensus.cc:2243] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.568463 15384 raft_consensus.cc:2272] T abf5322b429943b79e7e871a1f61ce06 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.570139 15384 tablet_replica.cc:333] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.570623 15384 raft_consensus.cc:2243] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.570971 15384 raft_consensus.cc:2272] T ddc99a8f26574b5e9d7a7d91000bf4a2 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.572757 15384 tablet_replica.cc:333] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.573261 15384 raft_consensus.cc:2243] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.573613 15384 raft_consensus.cc:2272] T e383f298f23f4ba8bb47a27742f0bff0 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.575389 15384 tablet_replica.cc:333] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.575866 15384 raft_consensus.cc:2243] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.576197 15384 raft_consensus.cc:2272] T 295ce00aba194098a6b6e3736a7c7b8d P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.577968 15384 tablet_replica.cc:333] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.578490 15384 raft_consensus.cc:2243] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.578871 15384 raft_consensus.cc:2272] T aa2603a30eb24f32a97306bcfe46d1ec P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.580482 15384 tablet_replica.cc:333] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.580914 15384 raft_consensus.cc:2243] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.581583 15384 raft_consensus.cc:2272] T 800fdd40a53c4181873d9251355e0317 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.583190 15384 tablet_replica.cc:333] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.583616 15384 raft_consensus.cc:2243] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.584291 15384 raft_consensus.cc:2272] T a7494d11a71a4d9a93693fc53b5d2421 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.585943 15384 tablet_replica.cc:333] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.586370 15384 raft_consensus.cc:2243] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.586985 15384 raft_consensus.cc:2272] T 106c7f82b57a430e8e9c9d0c209d5a5a P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.588625 15384 tablet_replica.cc:333] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.589040 15384 raft_consensus.cc:2243] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.589376 15384 raft_consensus.cc:2272] T 846d941237a64689b8c0a9604d7635d9 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.591404 15384 tablet_replica.cc:333] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.591854 15384 raft_consensus.cc:2243] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.592262 15384 raft_consensus.cc:2272] T 4b942ac249aa46ec842c3d763c4c5716 P e971a25f8dfb42fcb1afb9ecf74f760d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.593839 15384 tablet_replica.cc:333] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.594462 15384 raft_consensus.cc:2243] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.595184 15384 raft_consensus.cc:2272] T b1af8f7f5d2f49d2a6bafad6338a0e92 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.596942 15384 tablet_replica.cc:333] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.597415 15384 raft_consensus.cc:2243] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.598075 15384 raft_consensus.cc:2272] T 30b043244b784f45b564c43cf1477286 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.599921 15384 tablet_replica.cc:333] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.600364 15384 raft_consensus.cc:2243] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.600822 15384 raft_consensus.cc:2272] T 22769b9fbe4642f185da6c9a4f36aa30 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.602633 15384 tablet_replica.cc:333] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.603050 15384 raft_consensus.cc:2243] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.603402 15384 raft_consensus.cc:2272] T c9c98c482f2e46369c59ac866488c0e4 P e971a25f8dfb42fcb1afb9ecf74f760d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.605070 15384 tablet_replica.cc:333] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.605485 15384 raft_consensus.cc:2243] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.605849 15384 raft_consensus.cc:2272] T 524a9d5200604a8183ccae982b284bac P e971a25f8dfb42fcb1afb9ecf74f760d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.607560 15384 tablet_replica.cc:333] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.608027 15384 raft_consensus.cc:2243] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.608393 15384 raft_consensus.cc:2272] T 5ba0176229a34f60bf5899d36f898fe5 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.609982 15384 tablet_replica.cc:333] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.610368 15384 raft_consensus.cc:2243] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.610693 15384 raft_consensus.cc:2272] T d7300cd12cfb435b920f7079d2605e20 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.612335 15384 tablet_replica.cc:333] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d: stopping tablet replica
I20260709 13:10:26.612707 15384 raft_consensus.cc:2243] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.613031 15384 raft_consensus.cc:2272] T d84edc3d80d547aba534dc0d00486d96 P e971a25f8dfb42fcb1afb9ecf74f760d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:27.285393 23530 debug-util.cc:398] Leaking SignalData structure 0x7b0800130740 after lost signal to thread 15387
W20260709 13:10:27.286330 23530 debug-util.cc:398] Leaking SignalData structure 0x7b0800130e20 after lost signal to thread 23218
W20260709 13:10:27.674052 15384 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23530)
W20260709 13:10:28.674551 15384 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23530)
W20260709 13:10:29.674921 15384 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23530)
I20260709 13:10:29.792263 15384 tablet_server.cc:196] TabletServer@127.15.6.4:0 shutdown complete.
I20260709 13:10:29.856204 15384 master.cc:562] Master@127.15.6.62:38693 shutting down...
I20260709 13:10:29.878516 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:29.879083 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:29.879412 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P bd1ff099db324951ac10792dbb562230: stopping tablet replica
I20260709 13:10:29.900156 15384 master.cc:584] Master@127.15.6.62:38693 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37279 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:10:29.979044 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:40757
I20260709 13:10:29.980106 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:29.985327 24396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:29.985675 24397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:29.986445 24399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:29.986594 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:29.987684 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:29.988060 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:29.988216 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602629988198 us; error 0 us; skew 500 ppm
I20260709 13:10:29.988708 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:29.990847 15384 webserver.cc:533] Webserver started at http://127.15.6.62:37675/ using document root <none> and password file <none>
I20260709 13:10:29.991287 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:29.991443 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:29.991678 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:29.992744 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51"
format_stamp: "Formatted at 2026-07-09 13:10:29 on dist-test-slave-pqzm"
I20260709 13:10:29.996902 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:29.999876 24404 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.000523 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:30.000771 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51"
format_stamp: "Formatted at 2026-07-09 13:10:29 on dist-test-slave-pqzm"
I20260709 13:10:30.001017 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:30.024137 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:30.025256 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:30.060293 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:40757
I20260709 13:10:30.060380 24455 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:40757 every 8 connection(s)
I20260709 13:10:30.063936 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.073709 24456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51: Bootstrap starting.
I20260709 13:10:30.078096 24456 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.081893 24456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51: No bootstrap required, opened a new log
I20260709 13:10:30.083951 24456 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" member_type: VOTER }
I20260709 13:10:30.084311 24456 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.084522 24456 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c8dec78402a4f7aa837a4fe1fc1ef51, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.085048 24456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" member_type: VOTER }
I20260709 13:10:30.085466 24456 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:30.085664 24456 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:30.085904 24456 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.089797 24456 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" member_type: VOTER }
I20260709 13:10:30.090238 24456 leader_election.cc:304] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c8dec78402a4f7aa837a4fe1fc1ef51; no voters: 
I20260709 13:10:30.091233 24456 leader_election.cc:290] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:30.091604 24459 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.092859 24459 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 1 LEADER]: Becoming Leader. State: Replica: 1c8dec78402a4f7aa837a4fe1fc1ef51, State: Running, Role: LEADER
I20260709 13:10:30.093489 24459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" member_type: VOTER }
I20260709 13:10:30.093906 24456 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:30.097936 24460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" member_type: VOTER } }
I20260709 13:10:30.098565 24460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:30.100111 24461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c8dec78402a4f7aa837a4fe1fc1ef51. Latest consensus state: current_term: 1 leader_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8dec78402a4f7aa837a4fe1fc1ef51" member_type: VOTER } }
I20260709 13:10:30.100404 24466 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:30.100672 24461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:30.106012 24466 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:30.109145 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:30.114583 24466 catalog_manager.cc:1383] Generated new cluster ID: 3281cc6982314202b95f1657373a4b27
I20260709 13:10:30.114787 24466 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:30.132390 24466 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:30.133497 24466 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:30.159960 24466 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51: Generated new TSK 0
I20260709 13:10:30.160478 24466 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:30.175593 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:30.181463 24477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:30.182245 24478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:30.189584 24480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:30.189664 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:30.190824 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:30.191032 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:30.191175 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602630191158 us; error 0 us; skew 500 ppm
I20260709 13:10:30.191664 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:30.193737 15384 webserver.cc:533] Webserver started at http://127.15.6.1:38447/ using document root <none> and password file <none>
I20260709 13:10:30.194182 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:30.194348 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:30.194593 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:30.195611 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "d7d5902b8d2e4123852604f001c83cec"
format_stamp: "Formatted at 2026-07-09 13:10:30 on dist-test-slave-pqzm"
I20260709 13:10:30.199744 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:10:30.203022 24485 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.203758 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:30.204080 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "d7d5902b8d2e4123852604f001c83cec"
format_stamp: "Formatted at 2026-07-09 13:10:30 on dist-test-slave-pqzm"
I20260709 13:10:30.204387 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:30.215600 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:30.216743 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:30.218127 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:30.220366 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:30.220551 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.220762 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:30.220921 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.259547 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:38011
I20260709 13:10:30.259651 24547 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:38011 every 8 connection(s)
I20260709 13:10:30.264335 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:30.271521 24552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:30.273569 24553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:30.274241 24555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:30.274705 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:30.275833 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:30.276036 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:30.276191 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602630276173 us; error 0 us; skew 500 ppm
I20260709 13:10:30.276675 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:30.278825 15384 webserver.cc:533] Webserver started at http://127.15.6.2:40647/ using document root <none> and password file <none>
I20260709 13:10:30.279259 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:30.279439 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:30.279673 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:30.280794 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
format_stamp: "Formatted at 2026-07-09 13:10:30 on dist-test-slave-pqzm"
I20260709 13:10:30.283500 24548 heartbeater.cc:344] Connected to a master server at 127.15.6.62:40757
I20260709 13:10:30.283898 24548 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:30.284528 24548 heartbeater.cc:507] Master 127.15.6.62:40757 requested a full tablet report, sending...
I20260709 13:10:30.285972 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:10:30.286552 24421 ts_manager.cc:194] Registered new tserver with Master: d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011)
I20260709 13:10:30.288980 24421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60892
I20260709 13:10:30.290136 24560 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.291007 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:30.291319 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
format_stamp: "Formatted at 2026-07-09 13:10:30 on dist-test-slave-pqzm"
I20260709 13:10:30.291617 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:30.301978 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:30.303051 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:30.304512 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:30.306617 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:30.306792 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.306999 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:30.307132 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.344048 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:46839
I20260709 13:10:30.344148 24622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:46839 every 8 connection(s)
I20260709 13:10:30.348497 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:30.355070 24626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:30.356341 24627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:30.358299 24629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:30.359153 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:30.360049 24623 heartbeater.cc:344] Connected to a master server at 127.15.6.62:40757
I20260709 13:10:30.360220 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:30.360491 24623 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:30.360502 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:30.360903 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602630360882 us; error 0 us; skew 500 ppm
I20260709 13:10:30.361462 24623 heartbeater.cc:507] Master 127.15.6.62:40757 requested a full tablet report, sending...
I20260709 13:10:30.361670 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:30.363547 24421 ts_manager.cc:194] Registered new tserver with Master: 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:30.364214 15384 webserver.cc:533] Webserver started at http://127.15.6.3:37473/ using document root <none> and password file <none>
I20260709 13:10:30.364691 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:30.364857 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:30.364988 24421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60894
I20260709 13:10:30.365087 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:30.366370 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "4c90fd653e3e4007aafee61437223c67"
format_stamp: "Formatted at 2026-07-09 13:10:30 on dist-test-slave-pqzm"
I20260709 13:10:30.370477 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:10:30.373478 24634 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.374135 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:30.374403 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "4c90fd653e3e4007aafee61437223c67"
format_stamp: "Formatted at 2026-07-09 13:10:30 on dist-test-slave-pqzm"
I20260709 13:10:30.374650 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:30.384423 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:30.385465 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:30.386763 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:30.388859 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:30.389043 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.389245 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:30.389390 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:30.427314 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:38707
I20260709 13:10:30.427429 24696 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:38707 every 8 connection(s)
I20260709 13:10:30.439909 24697 heartbeater.cc:344] Connected to a master server at 127.15.6.62:40757
I20260709 13:10:30.440307 24697 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:30.440996 24697 heartbeater.cc:507] Master 127.15.6.62:40757 requested a full tablet report, sending...
I20260709 13:10:30.442799 24421 ts_manager.cc:194] Registered new tserver with Master: 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:30.443529 15384 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013196424s
I20260709 13:10:30.444126 24421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60908
I20260709 13:10:30.467396 24421 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60910:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:30.470314 24421 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:30.535334 24588 tablet_service.cc:1511] Processing CreateTablet for tablet d17339327c114749a38fdf6f00c19a8b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:30.536855 24588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17339327c114749a38fdf6f00c19a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.540839 24587 tablet_service.cc:1511] Processing CreateTablet for tablet 981db84394474d88b05cc2cf36a60a2b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:30.542238 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981db84394474d88b05cc2cf36a60a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.544612 24586 tablet_service.cc:1511] Processing CreateTablet for tablet bc122c82955a420a94a7dfa61ad25102 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:30.545936 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc122c82955a420a94a7dfa61ad25102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.549793 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 95eec89f4b14454a9a446dc4c70c6e46 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:30.551110 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95eec89f4b14454a9a446dc4c70c6e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.551458 24513 tablet_service.cc:1511] Processing CreateTablet for tablet d17339327c114749a38fdf6f00c19a8b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:30.552742 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17339327c114749a38fdf6f00c19a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.561333 24512 tablet_service.cc:1511] Processing CreateTablet for tablet 981db84394474d88b05cc2cf36a60a2b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:30.562702 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981db84394474d88b05cc2cf36a60a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.567111 24584 tablet_service.cc:1511] Processing CreateTablet for tablet 1189686b489e433fa2a0293731cb4b93 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:30.568516 24584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1189686b489e433fa2a0293731cb4b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.568563 24662 tablet_service.cc:1511] Processing CreateTablet for tablet d17339327c114749a38fdf6f00c19a8b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:30.569883 24662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17339327c114749a38fdf6f00c19a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.572918 24661 tablet_service.cc:1511] Processing CreateTablet for tablet 981db84394474d88b05cc2cf36a60a2b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:30.574244 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981db84394474d88b05cc2cf36a60a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.574599 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 95eec89f4b14454a9a446dc4c70c6e46 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:30.575894 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95eec89f4b14454a9a446dc4c70c6e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.576922 24660 tablet_service.cc:1511] Processing CreateTablet for tablet bc122c82955a420a94a7dfa61ad25102 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:30.578250 24660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc122c82955a420a94a7dfa61ad25102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.580981 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 95eec89f4b14454a9a446dc4c70c6e46 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:30.581209 24509 tablet_service.cc:1511] Processing CreateTablet for tablet 1189686b489e433fa2a0293731cb4b93 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:30.582267 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95eec89f4b14454a9a446dc4c70c6e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.582753 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1189686b489e433fa2a0293731cb4b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.586823 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 1189686b489e433fa2a0293731cb4b93 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:30.591321 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1189686b489e433fa2a0293731cb4b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.591127 24508 tablet_service.cc:1511] Processing CreateTablet for tablet 460137cb3d744ab2b5053ff07edf7b9e (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:30.593303 24508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460137cb3d744ab2b5053ff07edf7b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.573380 24511 tablet_service.cc:1511] Processing CreateTablet for tablet bc122c82955a420a94a7dfa61ad25102 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:30.596700 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc122c82955a420a94a7dfa61ad25102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.609239 24583 tablet_service.cc:1511] Processing CreateTablet for tablet 460137cb3d744ab2b5053ff07edf7b9e (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:30.610909 24583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460137cb3d744ab2b5053ff07edf7b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.645067 24657 tablet_service.cc:1511] Processing CreateTablet for tablet 460137cb3d744ab2b5053ff07edf7b9e (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:30.646550 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460137cb3d744ab2b5053ff07edf7b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.654573 24507 tablet_service.cc:1511] Processing CreateTablet for tablet 546f57378fc6470a94f57aa396406051 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:30.656014 24507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546f57378fc6470a94f57aa396406051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.659924 24713 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:30.663774 24712 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:30.673167 24586 tablet_service.cc:1511] Processing CreateTablet for tablet 546f57378fc6470a94f57aa396406051 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:30.675369 24713 tablet_bootstrap.cc:654] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.677184 24656 tablet_service.cc:1511] Processing CreateTablet for tablet 546f57378fc6470a94f57aa396406051 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:30.680859 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546f57378fc6470a94f57aa396406051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.679334 24513 tablet_service.cc:1511] Processing CreateTablet for tablet 338b7401f86641beb0dd80c0df0158d5 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:30.682003 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 338b7401f86641beb0dd80c0df0158d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.688547 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546f57378fc6470a94f57aa396406051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.692303 24712 tablet_bootstrap.cc:654] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.695767 24583 tablet_service.cc:1511] Processing CreateTablet for tablet 338b7401f86641beb0dd80c0df0158d5 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:30.697081 24583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 338b7401f86641beb0dd80c0df0158d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.700757 24715 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:30.712821 24713 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:30.713351 24713 ts_tablet_manager.cc:1403] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.005s
I20260709 13:10:30.713657 24715 tablet_bootstrap.cc:654] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.715411 24712 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:30.715955 24712 ts_tablet_manager.cc:1403] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.007s
I20260709 13:10:30.716229 24713 raft_consensus.cc:359] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:30.716960 24713 raft_consensus.cc:385] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.717239 24713 raft_consensus.cc:740] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.718835 24712 raft_consensus.cc:359] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.719549 24712 raft_consensus.cc:385] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.719856 24712 raft_consensus.cc:740] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.720698 24712 consensus_queue.cc:260] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.722203 24713 consensus_queue.cc:260] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:30.723197 24623 heartbeater.cc:499] Master 127.15.6.62:40757 was elected leader, sending a full tablet report...
I20260709 13:10:30.725615 24713 ts_tablet_manager.cc:1434] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 13:10:30.726624 24713 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:30.726301 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 338b7401f86641beb0dd80c0df0158d5 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:30.727679 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 338b7401f86641beb0dd80c0df0158d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.726763 24548 heartbeater.cc:499] Master 127.15.6.62:40757 was elected leader, sending a full tablet report...
I20260709 13:10:30.733526 24713 tablet_bootstrap.cc:654] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.739395 24712 ts_tablet_manager.cc:1434] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:10:30.742058 24509 tablet_service.cc:1511] Processing CreateTablet for tablet 3a884b9fd4a04eba8c3a9b0fce256a6b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:30.743360 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a884b9fd4a04eba8c3a9b0fce256a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.745147 24713 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:30.745682 24713 ts_tablet_manager.cc:1403] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:10:30.748610 24713 raft_consensus.cc:359] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.749372 24713 raft_consensus.cc:385] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.749702 24713 raft_consensus.cc:740] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.750530 24713 consensus_queue.cc:260] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.752892 24713 ts_tablet_manager.cc:1434] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:30.753865 24713 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:30.756009 24712 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:30.760208 24713 tablet_bootstrap.cc:654] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.762390 24712 tablet_bootstrap.cc:654] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.762537 24586 tablet_service.cc:1511] Processing CreateTablet for tablet 3a884b9fd4a04eba8c3a9b0fce256a6b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:30.763863 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a884b9fd4a04eba8c3a9b0fce256a6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:30.763756 24549 tablet.cc:2406] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:30.765256 24715 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:30.765739 24715 ts_tablet_manager.cc:1403] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.017s
I20260709 13:10:30.768355 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 3a884b9fd4a04eba8c3a9b0fce256a6b (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:30.769047 24715 raft_consensus.cc:359] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.769548 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a884b9fd4a04eba8c3a9b0fce256a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.769785 24715 raft_consensus.cc:385] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.770090 24715 raft_consensus.cc:740] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.770905 24715 consensus_queue.cc:260] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.772724 24583 tablet_service.cc:1511] Processing CreateTablet for tablet cd1b2e8fac074c039458fcf111bb19c2 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:30.773914 24583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1b2e8fac074c039458fcf111bb19c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.780169 24715 ts_tablet_manager.cc:1434] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:10:30.780869 24697 heartbeater.cc:499] Master 127.15.6.62:40757 was elected leader, sending a full tablet report...
I20260709 13:10:30.786307 24509 tablet_service.cc:1511] Processing CreateTablet for tablet cd1b2e8fac074c039458fcf111bb19c2 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:30.787521 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1b2e8fac074c039458fcf111bb19c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.790048 24715 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:30.790808 24657 tablet_service.cc:1511] Processing CreateTablet for tablet cd1b2e8fac074c039458fcf111bb19c2 (DEFAULT_TABLE table=test-workload [id=3f7fef8f8bb94bc9a9f89bad9dea9a7c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:30.792049 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1b2e8fac074c039458fcf111bb19c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.802227 24718 raft_consensus.cc:493] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.802656 24718 raft_consensus.cc:515] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:30.805007 24718 leader_election.cc:290] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:30.807559 24715 tablet_bootstrap.cc:654] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.808219 24713 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:30.809844 24713 ts_tablet_manager.cc:1403] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.010s
I20260709 13:10:30.823380 24713 raft_consensus.cc:359] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.824295 24713 raft_consensus.cc:385] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.824656 24713 raft_consensus.cc:740] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.825464 24713 consensus_queue.cc:260] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.827690 24713 ts_tablet_manager.cc:1434] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:30.829591 24713 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:30.833879 24712 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:30.834379 24712 ts_tablet_manager.cc:1403] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.094s	user 0.005s	sys 0.006s
I20260709 13:10:30.837345 24712 raft_consensus.cc:359] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.838025 24712 raft_consensus.cc:385] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.838308 24712 raft_consensus.cc:740] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.839349 24712 consensus_queue.cc:260] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.839870 24713 tablet_bootstrap.cc:654] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.841411 24712 ts_tablet_manager.cc:1434] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:30.842352 24712 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:30.848300 24712 tablet_bootstrap.cc:654] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.848982 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
W20260709 13:10:30.850677 24488 leader_election.cc:343] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.838289 24715 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:30.851567 24715 ts_tablet_manager.cc:1403] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.011s
I20260709 13:10:30.854482 24715 raft_consensus.cc:359] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.855137 24715 raft_consensus.cc:385] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.855419 24715 raft_consensus.cc:740] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.856503 24715 consensus_queue.cc:260] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.858831 24715 ts_tablet_manager.cc:1434] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:30.859771 24715 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:30.862741 24717 raft_consensus.cc:493] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.863236 24717 raft_consensus.cc:515] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.863860 24718 raft_consensus.cc:493] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.864398 24718 raft_consensus.cc:515] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.865466 24715 tablet_bootstrap.cc:654] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.865767 24717 leader_election.cc:290] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:30.866565 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:30.866503 24718 leader_election.cc:290] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:30.869541 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:30.870674 24713 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
W20260709 13:10:30.870936 24488 leader_election.cc:343] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.871172 24713 ts_tablet_manager.cc:1403] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.019s
W20260709 13:10:30.871487 24486 leader_election.cc:343] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.871961 24486 leader_election.cc:304] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7d5902b8d2e4123852604f001c83cec; no voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:30.873566 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:30.874150 24713 raft_consensus.cc:359] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.874845 24713 raft_consensus.cc:385] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.875042 24718 raft_consensus.cc:2749] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:30.876005 24486 leader_election.cc:343] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.877467 24712 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:30.875125 24713 raft_consensus.cc:740] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.878136 24486 leader_election.cc:304] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7d5902b8d2e4123852604f001c83cec; no voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:30.878928 24718 raft_consensus.cc:2749] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.878767 24713 consensus_queue.cc:260] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.877884 24712 ts_tablet_manager.cc:1403] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.005s
I20260709 13:10:30.881039 24713 ts_tablet_manager.cc:1434] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:10:30.882009 24713 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:30.888468 24713 tablet_bootstrap.cc:654] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.877825 24715 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:30.891520 24715 ts_tablet_manager.cc:1403] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.032s	user 0.002s	sys 0.008s
I20260709 13:10:30.893296 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:30.893949 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:30.894016 24712 raft_consensus.cc:359] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.893980 24523 raft_consensus.cc:2468] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 0.
I20260709 13:10:30.894407 24715 raft_consensus.cc:359] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:30.894796 24712 raft_consensus.cc:385] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.894730 24672 raft_consensus.cc:2468] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 0.
I20260709 13:10:30.895233 24715 raft_consensus.cc:385] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.895386 24712 raft_consensus.cc:740] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.895682 24715 raft_consensus.cc:740] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.895766 24561 leader_election.cc:304] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:30.896214 24712 consensus_queue.cc:260] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.896669 24717 raft_consensus.cc:2804] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.896548 24715 consensus_queue.cc:260] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:30.897137 24717 raft_consensus.cc:493] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.897485 24717 raft_consensus.cc:3060] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.898701 24715 ts_tablet_manager.cc:1434] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:30.899677 24715 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:30.904606 24717 raft_consensus.cc:515] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.905967 24715 tablet_bootstrap.cc:654] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.906853 24717 leader_election.cc:290] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:30.904964 24713 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:30.907887 24713 ts_tablet_manager.cc:1403] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:10:30.911753 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:30.914669 24672 raft_consensus.cc:3060] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.916890 24713 raft_consensus.cc:359] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.917609 24713 raft_consensus.cc:385] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.917878 24713 raft_consensus.cc:740] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.918476 24713 consensus_queue.cc:260] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.912539 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:30.920091 24523 raft_consensus.cc:3060] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.920368 24713 ts_tablet_manager.cc:1434] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:30.921378 24713 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:30.926383 24713 tablet_bootstrap.cc:654] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.926245 24672 raft_consensus.cc:2468] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 1.
I20260709 13:10:30.927678 24561 leader_election.cc:304] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: 
I20260709 13:10:30.928848 24712 ts_tablet_manager.cc:1434] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.049s	user 0.018s	sys 0.015s
I20260709 13:10:30.929845 24712 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:30.932500 24715 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:30.933141 24715 ts_tablet_manager.cc:1403] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.004s
I20260709 13:10:30.936344 24715 raft_consensus.cc:359] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.937136 24715 raft_consensus.cc:385] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.937170 24712 tablet_bootstrap.cc:654] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.937674 24715 raft_consensus.cc:740] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.938696 24715 consensus_queue.cc:260] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.941110 24715 ts_tablet_manager.cc:1434] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:30.942212 24715 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:30.944926 24713 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:30.945452 24713 ts_tablet_manager.cc:1403] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 13:10:30.948480 24713 raft_consensus.cc:359] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.948942 24712 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:30.949179 24713 raft_consensus.cc:385] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.949640 24713 raft_consensus.cc:740] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.949649 24712 ts_tablet_manager.cc:1403] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:10:30.949707 24715 tablet_bootstrap.cc:654] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.950564 24713 consensus_queue.cc:260] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.951603 24523 raft_consensus.cc:2468] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 1.
I20260709 13:10:30.952909 24712 raft_consensus.cc:359] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.953465 24733 raft_consensus.cc:2804] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.954644 24713 ts_tablet_manager.cc:1434] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:30.953599 24712 raft_consensus.cc:385] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.956630 24712 raft_consensus.cc:740] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.957198 24713 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:30.957504 24733 raft_consensus.cc:697] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:30.957438 24712 consensus_queue.cc:260] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.958527 24733 consensus_queue.cc:237] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.960700 24712 ts_tablet_manager.cc:1434] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:30.961700 24712 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:30.963076 24713 tablet_bootstrap.cc:654] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.955746 24715 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:30.965317 24715 ts_tablet_manager.cc:1403] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.003s
I20260709 13:10:30.967325 24712 tablet_bootstrap.cc:654] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.968058 24715 raft_consensus.cc:359] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.968763 24715 raft_consensus.cc:385] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.969046 24715 raft_consensus.cc:740] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.969808 24715 consensus_queue.cc:260] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.970295 24418 catalog_manager.cc:5697] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.972234 24715 ts_tablet_manager.cc:1434] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:10:30.973390 24715 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:30.979768 24715 tablet_bootstrap.cc:654] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.985446 24718 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.985996 24718 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:30.989238 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:30.989898 24598 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d5902b8d2e4123852604f001c83cec in term 0.
I20260709 13:10:30.991125 24488 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:30.992995 24718 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:30.993582 24718 raft_consensus.cc:2804] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.993939 24718 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.994259 24718 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.997006 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:30.997711 24672 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d5902b8d2e4123852604f001c83cec in term 0.
I20260709 13:10:31.030555 24718 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.035892 24733 raft_consensus.cc:493] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.036280 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.036481 24733 raft_consensus.cc:515] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.036968 24598 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.038676 24733 leader_election.cc:290] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.041177 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.041864 24523 raft_consensus.cc:2468] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 0.
I20260709 13:10:31.042873 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:31.043524 24672 raft_consensus.cc:2468] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 0.
I20260709 13:10:31.044653 24722 raft_consensus.cc:493] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.045159 24722 raft_consensus.cc:515] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:31.046240 24561 leader_election.cc:304] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.047727 24733 raft_consensus.cc:2804] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.048197 24733 raft_consensus.cc:493] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.048574 24733 raft_consensus.cc:3060] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.051448 24722 leader_election.cc:290] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011)
I20260709 13:10:31.055768 24733 raft_consensus.cc:515] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.058709 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.059286 24523 raft_consensus.cc:3060] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.066164 24523 raft_consensus.cc:2468] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 1.
I20260709 13:10:31.067344 24561 leader_election.cc:304] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.045152 24598 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7d5902b8d2e4123852604f001c83cec in term 1.
I20260709 13:10:31.068336 24717 raft_consensus.cc:2804] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.069041 24488 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.069689 24717 raft_consensus.cc:697] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:31.070222 24742 raft_consensus.cc:2804] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.070591 24717 consensus_queue.cc:237] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.073760 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:31.074388 24672 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.081472 24672 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7d5902b8d2e4123852604f001c83cec in term 1.
I20260709 13:10:31.084789 24718 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 election: Requested vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.089460 24733 leader_election.cc:290] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.090137 24418 catalog_manager.cc:5697] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:31.105041 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:31.103659 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:31.106266 24672 raft_consensus.cc:3060] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.129000 24742 raft_consensus.cc:697] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 LEADER]: Becoming Leader. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Running, Role: LEADER
I20260709 13:10:31.130029 24742 consensus_queue.cc:237] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.135073 24715 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:31.135627 24715 ts_tablet_manager.cc:1403] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.162s	user 0.059s	sys 0.096s
I20260709 13:10:31.136245 24713 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:31.136765 24713 ts_tablet_manager.cc:1403] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.180s	user 0.052s	sys 0.066s
I20260709 13:10:31.137365 24712 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:31.137920 24712 ts_tablet_manager.cc:1403] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.176s	user 0.071s	sys 0.099s
I20260709 13:10:31.138666 24715 raft_consensus.cc:359] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.139389 24715 raft_consensus.cc:385] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.139575 24713 raft_consensus.cc:359] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.140317 24713 raft_consensus.cc:385] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.140618 24713 raft_consensus.cc:740] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.141142 24712 raft_consensus.cc:359] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.141449 24713 consensus_queue.cc:260] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.141947 24715 raft_consensus.cc:740] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.141940 24712 raft_consensus.cc:385] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.142686 24712 raft_consensus.cc:740] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.143554 24712 consensus_queue.cc:260] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.144024 24713 ts_tablet_manager.cc:1434] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:31.145138 24713 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:31.143074 24715 consensus_queue.cc:260] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.145845 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.148186 24712 ts_tablet_manager.cc:1434] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:31.148553 24715 ts_tablet_manager.cc:1434] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:10:31.149294 24712 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:31.149561 24715 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:31.151058 24713 tablet_bootstrap.cc:654] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.156004 24712 tablet_bootstrap.cc:654] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.156219 24715 tablet_bootstrap.cc:654] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.162312 24713 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:31.162788 24713 ts_tablet_manager.cc:1403] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.012s
I20260709 13:10:31.165395 24713 raft_consensus.cc:359] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.166050 24713 raft_consensus.cc:385] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.166309 24713 raft_consensus.cc:740] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.167145 24713 consensus_queue.cc:260] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.167531 24722 raft_consensus.cc:493] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.168120 24722 raft_consensus.cc:515] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.169447 24713 ts_tablet_manager.cc:1434] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:31.170256 24722 leader_election.cc:290] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.170459 24713 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:31.171665 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.172394 24523 raft_consensus.cc:2468] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.174460 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.175083 24523 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.176764 24713 tablet_bootstrap.cc:654] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.178082 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.182147 24715 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:31.182649 24715 ts_tablet_manager.cc:1403] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.008s
I20260709 13:10:31.182915 24713 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:31.183338 24713 ts_tablet_manager.cc:1403] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:10:31.176669 24635 leader_election.cc:304] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.184551 24635 leader_election.cc:304] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.185572 24715 raft_consensus.cc:359] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.185734 24713 raft_consensus.cc:359] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.185807 24722 raft_consensus.cc:2804] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.186308 24715 raft_consensus.cc:385] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.186578 24713 raft_consensus.cc:385] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.187170 24713 raft_consensus.cc:740] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.187029 24722 raft_consensus.cc:493] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.187095 24715 raft_consensus.cc:740] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.187856 24722 raft_consensus.cc:3060] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.188179 24713 consensus_queue.cc:260] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.188354 24715 consensus_queue.cc:260] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.190426 24713 ts_tablet_manager.cc:1434] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:31.191414 24713 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
W20260709 13:10:31.186295 24637 leader_election.cc:343] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:31.193352 24637 leader_election.cc:343] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.198961 24713 tablet_bootstrap.cc:654] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.201727 24418 catalog_manager.cc:5697] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec reported cstate change: term changed from 0 to 1, leader changed from <none> to d7d5902b8d2e4123852604f001c83cec (127.15.6.1). New cstate: current_term: 1 leader_uuid: "d7d5902b8d2e4123852604f001c83cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.203902 24672 raft_consensus.cc:2468] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 1.
I20260709 13:10:31.204552 24754 raft_consensus.cc:2804] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.212006 24722 raft_consensus.cc:515] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:31.212423 24754 raft_consensus.cc:493] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.220892 24754 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.222177 24712 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:31.222750 24712 ts_tablet_manager.cc:1403] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.049s
I20260709 13:10:31.222793 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.223182 24742 raft_consensus.cc:493] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.223984 24722 leader_election.cc:290] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Requested vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011)
I20260709 13:10:31.224677 24746 raft_consensus.cc:493] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.225174 24746 raft_consensus.cc:515] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.225558 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.226173 24523 raft_consensus.cc:3060] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.227293 24746 leader_election.cc:290] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.228608 24712 raft_consensus.cc:359] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:31.229354 24712 raft_consensus.cc:385] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.229694 24712 raft_consensus.cc:740] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.229548 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:31.230214 24754 raft_consensus.cc:515] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.211741 24715 ts_tablet_manager.cc:1434] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 13:10:31.229961 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.220302 24753 raft_consensus.cc:493] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.230566 24712 consensus_queue.cc:260] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:31.231295 24598 raft_consensus.cc:2468] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d5902b8d2e4123852604f001c83cec in term 0.
W20260709 13:10:31.232367 24637 leader_election.cc:343] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.232592 24488 leader_election.cc:304] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.223711 24742 raft_consensus.cc:515] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.233566 24712 ts_tablet_manager.cc:1434] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:31.234015 24754 leader_election.cc:290] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.234678 24712 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:31.234697 24715 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:31.236217 24742 leader_election.cc:290] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.237653 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.237875 24523 raft_consensus.cc:2468] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.238303 24522 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.239162 24635 leader_election.cc:304] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:31.216193 24713 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: No bootstrap required, opened a new log
I20260709 13:10:31.231355 24753 raft_consensus.cc:515] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.240520 24754 raft_consensus.cc:2804] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.240661 24713 ts_tablet_manager.cc:1403] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.007s
I20260709 13:10:31.236739 24742 raft_consensus.cc:2804] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.248454 24742 raft_consensus.cc:493] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.248677 24672 raft_consensus.cc:2468] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d5902b8d2e4123852604f001c83cec in term 0.
I20260709 13:10:31.248816 24742 raft_consensus.cc:3060] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.249882 24712 tablet_bootstrap.cc:654] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.253122 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.255204 24753 leader_election.cc:290] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.255317 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.256809 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.257447 24753 raft_consensus.cc:493] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.257704 24637 leader_election.cc:343] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.257853 24754 raft_consensus.cc:697] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:31.240684 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:31.258251 24713 raft_consensus.cc:359] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.257457 24596 raft_consensus.cc:2468] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.259151 24713 raft_consensus.cc:385] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.242139 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.259629 24713 raft_consensus.cc:740] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.260174 24715 tablet_bootstrap.cc:654] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.258818 24754 consensus_queue.cc:237] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
W20260709 13:10:31.261807 24486 leader_election.cc:343] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.260663 24713 consensus_queue.cc:260] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.262681 24753 raft_consensus.cc:515] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
W20260709 13:10:31.263213 24488 leader_election.cc:343] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.263649 24488 leader_election.cc:304] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7d5902b8d2e4123852604f001c83cec; no voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:31.264407 24718 raft_consensus.cc:2749] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.265190 24753 leader_election.cc:290] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.266325 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.267033 24521 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.268667 24635 leader_election.cc:304] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.260633 24637 leader_election.cc:304] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: 
I20260709 13:10:31.269429 24753 raft_consensus.cc:2804] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.269811 24753 raft_consensus.cc:493] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.270130 24753 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.270437 24722 raft_consensus.cc:2804] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.270809 24722 raft_consensus.cc:493] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.271119 24722 raft_consensus.cc:3060] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.273463 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.274080 24597 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.276057 24713 ts_tablet_manager.cc:1434] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:10:31.277107 24753 raft_consensus.cc:515] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.280221 24753 leader_election.cc:290] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.280977 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.281579 24521 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.288156 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.288801 24597 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.293663 24418 catalog_manager.cc:5697] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.301964 24522 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.303416 24635 leader_election.cc:304] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:31.304730 24754 raft_consensus.cc:2804] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.305241 24754 raft_consensus.cc:697] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:31.306114 24754 consensus_queue.cc:237] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.308092 24722 raft_consensus.cc:515] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.311244 24722 leader_election.cc:290] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.312091 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.315048 24521 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.315609 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.316553 24596 raft_consensus.cc:3060] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.320433 24635 leader_election.cc:304] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.325675 24596 raft_consensus.cc:2468] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.326952 24637 leader_election.cc:304] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: d7d5902b8d2e4123852604f001c83cec
I20260709 13:10:31.327785 24753 raft_consensus.cc:2804] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.328289 24753 raft_consensus.cc:697] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:31.329059 24753 consensus_queue.cc:237] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.331827 24597 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.327955 24722 raft_consensus.cc:2804] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.332974 24722 raft_consensus.cc:697] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:31.334043 24722 consensus_queue.cc:237] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.299669 24742 raft_consensus.cc:515] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.338610 24523 raft_consensus.cc:2393] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c90fd653e3e4007aafee61437223c67 in current term 1: Already voted for candidate d7d5902b8d2e4123852604f001c83cec in this term.
I20260709 13:10:31.342644 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.343372 24598 raft_consensus.cc:2393] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7d5902b8d2e4123852604f001c83cec in current term 1: Already voted for candidate 4c90fd653e3e4007aafee61437223c67 in this term.
I20260709 13:10:31.345099 24742 leader_election.cc:290] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 election: Requested vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.346487 24715 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:31.346295 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:31.346030 24418 catalog_manager.cc:5697] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.347344 24712 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:31.347880 24712 ts_tablet_manager.cc:1403] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.113s	user 0.055s	sys 0.049s
I20260709 13:10:31.347946 24486 leader_election.cc:304] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7d5902b8d2e4123852604f001c83cec; no voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:31.349129 24746 raft_consensus.cc:2749] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.347940 24742 raft_consensus.cc:493] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.350641 24742 raft_consensus.cc:515] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.350867 24712 raft_consensus.cc:359] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.351553 24712 raft_consensus.cc:385] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.351913 24712 raft_consensus.cc:740] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.352635 24712 consensus_queue.cc:260] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.353344 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.350893 24715 ts_tablet_manager.cc:1403] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.118s	user 0.036s	sys 0.029s
W20260709 13:10:31.354524 24488 leader_election.cc:343] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.356356 24715 raft_consensus.cc:359] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.356624 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "d7d5902b8d2e4123852604f001c83cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:31.357020 24715 raft_consensus.cc:385] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.357296 24715 raft_consensus.cc:740] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.357542 24712 ts_tablet_manager.cc:1434] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:31.357924 24715 consensus_queue.cc:260] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.358656 24712 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
W20260709 13:10:31.358564 24486 leader_election.cc:343] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.359099 24486 leader_election.cc:304] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7d5902b8d2e4123852604f001c83cec; no voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:31.359200 24742 leader_election.cc:290] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.359877 24742 raft_consensus.cc:2749] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.360164 24715 ts_tablet_manager.cc:1434] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:31.360914 24715 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:31.365654 24715 tablet_bootstrap.cc:654] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.366240 24712 tablet_bootstrap.cc:654] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.369875 24715 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:31.370222 24715 ts_tablet_manager.cc:1403] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:31.370890 24712 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:31.371362 24712 ts_tablet_manager.cc:1403] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:10:31.372190 24715 raft_consensus.cc:359] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.372918 24715 raft_consensus.cc:385] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.373106 24715 raft_consensus.cc:740] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.372154 24421 catalog_manager.cc:5697] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.373672 24715 consensus_queue.cc:260] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.373858 24712 raft_consensus.cc:359] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.374540 24712 raft_consensus.cc:385] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.374058 24421 catalog_manager.cc:5697] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.374815 24712 raft_consensus.cc:740] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.375222 24715 ts_tablet_manager.cc:1434] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:31.375574 24712 consensus_queue.cc:260] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.376124 24715 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67: Bootstrap starting.
I20260709 13:10:31.379323 24712 ts_tablet_manager.cc:1434] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:31.380196 24712 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:31.381425 24715 tablet_bootstrap.cc:654] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.385270 24712 tablet_bootstrap.cc:654] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.385658 24715 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67: No bootstrap required, opened a new log
I20260709 13:10:31.386078 24715 ts_tablet_manager.cc:1403] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67: Time spent bootstrapping tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:10:31.389611 24712 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:31.390057 24712 ts_tablet_manager.cc:1403] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:10:31.389966 24715 raft_consensus.cc:359] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.390700 24715 raft_consensus.cc:385] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.390962 24715 raft_consensus.cc:740] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.391685 24715 consensus_queue.cc:260] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.392714 24712 raft_consensus.cc:359] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.393355 24712 raft_consensus.cc:385] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.393595 24712 raft_consensus.cc:740] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.393854 24715 ts_tablet_manager.cc:1434] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:31.394317 24712 consensus_queue.cc:260] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.396530 24712 ts_tablet_manager.cc:1434] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:31.397392 24712 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4: Bootstrap starting.
I20260709 13:10:31.402168 24712 tablet_bootstrap.cc:654] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.409585 24712 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4: No bootstrap required, opened a new log
I20260709 13:10:31.409893 24712 ts_tablet_manager.cc:1403] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:10:31.411535 24712 raft_consensus.cc:359] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.411995 24712 raft_consensus.cc:385] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.412160 24712 raft_consensus.cc:740] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.412588 24712 consensus_queue.cc:260] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.414212 24712 ts_tablet_manager.cc:1434] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:31.449152 24733 consensus_queue.cc:1048] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.454519 24733 consensus_queue.cc:1048] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.479328 24722 raft_consensus.cc:493] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.479719 24722 raft_consensus.cc:515] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.481441 24722 leader_election.cc:290] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.482117 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.482720 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.482784 24523 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.483480 24596 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.483575 24733 consensus_queue.cc:1048] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.484272 24635 leader_election.cc:304] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.485049 24722 raft_consensus.cc:2804] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.485390 24722 raft_consensus.cc:493] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.485646 24722 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.492015 24722 raft_consensus.cc:515] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.496232 24717 consensus_queue.cc:1048] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.496456 24722 leader_election.cc:290] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.498221 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.498812 24523 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.499066 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.499617 24596 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.505628 24596 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.506457 24637 leader_election.cc:304] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: 
I20260709 13:10:31.506673 24523 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.507119 24722 raft_consensus.cc:2804] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.507738 24722 raft_consensus.cc:697] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:31.508399 24722 consensus_queue.cc:237] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.509346 24753 raft_consensus.cc:493] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.509663 24717 raft_consensus.cc:493] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.509891 24753 raft_consensus.cc:515] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.510161 24717 raft_consensus.cc:515] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.512063 24753 leader_election.cc:290] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.513329 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:31.513787 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.513908 24672 raft_consensus.cc:2468] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 0.
I20260709 13:10:31.514189 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.514533 24523 raft_consensus.cc:2468] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.514911 24521 raft_consensus.cc:2468] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 0.
I20260709 13:10:31.515343 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:31.515900 24635 leader_election.cc:304] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.516364 24561 leader_election.cc:304] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.516703 24753 raft_consensus.cc:2804] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.512074 24717 leader_election.cc:290] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.517237 24753 raft_consensus.cc:493] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.517671 24753 raft_consensus.cc:3060] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.517444 24745 raft_consensus.cc:2804] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.518152 24745 raft_consensus.cc:493] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.518427 24745 raft_consensus.cc:3060] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.515971 24596 raft_consensus.cc:2468] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 0.
I20260709 13:10:31.523517 24753 raft_consensus.cc:515] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.524194 24745 raft_consensus.cc:515] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.525720 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.525986 24745 leader_election.cc:290] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:31.526301 24521 raft_consensus.cc:3060] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.527336 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:31.527537 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:31.527941 24523 raft_consensus.cc:3060] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.528090 24671 raft_consensus.cc:3060] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.532008 24521 raft_consensus.cc:2468] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.533353 24635 leader_election.cc:304] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.534462 24523 raft_consensus.cc:2468] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 1.
I20260709 13:10:31.535017 24753 leader_election.cc:290] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 1 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:31.534848 24671 raft_consensus.cc:2468] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 1.
I20260709 13:10:31.534816 24722 raft_consensus.cc:2804] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.535953 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:31.534965 24745 raft_consensus.cc:493] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.536693 24722 raft_consensus.cc:697] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:31.536854 24596 raft_consensus.cc:3060] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.536840 24745 raft_consensus.cc:515] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:31.537705 24722 consensus_queue.cc:237] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.537788 24421 catalog_manager.cc:5697] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.538888 24745 leader_election.cc:290] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707), d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011)
I20260709 13:10:31.535816 24561 leader_election.cc:304] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:31.540609 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:31.540796 24745 raft_consensus.cc:2804] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.540799 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17339327c114749a38fdf6f00c19a8b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d5902b8d2e4123852604f001c83cec" is_pre_election: true
I20260709 13:10:31.541855 24523 raft_consensus.cc:2393] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ef14ee827c4b34b4afd4510da9e2f4 in current term 1: Already voted for candidate 4c90fd653e3e4007aafee61437223c67 in this term.
I20260709 13:10:31.542925 24561 leader_election.cc:304] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4; no voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec
I20260709 13:10:31.544018 24717 raft_consensus.cc:3060] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.547287 24596 raft_consensus.cc:2468] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:31.542308 24745 raft_consensus.cc:697] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:31.550078 24745 consensus_queue.cc:237] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.551085 24717 raft_consensus.cc:2749] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.555115 24421 catalog_manager.cc:5697] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.557440 24418 catalog_manager.cc:5697] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.565395 24742 consensus_queue.cc:1048] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.574363 24742 consensus_queue.cc:1048] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.651170 15384 ts_manager.cc:295] Set tserver state for d7d5902b8d2e4123852604f001c83cec to MAINTENANCE_MODE
I20260709 13:10:31.651822 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
I20260709 13:10:31.669489 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:31.670166 15384 tablet_replica.cc:333] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.671064 15384 raft_consensus.cc:2243] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.671492 15384 raft_consensus.cc:2272] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.673416 15384 tablet_replica.cc:333] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.673938 15384 raft_consensus.cc:2243] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.674274 15384 raft_consensus.cc:2272] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.675843 15384 tablet_replica.cc:333] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.676367 15384 raft_consensus.cc:2243] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.676694 15384 raft_consensus.cc:2272] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.678231 15384 tablet_replica.cc:333] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.678710 15384 raft_consensus.cc:2243] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.679071 15384 raft_consensus.cc:2272] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.681162 15384 tablet_replica.cc:333] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.681646 15384 raft_consensus.cc:2243] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.681974 15384 raft_consensus.cc:2272] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.683449 15384 tablet_replica.cc:333] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.683928 15384 raft_consensus.cc:2243] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:31.684650 15384 raft_consensus.cc:2272] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.686460 15384 tablet_replica.cc:333] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.686925 15384 raft_consensus.cc:2243] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.687242 15384 raft_consensus.cc:2272] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.688768 15384 tablet_replica.cc:333] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.689203 15384 raft_consensus.cc:2243] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.689605 15384 raft_consensus.cc:2272] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.691622 15384 tablet_replica.cc:333] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.692085 15384 raft_consensus.cc:2243] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.692406 15384 raft_consensus.cc:2272] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.694118 15384 tablet_replica.cc:333] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: stopping tablet replica
I20260709 13:10:31.694537 15384 raft_consensus.cc:2243] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:31.694860 15384 raft_consensus.cc:2272] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:31.713271 24745 raft_consensus.cc:493] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.713716 24745 raft_consensus.cc:515] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:31.715168 24745 leader_election.cc:290] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
W20260709 13:10:31.716955 24561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111) [suppressed 118 similar messages]
I20260709 13:10:31.716955 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
W20260709 13:10:31.720381 24561 leader_election.cc:336] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111)
I20260709 13:10:31.720948 24561 leader_election.cc:304] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4; no voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec
I20260709 13:10:31.721558 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
I20260709 13:10:31.721644 24745 raft_consensus.cc:2749] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.751150 24722 consensus_queue.cc:1048] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:31.765723 24635 consensus_peers.cc:597] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:31.782171 24635 consensus_peers.cc:597] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:31.788341 24753 consensus_queue.cc:1048] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:31.799844 24635 consensus_peers.cc:597] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:31.830433 24596 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.836346 24754 consensus_queue.cc:1048] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:31.852945 24561 consensus_peers.cc:597] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:31.856870 24635 consensus_peers.cc:597] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:31.902266 24722 consensus_queue.cc:1048] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:31.909204 24635 consensus_peers.cc:597] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:31.924846 24561 consensus_peers.cc:597] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:31.998324 24561 consensus_peers.cc:597] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:32.106112 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:32.106943 24756 consensus_queue.cc:1048] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.109212 24756 consensus_queue.cc:1048] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:32.124512 24635 consensus_peers.cc:597] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.150133 24745 consensus_queue.cc:1048] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.076086 24745 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7d5902b8d2e4123852604f001c83cec)
I20260709 13:10:33.076540 24745 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:33.078003 24793 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7d5902b8d2e4123852604f001c83cec)
I20260709 13:10:33.078181 24745 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:33.078585 24793 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:33.079869 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67" is_pre_election: true
I20260709 13:10:33.080531 24671 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 1.
I20260709 13:10:33.080988 24793 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
W20260709 13:10:33.083030 24561 leader_election.cc:336] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111)
I20260709 13:10:33.083194 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:33.083783 24596 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 1.
I20260709 13:10:33.083994 24561 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: d7d5902b8d2e4123852604f001c83cec
W20260709 13:10:33.084544 24635 leader_election.cc:336] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111)
I20260709 13:10:33.084796 24745 raft_consensus.cc:2804] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.085181 24745 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7d5902b8d2e4123852604f001c83cec)
I20260709 13:10:33.085520 24745 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.085533 24637 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: d7d5902b8d2e4123852604f001c83cec
I20260709 13:10:33.086377 24753 raft_consensus.cc:2804] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.086655 24753 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7d5902b8d2e4123852604f001c83cec)
I20260709 13:10:33.086983 24753 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.090553 24745 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:33.091414 24753 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:33.092073 24745 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:33.093429 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:33.094158 24671 raft_consensus.cc:2393] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65ef14ee827c4b34b4afd4510da9e2f4 in current term 2: Already voted for candidate 4c90fd653e3e4007aafee61437223c67 in this term.
I20260709 13:10:33.094427 24753 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
W20260709 13:10:33.095669 24561 leader_election.cc:336] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111)
I20260709 13:10:33.095781 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:33.096150 24561 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4; no voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec
I20260709 13:10:33.096535 24596 raft_consensus.cc:2393] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c90fd653e3e4007aafee61437223c67 in current term 2: Already voted for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in this term.
W20260709 13:10:33.097285 24635 leader_election.cc:336] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111)
I20260709 13:10:33.097465 24745 raft_consensus.cc:2749] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.097889 24637 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67; no voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec
I20260709 13:10:33.098555 24753 raft_consensus.cc:2749] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:33.107064 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:34.107969 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:34.183948 24635 consensus_peers.cc:597] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:34.232298 24635 consensus_peers.cc:597] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:34.247833 24561 consensus_peers.cc:597] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:34.345597 24635 consensus_peers.cc:597] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:34.381971 24561 consensus_peers.cc:597] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:34.447093 24635 consensus_peers.cc:597] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:34.509689 24635 consensus_peers.cc:597] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:34.685534 24635 consensus_peers.cc:597] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:34.740866 24795 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.741331 24795 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:34.742869 24795 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:34.743810 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" is_pre_election: true
I20260709 13:10:34.744340 24596 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 2.
I20260709 13:10:34.745237 24637 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: 
I20260709 13:10:34.745817 24795 raft_consensus.cc:2804] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:34.745857 24635 leader_election.cc:336] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111)
I20260709 13:10:34.746162 24795 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.746455 24795 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.751425 24795 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:34.752830 24795 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:34.753786 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:34.754312 24596 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:34.755971 24635 leader_election.cc:336] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111)
I20260709 13:10:34.760381 24596 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 3.
I20260709 13:10:34.761215 24637 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, 65ef14ee827c4b34b4afd4510da9e2f4; no voters: d7d5902b8d2e4123852604f001c83cec
I20260709 13:10:34.761795 24795 raft_consensus.cc:2804] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.762707 24795 raft_consensus.cc:697] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:34.763502 24795 consensus_queue.cc:237] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:34.771651 24418 catalog_manager.cc:5697] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 1 to 3, leader changed from d7d5902b8d2e4123852604f001c83cec (127.15.6.1) to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:34.838452 24561 consensus_peers.cc:597] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:35.108847 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:35.187506 24596 raft_consensus.cc:1275] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:35.189399 24796 consensus_queue.cc:1048] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:35.206974 24635 consensus_peers.cc:597] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.109975 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:36.499061 24635 consensus_peers.cc:597] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:36.686988 24635 consensus_peers.cc:597] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:36.696919 24635 consensus_peers.cc:597] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:36.717419 24635 consensus_peers.cc:597] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:36.738765 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:36.739825 24635 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111) [suppressed 103 similar messages]
W20260709 13:10:36.742195 24635 consensus_peers.cc:597] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:36.747099 24810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.748580 24811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.749068 24561 consensus_peers.cc:597] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:36.752012 24813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:36.752151 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:36.753772 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:36.753962 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:36.754096 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602636754086 us; error 0 us; skew 500 ppm
I20260709 13:10:36.754609 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:36.757025 15384 webserver.cc:533] Webserver started at http://127.15.6.1:38447/ using document root <none> and password file <none>
I20260709 13:10:36.757501 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:36.757644 15384 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:36.761276 15384 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:36.764887 24818 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.765559 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:36.765829 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "d7d5902b8d2e4123852604f001c83cec"
format_stamp: "Formatted at 2026-07-09 13:10:30 on dist-test-slave-pqzm"
I20260709 13:10:36.766304 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:36.778110 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:36.779331 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:36.780805 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:36.784198 24825 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:10:36.832382 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:10:36.832665 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.049s	user 0.002s	sys 0.000s
I20260709 13:10:36.832973 15384 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:10:36.838192 24825 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.849017 24825 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.849623 24825 tablet_bootstrap.cc:492] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.850129 24825 ts_tablet_manager.cc:1403] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:36.852372 24825 raft_consensus.cc:359] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.852996 24825 raft_consensus.cc:740] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.853737 24825 consensus_queue.cc:260] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.856447 24825 ts_tablet_manager.cc:1434] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:10:36.857156 24825 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.869210 24825 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.869822 24825 tablet_bootstrap.cc:492] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.870312 24825 ts_tablet_manager.cc:1403] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.008s
I20260709 13:10:36.871978 15384 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:10:36.872256 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.036s	sys 0.004s
I20260709 13:10:36.872479 24825 raft_consensus.cc:359] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.873044 24825 raft_consensus.cc:740] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.873693 24825 consensus_queue.cc:260] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.875186 24825 ts_tablet_manager.cc:1434] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:36.875837 24825 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.887377 24825 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.888193 24825 tablet_bootstrap.cc:492] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.888687 24825 ts_tablet_manager.cc:1403] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.009s
I20260709 13:10:36.890786 24825 raft_consensus.cc:359] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.891304 24825 raft_consensus.cc:740] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.891933 24825 consensus_queue.cc:260] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.893559 24825 ts_tablet_manager.cc:1434] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:10:36.894178 24825 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.905791 24825 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.906445 24825 tablet_bootstrap.cc:492] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.906977 24825 ts_tablet_manager.cc:1403] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:10:36.908968 24825 raft_consensus.cc:359] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.909407 24825 raft_consensus.cc:740] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.909970 24825 consensus_queue.cc:260] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.911527 24825 ts_tablet_manager.cc:1434] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:10:36.912123 24825 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.924167 24825 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.924752 24825 tablet_bootstrap.cc:492] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.925282 24825 ts_tablet_manager.cc:1403] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.005s
I20260709 13:10:36.926924 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:38011
I20260709 13:10:36.927037 24887 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:38011 every 8 connection(s)
I20260709 13:10:36.927171 24825 raft_consensus.cc:359] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.927866 24825 raft_consensus.cc:740] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.928483 24825 consensus_queue.cc:260] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.929881 24825 ts_tablet_manager.cc:1434] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:36.930516 24825 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.931878 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:36.952657 24825 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.953639 24825 tablet_bootstrap.cc:492] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.954147 24825 ts_tablet_manager.cc:1403] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.003s
I20260709 13:10:36.956336 24825 raft_consensus.cc:359] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.956888 24825 raft_consensus.cc:740] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.957653 24825 consensus_queue.cc:260] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.959535 24825 ts_tablet_manager.cc:1434] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:36.960430 24825 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.967248 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:36.968031 24671 raft_consensus.cc:606] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:36.968859 24888 heartbeater.cc:344] Connected to a master server at 127.15.6.62:40757
I20260709 13:10:36.969292 24888 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:36.970243 24888 heartbeater.cc:507] Master 127.15.6.62:40757 requested a full tablet report, sending...
I20260709 13:10:36.970728 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:36.971140 24671 raft_consensus.cc:606] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:36.971864 24825 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.972625 24825 tablet_bootstrap.cc:492] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.973227 24825 ts_tablet_manager.cc:1403] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:10:36.973278 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "546f57378fc6470a94f57aa396406051"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:36.973789 24671 raft_consensus.cc:606] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:36.974725 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:36.975284 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:36.975955 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:36.975751 24825 raft_consensus.cc:359] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.976553 24825 raft_consensus.cc:740] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.976958 24418 ts_manager.cc:194] Re-registered known tserver with Master: d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011)
I20260709 13:10:36.977288 24825 consensus_queue.cc:260] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:36.979338 24825 ts_tablet_manager.cc:1434] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:36.980104 24825 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:36.988631 24418 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40076
I20260709 13:10:36.992097 24888 heartbeater.cc:499] Master 127.15.6.62:40757 was elected leader, sending a full tablet report...
I20260709 13:10:36.996008 24825 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.996788 24825 tablet_bootstrap.cc:492] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:36.997382 24825 ts_tablet_manager.cc:1403] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:10:36.999782 24825 raft_consensus.cc:359] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:37.000540 24825 raft_consensus.cc:740] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.001351 24825 consensus_queue.cc:260] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } } peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } }
I20260709 13:10:37.003667 24825 ts_tablet_manager.cc:1434] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:37.004577 24825 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:37.018172 24825 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.018766 24825 tablet_bootstrap.cc:492] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:37.019229 24825 ts_tablet_manager.cc:1403] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:10:37.021567 24825 raft_consensus.cc:359] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.022192 24825 raft_consensus.cc:740] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.022835 24825 consensus_queue.cc:260] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.024345 24825 ts_tablet_manager.cc:1434] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:10:37.024948 24825 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Bootstrap starting.
I20260709 13:10:37.035552 24825 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.036186 24825 tablet_bootstrap.cc:492] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Bootstrap complete.
I20260709 13:10:37.036623 24825 ts_tablet_manager.cc:1403] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:10:37.038272 24825 raft_consensus.cc:359] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.038712 24825 raft_consensus.cc:740] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d5902b8d2e4123852604f001c83cec, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.039213 24825 consensus_queue.cc:260] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.040525 24825 ts_tablet_manager.cc:1434] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:37.052738 24862 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:10:37.110988 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:37.365321 24909 raft_consensus.cc:993] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:37.366281 24795 raft_consensus.cc:1081] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:37.368163 24597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "546f57378fc6470a94f57aa396406051"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:37.368824 24597 raft_consensus.cc:493] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.368837 24909 raft_consensus.cc:993] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:37.369217 24597 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.369485 24909 raft_consensus.cc:1081] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:37.370903 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:37.371436 24596 raft_consensus.cc:493] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.371784 24596 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.378391 24597 raft_consensus.cc:515] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.379727 24596 raft_consensus.cc:515] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.381487 24597 leader_election.cc:290] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:37.381734 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:37.382395 24596 leader_election.cc:290] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:37.382905 24862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:37.383621 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:37.383898 24862 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.383114 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:37.384277 24672 raft_consensus.cc:3055] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.384424 24861 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.384996 24672 raft_consensus.cc:740] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:37.385998 24672 consensus_queue.cc:260] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.387277 24672 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.389038 24862 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:37.383641 24671 raft_consensus.cc:3055] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.389748 24671 raft_consensus.cc:740] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:37.390066 24561 leader_election.cc:304] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:37.390560 24671 consensus_queue.cc:260] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.391142 24808 raft_consensus.cc:2804] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.391779 24671 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.391893 24861 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:37.393318 24808 raft_consensus.cc:697] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:37.394634 24672 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:37.394428 24808 consensus_queue.cc:237] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.396606 24561 leader_election.cc:304] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:37.397328 24911 raft_consensus.cc:2804] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.398871 24911 raft_consensus.cc:697] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:37.400243 24671 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:37.399719 24911 consensus_queue.cc:237] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.405491 24419 catalog_manager.cc:5697] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 1 to 2, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.426244 24910 raft_consensus.cc:993] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:37.426640 24909 raft_consensus.cc:1081] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:37.427994 24597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:37.428423 24597 raft_consensus.cc:493] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.428709 24597 raft_consensus.cc:3060] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.429813 24419 catalog_manager.cc:5697] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 1 to 2, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.433491 24597 raft_consensus.cc:515] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.435205 24597 leader_election.cc:290] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:37.435918 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:37.436230 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1189686b489e433fa2a0293731cb4b93" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:37.436508 24861 raft_consensus.cc:3060] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.436831 24671 raft_consensus.cc:3055] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.437161 24671 raft_consensus.cc:740] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:37.438006 24671 consensus_queue.cc:260] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.439208 24671 raft_consensus.cc:3060] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.441723 24861 raft_consensus.cc:2468] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:37.442617 24561 leader_election.cc:304] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:37.443356 24911 raft_consensus.cc:2804] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.443706 24911 raft_consensus.cc:697] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:37.444474 24671 raft_consensus.cc:2468] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:37.444422 24911 consensus_queue.cc:237] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:37.450977 24419 catalog_manager.cc:5697] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 1 to 2, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.777642 24861 raft_consensus.cc:1275] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.778836 24911 consensus_queue.cc:1048] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.786808 24671 raft_consensus.cc:1275] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.788291 24911 consensus_queue.cc:1048] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.906358 24861 raft_consensus.cc:1275] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.907387 24911 consensus_queue.cc:1048] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.914914 24671 raft_consensus.cc:1275] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.916673 24808 consensus_queue.cc:1048] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.970235 24861 raft_consensus.cc:1275] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.971400 24808 consensus_queue.cc:1048] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.978204 24671 raft_consensus.cc:1275] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.979737 24808 consensus_queue.cc:1048] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.988647 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:38.005905 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
mode: GRACEFUL
new_leader_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:38966
I20260709 13:10:38.006376 24597 raft_consensus.cc:606] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Received request to transfer leadership to TS 4c90fd653e3e4007aafee61437223c67
I20260709 13:10:38.008464 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
mode: GRACEFUL
new_leader_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:38966
I20260709 13:10:38.008888 24597 raft_consensus.cc:606] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Received request to transfer leadership to TS 4c90fd653e3e4007aafee61437223c67
I20260709 13:10:38.009744 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:38.010177 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:38.010726 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:38.111917 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:38.228204 24911 raft_consensus.cc:993] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4: : Instructing follower 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:38.228677 24808 raft_consensus.cc:1081] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Signalling peer 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:38.230057 24671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:48372
I20260709 13:10:38.230506 24671 raft_consensus.cc:493] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.230779 24671 raft_consensus.cc:3060] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.235486 24671 raft_consensus.cc:515] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:38.236966 24671 leader_election.cc:290] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:38.237727 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:38.237980 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a884b9fd4a04eba8c3a9b0fce256a6b" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:38.238322 24861 raft_consensus.cc:3060] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.238546 24597 raft_consensus.cc:3055] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.238873 24597 raft_consensus.cc:740] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:38.239578 24597 consensus_queue.cc:260] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:38.240628 24597 raft_consensus.cc:3060] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.243126 24861 raft_consensus.cc:2468] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 2.
I20260709 13:10:38.244035 24635 leader_election.cc:304] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:38.244679 24909 raft_consensus.cc:2804] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.245566 24909 raft_consensus.cc:697] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 2 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:38.245967 24597 raft_consensus.cc:2468] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 2.
I20260709 13:10:38.246559 24909 consensus_queue.cc:237] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:38.253158 24419 catalog_manager.cc:5697] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 1 to 2, leader changed from 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2) to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.340728 24911 raft_consensus.cc:993] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4: : Instructing follower 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:38.341130 24808 raft_consensus.cc:1081] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Signalling peer 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:38.342470 24671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:48372
I20260709 13:10:38.342885 24671 raft_consensus.cc:493] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.343129 24671 raft_consensus.cc:3060] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.348695 24671 raft_consensus.cc:515] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:38.350126 24671 leader_election.cc:290] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:38.350765 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:38.351109 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc122c82955a420a94a7dfa61ad25102" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:38.351373 24861 raft_consensus.cc:3060] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.351650 24597 raft_consensus.cc:3055] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.351943 24597 raft_consensus.cc:740] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:38.352571 24597 consensus_queue.cc:260] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:38.353550 24597 raft_consensus.cc:3060] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.356055 24861 raft_consensus.cc:2468] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 2.
I20260709 13:10:38.356962 24635 leader_election.cc:304] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:38.357673 24909 raft_consensus.cc:2804] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.358048 24909 raft_consensus.cc:697] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 2 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:38.358484 24597 raft_consensus.cc:2468] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 2.
I20260709 13:10:38.358968 24909 consensus_queue.cc:237] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:38.365705 24419 catalog_manager.cc:5697] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 1 to 2, leader changed from 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2) to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.676934 24861 raft_consensus.cc:1275] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.678103 24909 consensus_queue.cc:1048] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.686932 24597 raft_consensus.cc:1275] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.688405 24937 consensus_queue.cc:1048] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.848524 24597 raft_consensus.cc:1275] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.849606 24937 consensus_queue.cc:1048] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.857903 24861 raft_consensus.cc:1275] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.860482 24909 consensus_queue.cc:1048] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.016610 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.023226 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:39.023732 24671 raft_consensus.cc:606] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:39.026180 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "546f57378fc6470a94f57aa396406051"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
mode: GRACEFUL
new_leader_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:38966
I20260709 13:10:39.026749 24597 raft_consensus.cc:606] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Received request to transfer leadership to TS 4c90fd653e3e4007aafee61437223c67
I20260709 13:10:39.029214 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:39.029788 24671 raft_consensus.cc:606] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:39.030736 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:39.031172 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:39.031752 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.089442 24928 raft_consensus.cc:993] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:39.089934 24909 raft_consensus.cc:1081] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:39.091233 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:39.091676 24596 raft_consensus.cc:493] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.091979 24596 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.096827 24596 raft_consensus.cc:515] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.098428 24596 leader_election.cc:290] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 4 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:39.099078 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:39.099311 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981db84394474d88b05cc2cf36a60a2b" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:39.099622 24861 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.099936 24672 raft_consensus.cc:3055] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:39.100252 24672 raft_consensus.cc:740] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:39.100881 24672 consensus_queue.cc:260] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.101759 24672 raft_consensus.cc:3060] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.104620 24861 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 4.
I20260709 13:10:39.105580 24561 leader_election.cc:304] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:39.106161 24808 raft_consensus.cc:2804] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:39.106606 24672 raft_consensus.cc:2468] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 4.
I20260709 13:10:39.107060 24808 raft_consensus.cc:697] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:39.108080 24808 consensus_queue.cc:237] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
W20260709 13:10:39.112668 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:39.114252 24418 catalog_manager.cc:5697] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 3 to 4, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 4 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.265601 24943 raft_consensus.cc:993] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4: : Instructing follower 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:39.266040 24808 raft_consensus.cc:1081] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Signalling peer 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:39.267643 24672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "546f57378fc6470a94f57aa396406051"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:48372
I20260709 13:10:39.268214 24672 raft_consensus.cc:493] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.268584 24672 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.274451 24672 raft_consensus.cc:515] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.275877 24672 leader_election.cc:290] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:39.276479 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:39.276877 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:39.277091 24861 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.277477 24596 raft_consensus.cc:3055] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:39.277820 24596 raft_consensus.cc:740] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:39.278553 24596 consensus_queue.cc:260] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.279685 24596 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.284000 24861 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 3.
I20260709 13:10:39.285015 24635 leader_election.cc:304] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:39.285487 24596 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 3.
I20260709 13:10:39.285591 24937 raft_consensus.cc:2804] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:39.286154 24937 raft_consensus.cc:697] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:39.286815 24937 consensus_queue.cc:237] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.293284 24418 catalog_manager.cc:5697] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 2 to 3, leader changed from 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2) to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.456207 24909 raft_consensus.cc:993] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:39.456626 24909 raft_consensus.cc:1081] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:39.457891 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:39.458307 24596 raft_consensus.cc:493] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.458562 24596 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.463976 24596 raft_consensus.cc:515] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.465528 24596 leader_election.cc:290] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:39.466331 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:39.466540 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:39.467062 24861 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.467141 24671 raft_consensus.cc:3055] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.467506 24671 raft_consensus.cc:740] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:39.468267 24671 consensus_queue.cc:260] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.469264 24671 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.472085 24861 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:39.472992 24561 leader_election.cc:304] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:39.473587 24943 raft_consensus.cc:2804] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.473963 24671 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:39.474052 24943 raft_consensus.cc:697] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:39.474923 24943 consensus_queue.cc:237] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:39.481102 24418 catalog_manager.cc:5697] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 1 to 2, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.550174 24861 raft_consensus.cc:1275] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:39.551273 24943 consensus_queue.cc:1048] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.560479 24671 raft_consensus.cc:1275] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:39.561811 24808 consensus_queue.cc:1048] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.792182 24861 raft_consensus.cc:1275] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:39.793325 24909 consensus_queue.cc:1048] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.802197 24596 raft_consensus.cc:1275] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:39.803965 24957 consensus_queue.cc:1048] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:39.881971 24671 raft_consensus.cc:1275] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.883036 24808 consensus_queue.cc:1048] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.895256 24861 raft_consensus.cc:1275] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.898320 24808 consensus_queue.cc:1048] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.038674 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:40.046518 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
mode: GRACEFUL
new_leader_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:38966
I20260709 13:10:40.047081 24596 raft_consensus.cc:606] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Received request to transfer leadership to TS 4c90fd653e3e4007aafee61437223c67
I20260709 13:10:40.049125 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
mode: GRACEFUL
new_leader_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:38966
I20260709 13:10:40.049512 24596 raft_consensus.cc:606] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Received request to transfer leadership to TS 4c90fd653e3e4007aafee61437223c67
I20260709 13:10:40.051359 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "546f57378fc6470a94f57aa396406051"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:40.051743 24671 raft_consensus.cc:606] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:40.052687 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:40.053098 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:40.053602 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:40.113549 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:40.257794 24957 raft_consensus.cc:993] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:40.258291 24909 raft_consensus.cc:1081] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:40.259613 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "546f57378fc6470a94f57aa396406051"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:40.260066 24596 raft_consensus.cc:493] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:40.260398 24596 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.264648 24596 raft_consensus.cc:515] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.266073 24596 leader_election.cc:290] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 4 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:40.266768 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:40.266887 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546f57378fc6470a94f57aa396406051" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:40.267395 24861 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.267491 24671 raft_consensus.cc:3055] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:40.267858 24671 raft_consensus.cc:740] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:40.268435 24671 consensus_queue.cc:260] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.269331 24671 raft_consensus.cc:3060] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.271644 24861 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 4.
I20260709 13:10:40.272571 24561 leader_election.cc:304] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:40.273236 24808 raft_consensus.cc:2804] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:40.273586 24808 raft_consensus.cc:697] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:40.273676 24671 raft_consensus.cc:2468] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 4.
I20260709 13:10:40.274291 24808 consensus_queue.cc:237] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.279775 24418 catalog_manager.cc:5697] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 3 to 4, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 4 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.322561 24960 raft_consensus.cc:993] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4: : Instructing follower 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:40.322976 24960 raft_consensus.cc:1081] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Signalling peer 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:40.324234 24671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:48372
I20260709 13:10:40.324677 24671 raft_consensus.cc:493] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:40.324990 24671 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.329738 24671 raft_consensus.cc:515] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.331281 24671 leader_election.cc:290] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:40.331867 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:40.332239 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338b7401f86641beb0dd80c0df0158d5" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:40.332415 24861 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.332705 24596 raft_consensus.cc:3055] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:40.332957 24596 raft_consensus.cc:740] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:40.333519 24596 consensus_queue.cc:260] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.334338 24596 raft_consensus.cc:3060] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.336580 24861 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 3.
I20260709 13:10:40.337423 24635 leader_election.cc:304] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:40.338102 24909 raft_consensus.cc:2804] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.338496 24909 raft_consensus.cc:697] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:40.338666 24596 raft_consensus.cc:2468] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 3.
I20260709 13:10:40.339167 24909 consensus_queue.cc:237] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.345171 24418 catalog_manager.cc:5697] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 2 to 3, leader changed from 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2) to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.383976 24961 raft_consensus.cc:993] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4: : Instructing follower 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:40.384379 24961 raft_consensus.cc:1081] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Signalling peer 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:40.385672 24671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:48372
I20260709 13:10:40.386085 24671 raft_consensus.cc:493] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:40.386317 24671 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.390514 24671 raft_consensus.cc:515] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.391755 24671 leader_election.cc:290] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:40.392728 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:40.392894 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:40.393270 24861 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.393477 24596 raft_consensus.cc:3055] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:40.393783 24596 raft_consensus.cc:740] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:40.394330 24596 consensus_queue.cc:260] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.395171 24596 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.397675 24861 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 3.
I20260709 13:10:40.398496 24635 leader_election.cc:304] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:40.399080 24909 raft_consensus.cc:2804] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.399431 24909 raft_consensus.cc:697] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:40.399528 24596 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 3.
I20260709 13:10:40.400203 24909 consensus_queue.cc:237] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:40.405779 24418 catalog_manager.cc:5697] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 2 to 3, leader changed from 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2) to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.697793 24861 raft_consensus.cc:1275] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:40.698860 24961 consensus_queue.cc:1048] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:40.707109 24671 raft_consensus.cc:1275] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:40.709223 24960 consensus_queue.cc:1048] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:40.782261 24861 raft_consensus.cc:1275] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:40.783262 24909 consensus_queue.cc:1048] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.789496 24596 raft_consensus.cc:1275] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:40.790928 24971 consensus_queue.cc:1048] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.838598 24861 raft_consensus.cc:1275] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:40.839880 24971 consensus_queue.cc:1048] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.848153 24596 raft_consensus.cc:1275] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:40.850247 24909 consensus_queue.cc:1048] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.059576 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:41.066509 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:41.066969 24671 raft_consensus.cc:606] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:41.069288 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
mode: GRACEFUL
new_leader_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:38966
I20260709 13:10:41.069723 24596 raft_consensus.cc:606] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Received request to transfer leadership to TS 4c90fd653e3e4007aafee61437223c67
I20260709 13:10:41.072074 24671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
mode: GRACEFUL
new_leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:10:41.072540 24671 raft_consensus.cc:606] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Received request to transfer leadership to TS 65ef14ee827c4b34b4afd4510da9e2f4
I20260709 13:10:41.073503 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:41.073930 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:41.074429 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:41.114352 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:41.209368 24971 raft_consensus.cc:993] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:41.209980 24909 raft_consensus.cc:1081] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:41.211314 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:41.211869 24596 raft_consensus.cc:493] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.212203 24596 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.216703 24596 raft_consensus.cc:515] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.218236 24596 leader_election.cc:290] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 4 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:41.218928 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:41.219312 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460137cb3d744ab2b5053ff07edf7b9e" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:41.219543 24861 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.220024 24671 raft_consensus.cc:3055] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.220325 24671 raft_consensus.cc:740] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:41.221024 24671 consensus_queue.cc:260] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.222108 24671 raft_consensus.cc:3060] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.225740 24861 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 4.
I20260709 13:10:41.226744 24561 leader_election.cc:304] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:41.227317 24960 raft_consensus.cc:2804] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:41.227658 24671 raft_consensus.cc:2468] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 4.
I20260709 13:10:41.228186 24960 raft_consensus.cc:697] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:41.229084 24960 consensus_queue.cc:237] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.237123 24419 catalog_manager.cc:5697] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 3 to 4, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 4 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.431761 24909 raft_consensus.cc:993] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67: : Instructing follower 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:41.432188 24957 raft_consensus.cc:1081] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Signalling peer 65ef14ee827c4b34b4afd4510da9e2f4 to start an election
I20260709 13:10:41.433442 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2"
dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
 from {username='slave'} at 127.0.0.1:57792
I20260709 13:10:41.433848 24596 raft_consensus.cc:493] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.434090 24596 raft_consensus.cc:3060] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.438303 24596 raft_consensus.cc:515] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.439553 24596 leader_election.cc:290] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 4c90fd653e3e4007aafee61437223c67 (127.15.6.3:38707)
I20260709 13:10:41.440255 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:41.440385 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b2e8fac074c039458fcf111bb19c2" candidate_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c90fd653e3e4007aafee61437223c67"
I20260709 13:10:41.440747 24861 raft_consensus.cc:3060] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.440887 24671 raft_consensus.cc:3055] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.441255 24671 raft_consensus.cc:740] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:41.441861 24671 consensus_queue.cc:260] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.442690 24671 raft_consensus.cc:3060] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.445091 24861 raft_consensus.cc:2468] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:41.445983 24561 leader_election.cc:304] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ef14ee827c4b34b4afd4510da9e2f4, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:41.446714 24978 raft_consensus.cc:2804] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:41.446970 24671 raft_consensus.cc:2468] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ef14ee827c4b34b4afd4510da9e2f4 in term 2.
I20260709 13:10:41.447177 24978 raft_consensus.cc:697] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Becoming Leader. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:41.448043 24978 consensus_queue.cc:237] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.454640 24419 catalog_manager.cc:5697] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 reported cstate change: term changed from 1 to 2, leader changed from 4c90fd653e3e4007aafee61437223c67 (127.15.6.3) to 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.552757 24974 raft_consensus.cc:993] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4: : Instructing follower 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:41.553210 24978 raft_consensus.cc:1081] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Signalling peer 4c90fd653e3e4007aafee61437223c67 to start an election
I20260709 13:10:41.554585 24671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46"
dest_uuid: "4c90fd653e3e4007aafee61437223c67"
 from {username='slave'} at 127.0.0.1:48372
I20260709 13:10:41.555012 24671 raft_consensus.cc:493] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.555275 24671 raft_consensus.cc:3060] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.559393 24671 raft_consensus.cc:515] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.560824 24671 leader_election.cc:290] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Requested vote from peers d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011), 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839)
I20260709 13:10:41.561432 24861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7d5902b8d2e4123852604f001c83cec"
I20260709 13:10:41.561766 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95eec89f4b14454a9a446dc4c70c6e46" candidate_uuid: "4c90fd653e3e4007aafee61437223c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65ef14ee827c4b34b4afd4510da9e2f4"
I20260709 13:10:41.562026 24861 raft_consensus.cc:3060] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.562335 24596 raft_consensus.cc:3055] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.562626 24596 raft_consensus.cc:740] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65ef14ee827c4b34b4afd4510da9e2f4, State: Running, Role: LEADER
I20260709 13:10:41.563350 24596 consensus_queue.cc:260] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.564548 24596 raft_consensus.cc:3060] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.567973 24861 raft_consensus.cc:2468] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 2.
I20260709 13:10:41.569000 24635 leader_election.cc:304] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c90fd653e3e4007aafee61437223c67, d7d5902b8d2e4123852604f001c83cec; no voters: 
I20260709 13:10:41.569754 24957 raft_consensus.cc:2804] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:41.570195 24957 raft_consensus.cc:697] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 2 LEADER]: Becoming Leader. State: Replica: 4c90fd653e3e4007aafee61437223c67, State: Running, Role: LEADER
I20260709 13:10:41.570557 24596 raft_consensus.cc:2468] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c90fd653e3e4007aafee61437223c67 in term 2.
I20260709 13:10:41.571043 24957 consensus_queue.cc:237] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } }
I20260709 13:10:41.577548 24419 catalog_manager.cc:5697] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 reported cstate change: term changed from 1 to 2, leader changed from 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2) to 4c90fd653e3e4007aafee61437223c67 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "4c90fd653e3e4007aafee61437223c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.733871 24671 raft_consensus.cc:1275] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:41.734906 24978 consensus_queue.cc:1048] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:41.743239 24862 raft_consensus.cc:1275] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:41.744619 24974 consensus_queue.cc:1048] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:41.959241 24862 raft_consensus.cc:1275] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.960350 24957 consensus_queue.cc:1048] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.969122 24596 raft_consensus.cc:1275] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Refusing update from remote peer 4c90fd653e3e4007aafee61437223c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.972064 24986 consensus_queue.cc:1048] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ef14ee827c4b34b4afd4510da9e2f4" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.974567 24860 raft_consensus.cc:1275] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.976109 24978 consensus_queue.cc:1048] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d5902b8d2e4123852604f001c83cec" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 38011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.985919 24671 raft_consensus.cc:1275] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Refusing update from remote peer 65ef14ee827c4b34b4afd4510da9e2f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.987274 24974 consensus_queue.cc:1048] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c90fd653e3e4007aafee61437223c67" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.080245 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.107326 15384 tablet_server.cc:179] TabletServer@127.15.6.1:38011 shutting down...
W20260709 13:10:42.115396 24469 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:42.125931 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:42.126580 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.127135 15384 raft_consensus.cc:2243] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.127547 15384 raft_consensus.cc:2272] T 981db84394474d88b05cc2cf36a60a2b P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.129544 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.130101 15384 raft_consensus.cc:2243] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.130496 15384 raft_consensus.cc:2272] T 3a884b9fd4a04eba8c3a9b0fce256a6b P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.132205 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.132694 15384 raft_consensus.cc:2243] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.133080 15384 raft_consensus.cc:2272] T 338b7401f86641beb0dd80c0df0158d5 P d7d5902b8d2e4123852604f001c83cec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.134831 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.135331 15384 raft_consensus.cc:2243] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.135704 15384 raft_consensus.cc:2272] T 95eec89f4b14454a9a446dc4c70c6e46 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.137706 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.138221 15384 raft_consensus.cc:2243] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.138646 15384 raft_consensus.cc:2272] T 546f57378fc6470a94f57aa396406051 P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.140365 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.140831 15384 raft_consensus.cc:2243] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.141204 15384 raft_consensus.cc:2272] T bc122c82955a420a94a7dfa61ad25102 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.142824 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.143291 15384 raft_consensus.cc:2243] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.143664 15384 raft_consensus.cc:2272] T 1189686b489e433fa2a0293731cb4b93 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.145362 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.145819 15384 raft_consensus.cc:2243] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.146224 15384 raft_consensus.cc:2272] T 460137cb3d744ab2b5053ff07edf7b9e P d7d5902b8d2e4123852604f001c83cec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.148343 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.148808 15384 raft_consensus.cc:2243] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.149171 15384 raft_consensus.cc:2272] T d17339327c114749a38fdf6f00c19a8b P d7d5902b8d2e4123852604f001c83cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.150761 15384 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:42.151172 15384 raft_consensus.cc:2243] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.151528 15384 raft_consensus.cc:2272] T cd1b2e8fac074c039458fcf111bb19c2 P d7d5902b8d2e4123852604f001c83cec [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.168367 24635 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260709 13:10:42.168514 15384 tablet_server.cc:196] TabletServer@127.15.6.1:38011 shutdown complete.
W20260709 13:10:42.171243 24635 consensus_peers.cc:597] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.185351 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
W20260709 13:10:42.208973 24561 consensus_peers.cc:597] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.215335 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:42.216027 15384 tablet_replica.cc:333] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.216709 15384 raft_consensus.cc:2243] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.217137 15384 raft_consensus.cc:2272] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.219193 15384 tablet_replica.cc:333] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.219763 15384 raft_consensus.cc:2243] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.220600 15384 raft_consensus.cc:2272] T cd1b2e8fac074c039458fcf111bb19c2 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.223611 15384 tablet_replica.cc:333] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
W20260709 13:10:42.223918 24637 consensus_peers.cc:597] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 -> Peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Couldn't send request to peer 65ef14ee827c4b34b4afd4510da9e2f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.224182 15384 raft_consensus.cc:2243] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.224709 15384 raft_consensus.cc:2272] T d17339327c114749a38fdf6f00c19a8b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.226562 15384 tablet_replica.cc:333] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.227115 15384 raft_consensus.cc:2243] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.227838 15384 raft_consensus.cc:2272] T 460137cb3d744ab2b5053ff07edf7b9e P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.229967 15384 tablet_replica.cc:333] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.230450 15384 raft_consensus.cc:2243] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.231133 15384 raft_consensus.cc:2272] T 1189686b489e433fa2a0293731cb4b93 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.233021 15384 tablet_replica.cc:333] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.233480 15384 raft_consensus.cc:2243] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.233861 15384 raft_consensus.cc:2272] T 338b7401f86641beb0dd80c0df0158d5 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.235625 15384 tablet_replica.cc:333] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.236114 15384 raft_consensus.cc:2243] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.236469 15384 raft_consensus.cc:2272] T 95eec89f4b14454a9a446dc4c70c6e46 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.239254 15384 tablet_replica.cc:333] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.239850 15384 raft_consensus.cc:2243] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.240639 15384 raft_consensus.cc:2272] T 981db84394474d88b05cc2cf36a60a2b P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.240854 24637 consensus_peers.cc:597] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 -> Peer 65ef14ee827c4b34b4afd4510da9e2f4 (127.15.6.2:46839): Couldn't send request to peer 65ef14ee827c4b34b4afd4510da9e2f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.242501 15384 tablet_replica.cc:333] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.243047 15384 raft_consensus.cc:2243] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.243700 15384 raft_consensus.cc:2272] T 546f57378fc6470a94f57aa396406051 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.245999 15384 tablet_replica.cc:333] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4: stopping tablet replica
I20260709 13:10:42.246496 15384 raft_consensus.cc:2243] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.246876 15384 raft_consensus.cc:2272] T bc122c82955a420a94a7dfa61ad25102 P 65ef14ee827c4b34b4afd4510da9e2f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.249012 24635 consensus_peers.cc:597] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 -> Peer d7d5902b8d2e4123852604f001c83cec (127.15.6.1:38011): Couldn't send request to peer d7d5902b8d2e4123852604f001c83cec. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:38011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.267395 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
I20260709 13:10:42.288838 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
I20260709 13:10:42.308444 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:42.309031 15384 tablet_replica.cc:333] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.309655 15384 raft_consensus.cc:2243] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.310369 15384 raft_consensus.cc:2272] T 3a884b9fd4a04eba8c3a9b0fce256a6b P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.312428 15384 tablet_replica.cc:333] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.312999 15384 raft_consensus.cc:2243] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.313400 15384 raft_consensus.cc:2272] T 1189686b489e433fa2a0293731cb4b93 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.315265 15384 tablet_replica.cc:333] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.315769 15384 raft_consensus.cc:2243] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.316179 15384 raft_consensus.cc:2272] T 460137cb3d744ab2b5053ff07edf7b9e P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.318521 15384 tablet_replica.cc:333] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.319007 15384 raft_consensus.cc:2243] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.319687 15384 raft_consensus.cc:2272] T 338b7401f86641beb0dd80c0df0158d5 P 4c90fd653e3e4007aafee61437223c67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.321559 15384 tablet_replica.cc:333] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.322045 15384 raft_consensus.cc:2243] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.322736 15384 raft_consensus.cc:2272] T 95eec89f4b14454a9a446dc4c70c6e46 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.325124 15384 tablet_replica.cc:333] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.325621 15384 raft_consensus.cc:2243] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.326306 15384 raft_consensus.cc:2272] T bc122c82955a420a94a7dfa61ad25102 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.328138 15384 tablet_replica.cc:333] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.328588 15384 raft_consensus.cc:2243] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.328948 15384 raft_consensus.cc:2272] T 546f57378fc6470a94f57aa396406051 P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.330746 15384 tablet_replica.cc:333] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.331195 15384 raft_consensus.cc:2243] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.331555 15384 raft_consensus.cc:2272] T cd1b2e8fac074c039458fcf111bb19c2 P 4c90fd653e3e4007aafee61437223c67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.333670 15384 tablet_replica.cc:333] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.334123 15384 raft_consensus.cc:2243] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.334830 15384 raft_consensus.cc:2272] T d17339327c114749a38fdf6f00c19a8b P 4c90fd653e3e4007aafee61437223c67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.336652 15384 tablet_replica.cc:333] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67: stopping tablet replica
I20260709 13:10:42.337055 15384 raft_consensus.cc:2243] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.337412 15384 raft_consensus.cc:2272] T 981db84394474d88b05cc2cf36a60a2b P 4c90fd653e3e4007aafee61437223c67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.364997 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
I20260709 13:10:42.385603 15384 master.cc:562] Master@127.15.6.62:40757 shutting down...
I20260709 13:10:42.404489 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.405001 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.405330 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1c8dec78402a4f7aa837a4fe1fc1ef51: stopping tablet replica
I20260709 13:10:42.424242 15384 master.cc:584] Master@127.15.6.62:40757 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12481 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:42.459926 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:34217
I20260709 13:10:42.460942 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.465545 24997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.466274 24998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.466624 25000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.467242 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:42.468035 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.468217 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.468348 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602642468331 us; error 0 us; skew 500 ppm
I20260709 13:10:42.468822 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.470849 15384 webserver.cc:533] Webserver started at http://127.15.6.62:37003/ using document root <none> and password file <none>
I20260709 13:10:42.471313 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.471480 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.471726 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.472795 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "58e6c5ea7d304779bc64d4607490cbcf"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.476791 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:42.479655 25005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.480341 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:42.480589 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "58e6c5ea7d304779bc64d4607490cbcf"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.480832 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.497502 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.498550 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.532812 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:34217
I20260709 13:10:42.532902 25056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:34217 every 8 connection(s)
I20260709 13:10:42.536377 25057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:42.546657 25057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf: Bootstrap starting.
I20260709 13:10:42.551191 25057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.554891 25057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf: No bootstrap required, opened a new log
I20260709 13:10:42.556852 25057 raft_consensus.cc:359] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e6c5ea7d304779bc64d4607490cbcf" member_type: VOTER }
I20260709 13:10:42.557183 25057 raft_consensus.cc:385] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.557351 25057 raft_consensus.cc:740] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e6c5ea7d304779bc64d4607490cbcf, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.557857 25057 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e6c5ea7d304779bc64d4607490cbcf" member_type: VOTER }
I20260709 13:10:42.558256 25057 raft_consensus.cc:399] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:42.558458 25057 raft_consensus.cc:493] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:42.558655 25057 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.562620 25057 raft_consensus.cc:515] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e6c5ea7d304779bc64d4607490cbcf" member_type: VOTER }
I20260709 13:10:42.563040 25057 leader_election.cc:304] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58e6c5ea7d304779bc64d4607490cbcf; no voters: 
I20260709 13:10:42.564010 25057 leader_election.cc:290] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:42.564302 25060 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.565681 25060 raft_consensus.cc:697] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 1 LEADER]: Becoming Leader. State: Replica: 58e6c5ea7d304779bc64d4607490cbcf, State: Running, Role: LEADER
I20260709 13:10:42.566248 25060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e6c5ea7d304779bc64d4607490cbcf" member_type: VOTER }
I20260709 13:10:42.566551 25057 sys_catalog.cc:565] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:42.569151 25062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58e6c5ea7d304779bc64d4607490cbcf. Latest consensus state: current_term: 1 leader_uuid: "58e6c5ea7d304779bc64d4607490cbcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e6c5ea7d304779bc64d4607490cbcf" member_type: VOTER } }
I20260709 13:10:42.569162 25061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58e6c5ea7d304779bc64d4607490cbcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e6c5ea7d304779bc64d4607490cbcf" member_type: VOTER } }
I20260709 13:10:42.569979 25061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:42.570931 25062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:42.575763 25066 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:42.580412 25066 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:42.581410 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:42.587880 25066 catalog_manager.cc:1383] Generated new cluster ID: 30586140c40e4b8d87ce6e650e8a15c2
I20260709 13:10:42.588119 25066 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:42.611260 25066 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:42.612468 25066 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:42.630626 25066 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf: Generated new TSK 0
I20260709 13:10:42.631155 25066 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:42.647209 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.652731 25078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.653566 25079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.655073 25081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.655323 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:42.656291 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.656471 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.656586 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602642656575 us; error 0 us; skew 500 ppm
I20260709 13:10:42.657051 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.659106 15384 webserver.cc:533] Webserver started at http://127.15.6.1:43705/ using document root <none> and password file <none>
I20260709 13:10:42.659525 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.659673 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.659925 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.660890 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "e56160cfd54847bc93735e50a85b2f92"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.665009 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:10:42.668113 25086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.668789 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:42.669046 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "e56160cfd54847bc93735e50a85b2f92"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.669298 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.689224 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.690318 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.691632 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:42.693732 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:42.693917 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.694125 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:42.694268 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.730922 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:41547
I20260709 13:10:42.731057 25148 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:41547 every 8 connection(s)
I20260709 13:10:42.735495 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.742396 25153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.744491 25154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.745419 15384 server_base.cc:1061] running on GCE node
W20260709 13:10:42.746259 25156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.747203 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.747404 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.747478 25149 heartbeater.cc:344] Connected to a master server at 127.15.6.62:34217
I20260709 13:10:42.747611 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602642747592 us; error 0 us; skew 500 ppm
I20260709 13:10:42.747958 25149 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:42.748401 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.748591 25149 heartbeater.cc:507] Master 127.15.6.62:34217 requested a full tablet report, sending...
I20260709 13:10:42.750700 25022 ts_manager.cc:194] Registered new tserver with Master: e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547)
I20260709 13:10:42.750854 15384 webserver.cc:533] Webserver started at http://127.15.6.2:37047/ using document root <none> and password file <none>
I20260709 13:10:42.751431 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.751614 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.751904 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.752681 25022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40108
I20260709 13:10:42.752883 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "82d4b0865a354ca183997557841cbc49"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.757216 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:42.760205 25161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.760859 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:42.761109 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "82d4b0865a354ca183997557841cbc49"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.761356 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.793205 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.794308 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.795670 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:42.797731 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:42.797927 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.798130 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:42.798271 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.834630 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:45827
I20260709 13:10:42.834726 25223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:45827 every 8 connection(s)
I20260709 13:10:42.839129 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:42.845947 25228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:42.848312 25227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.849572 15384 server_base.cc:1061] running on GCE node
W20260709 13:10:42.850260 25230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:42.850878 25224 heartbeater.cc:344] Connected to a master server at 127.15.6.62:34217
I20260709 13:10:42.851224 25224 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:42.851236 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:42.851600 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:42.851756 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602642851741 us; error 0 us; skew 500 ppm
I20260709 13:10:42.852057 25224 heartbeater.cc:507] Master 127.15.6.62:34217 requested a full tablet report, sending...
I20260709 13:10:42.852386 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:42.854017 25022 ts_manager.cc:194] Registered new tserver with Master: 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827)
I20260709 13:10:42.854749 15384 webserver.cc:533] Webserver started at http://127.15.6.3:45485/ using document root <none> and password file <none>
I20260709 13:10:42.855242 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:42.855403 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:42.855422 25022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40122
I20260709 13:10:42.855727 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:42.856997 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "68f5c730ad164b4eaddccedadf445e32"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.861065 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:42.864094 25235 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.864796 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:42.865067 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "68f5c730ad164b4eaddccedadf445e32"
format_stamp: "Formatted at 2026-07-09 13:10:42 on dist-test-slave-pqzm"
I20260709 13:10:42.865319 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:42.900211 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:42.901273 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:42.902577 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:42.904608 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:42.904798 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.905002 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:42.905161 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:42.941407 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:39959
I20260709 13:10:42.941512 25297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:39959 every 8 connection(s)
I20260709 13:10:42.953994 25298 heartbeater.cc:344] Connected to a master server at 127.15.6.62:34217
I20260709 13:10:42.954401 25298 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:42.955072 25298 heartbeater.cc:507] Master 127.15.6.62:34217 requested a full tablet report, sending...
I20260709 13:10:42.956863 25022 ts_manager.cc:194] Registered new tserver with Master: 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3:39959)
I20260709 13:10:42.957826 15384 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013292143s
I20260709 13:10:42.958112 25022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40124
I20260709 13:10:42.980453 25022 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40126:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:42.982491 25022 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:43.028139 25189 tablet_service.cc:1511] Processing CreateTablet for tablet cc3dd576308143d89119b89209900942 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b538b79f41b742d8ad3a9d527c40da36]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:43.028429 25188 tablet_service.cc:1511] Processing CreateTablet for tablet edc8d191c0bf45bdb9f523f72ce97666 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b538b79f41b742d8ad3a9d527c40da36]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:43.029516 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3dd576308143d89119b89209900942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.030099 25188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc8d191c0bf45bdb9f523f72ce97666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.037878 25262 tablet_service.cc:1511] Processing CreateTablet for tablet edc8d191c0bf45bdb9f523f72ce97666 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b538b79f41b742d8ad3a9d527c40da36]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:43.038213 25263 tablet_service.cc:1511] Processing CreateTablet for tablet cc3dd576308143d89119b89209900942 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b538b79f41b742d8ad3a9d527c40da36]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:43.039244 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc8d191c0bf45bdb9f523f72ce97666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.039783 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3dd576308143d89119b89209900942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.039491 25113 tablet_service.cc:1511] Processing CreateTablet for tablet edc8d191c0bf45bdb9f523f72ce97666 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b538b79f41b742d8ad3a9d527c40da36]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:43.040779 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc8d191c0bf45bdb9f523f72ce97666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.038303 25114 tablet_service.cc:1511] Processing CreateTablet for tablet cc3dd576308143d89119b89209900942 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b538b79f41b742d8ad3a9d527c40da36]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:43.043547 25114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3dd576308143d89119b89209900942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.074260 25313 tablet_bootstrap.cc:492] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49: Bootstrap starting.
I20260709 13:10:43.074677 25314 tablet_bootstrap.cc:492] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32: Bootstrap starting.
I20260709 13:10:43.076027 25315 tablet_bootstrap.cc:492] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92: Bootstrap starting.
I20260709 13:10:43.081172 25315 tablet_bootstrap.cc:654] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.081610 25314 tablet_bootstrap.cc:654] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.081614 25313 tablet_bootstrap.cc:654] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.089942 25313 tablet_bootstrap.cc:492] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49: No bootstrap required, opened a new log
I20260709 13:10:43.090378 25313 ts_tablet_manager.cc:1403] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:10:43.090404 25315 tablet_bootstrap.cc:492] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92: No bootstrap required, opened a new log
I20260709 13:10:43.090687 25314 tablet_bootstrap.cc:492] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32: No bootstrap required, opened a new log
I20260709 13:10:43.091054 25315 ts_tablet_manager.cc:1403] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:10:43.091126 25314 ts_tablet_manager.cc:1403] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:10:43.094026 25314 raft_consensus.cc:359] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.094189 25315 raft_consensus.cc:359] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.094352 25313 raft_consensus.cc:359] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.094795 25314 raft_consensus.cc:385] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.094940 25315 raft_consensus.cc:385] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.095017 25313 raft_consensus.cc:385] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.095160 25314 raft_consensus.cc:740] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.095359 25315 raft_consensus.cc:740] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.095504 25313 raft_consensus.cc:740] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d4b0865a354ca183997557841cbc49, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.096109 25314 consensus_queue.cc:260] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.096446 25313 consensus_queue.cc:260] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.096334 25315 consensus_queue.cc:260] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.098254 25298 heartbeater.cc:499] Master 127.15.6.62:34217 was elected leader, sending a full tablet report...
I20260709 13:10:43.098757 25314 ts_tablet_manager.cc:1434] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:10:43.099692 25314 tablet_bootstrap.cc:492] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32: Bootstrap starting.
I20260709 13:10:43.105712 25314 tablet_bootstrap.cc:654] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.108842 25315 ts_tablet_manager.cc:1434] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.009s
I20260709 13:10:43.110351 25224 heartbeater.cc:499] Master 127.15.6.62:34217 was elected leader, sending a full tablet report...
I20260709 13:10:43.110909 25313 ts_tablet_manager.cc:1434] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:10:43.111981 25313 tablet_bootstrap.cc:492] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49: Bootstrap starting.
I20260709 13:10:43.113372 25149 heartbeater.cc:499] Master 127.15.6.62:34217 was elected leader, sending a full tablet report...
I20260709 13:10:43.116001 25315 tablet_bootstrap.cc:492] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92: Bootstrap starting.
I20260709 13:10:43.117900 25313 tablet_bootstrap.cc:654] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.121742 25315 tablet_bootstrap.cc:654] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.132949 25314 tablet_bootstrap.cc:492] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32: No bootstrap required, opened a new log
I20260709 13:10:43.133509 25314 ts_tablet_manager.cc:1403] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.016s
I20260709 13:10:43.135743 25313 tablet_bootstrap.cc:492] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49: No bootstrap required, opened a new log
I20260709 13:10:43.136265 25313 ts_tablet_manager.cc:1403] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.008s
I20260709 13:10:43.136178 25314 raft_consensus.cc:359] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.136971 25314 raft_consensus.cc:385] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.137269 25314 raft_consensus.cc:740] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.137913 25315 tablet_bootstrap.cc:492] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92: No bootstrap required, opened a new log
I20260709 13:10:43.138423 25315 ts_tablet_manager.cc:1403] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.002s
I20260709 13:10:43.138100 25314 consensus_queue.cc:260] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.138653 25313 raft_consensus.cc:359] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.139413 25313 raft_consensus.cc:385] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.139741 25313 raft_consensus.cc:740] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d4b0865a354ca183997557841cbc49, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.140349 25314 ts_tablet_manager.cc:1434] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:43.140668 25313 consensus_queue.cc:260] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.142256 25315 raft_consensus.cc:359] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.142709 25313 ts_tablet_manager.cc:1434] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:10:43.143045 25315 raft_consensus.cc:385] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.143467 25315 raft_consensus.cc:740] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.144148 25315 consensus_queue.cc:260] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.146075 25315 ts_tablet_manager.cc:1434] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:43.358741 25319 raft_consensus.cc:493] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.359249 25319 raft_consensus.cc:515] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.361281 25319 leader_election.cc:290] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827), e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547)
I20260709 13:10:43.369509 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3dd576308143d89119b89209900942" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d4b0865a354ca183997557841cbc49" is_pre_election: true
I20260709 13:10:43.370252 25199 raft_consensus.cc:2468] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 0.
I20260709 13:10:43.370801 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3dd576308143d89119b89209900942" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92" is_pre_election: true
I20260709 13:10:43.371258 25239 leader_election.cc:304] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, 82d4b0865a354ca183997557841cbc49; no voters: 
I20260709 13:10:43.371464 25124 raft_consensus.cc:2468] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 0.
I20260709 13:10:43.372023 25319 raft_consensus.cc:2804] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.372320 25319 raft_consensus.cc:493] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.372677 25319 raft_consensus.cc:3060] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.377592 25319 raft_consensus.cc:515] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.379201 25319 leader_election.cc:290] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 election: Requested vote from peers 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827), e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547)
I20260709 13:10:43.379913 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3dd576308143d89119b89209900942" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d4b0865a354ca183997557841cbc49"
I20260709 13:10:43.380226 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3dd576308143d89119b89209900942" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
I20260709 13:10:43.380581 25199 raft_consensus.cc:3060] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.380827 25124 raft_consensus.cc:3060] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.387579 25199 raft_consensus.cc:2468] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 1.
I20260709 13:10:43.387579 25124 raft_consensus.cc:2468] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 1.
I20260709 13:10:43.388778 25237 leader_election.cc:304] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, e56160cfd54847bc93735e50a85b2f92; no voters: 
I20260709 13:10:43.389449 25319 raft_consensus.cc:2804] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:43.390388 25319 raft_consensus.cc:697] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Becoming Leader. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Running, Role: LEADER
I20260709 13:10:43.391065 25319 consensus_queue.cc:237] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.398553 25020 catalog_manager.cc:5697] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "68f5c730ad164b4eaddccedadf445e32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.506882 25319 raft_consensus.cc:493] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.507395 25319 raft_consensus.cc:515] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.509016 25319 leader_election.cc:290] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547), 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827)
I20260709 13:10:43.509841 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc8d191c0bf45bdb9f523f72ce97666" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92" is_pre_election: true
I20260709 13:10:43.509976 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc8d191c0bf45bdb9f523f72ce97666" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d4b0865a354ca183997557841cbc49" is_pre_election: true
I20260709 13:10:43.510610 25124 raft_consensus.cc:2468] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 0.
I20260709 13:10:43.510644 25199 raft_consensus.cc:2468] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 0.
I20260709 13:10:43.511821 25239 leader_election.cc:304] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, 82d4b0865a354ca183997557841cbc49; no voters: 
I20260709 13:10:43.512418 25319 raft_consensus.cc:2804] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.512737 25319 raft_consensus.cc:493] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.513047 25319 raft_consensus.cc:3060] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.518054 25319 raft_consensus.cc:515] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.519477 25319 leader_election.cc:290] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 election: Requested vote from peers e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547), 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827)
I20260709 13:10:43.520215 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc8d191c0bf45bdb9f523f72ce97666" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
I20260709 13:10:43.520377 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc8d191c0bf45bdb9f523f72ce97666" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d4b0865a354ca183997557841cbc49"
I20260709 13:10:43.520752 25124 raft_consensus.cc:3060] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.520874 25199 raft_consensus.cc:3060] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.525197 25124 raft_consensus.cc:2468] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 1.
I20260709 13:10:43.525329 25199 raft_consensus.cc:2468] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 1.
I20260709 13:10:43.526129 25237 leader_election.cc:304] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, e56160cfd54847bc93735e50a85b2f92; no voters: 
I20260709 13:10:43.526793 25319 raft_consensus.cc:2804] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:43.527148 25319 raft_consensus.cc:697] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Becoming Leader. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Running, Role: LEADER
I20260709 13:10:43.527724 25319 consensus_queue.cc:237] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.533632 25020 catalog_manager.cc:5697] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "68f5c730ad164b4eaddccedadf445e32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.648361 25020 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40140:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:43.650239 25020 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:43.672225 25113 tablet_service.cc:1511] Processing CreateTablet for tablet 7046c004a9d24c328b5fe301a67fc3b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ce92467f0f9e4b26ae3cf020c1f37bb0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:43.673494 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7046c004a9d24c328b5fe301a67fc3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.673553 25189 tablet_service.cc:1511] Processing CreateTablet for tablet 7046c004a9d24c328b5fe301a67fc3b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ce92467f0f9e4b26ae3cf020c1f37bb0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:43.674902 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7046c004a9d24c328b5fe301a67fc3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.682574 25262 tablet_service.cc:1511] Processing CreateTablet for tablet 7046c004a9d24c328b5fe301a67fc3b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ce92467f0f9e4b26ae3cf020c1f37bb0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:43.683876 25262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7046c004a9d24c328b5fe301a67fc3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.683815 25114 tablet_service.cc:1511] Processing CreateTablet for tablet 74a2f1e7842b46db90d8319a983abaca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ce92467f0f9e4b26ae3cf020c1f37bb0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:43.685158 25114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a2f1e7842b46db90d8319a983abaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.686939 25263 tablet_service.cc:1511] Processing CreateTablet for tablet 74a2f1e7842b46db90d8319a983abaca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ce92467f0f9e4b26ae3cf020c1f37bb0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:43.688186 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a2f1e7842b46db90d8319a983abaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.690131 25188 tablet_service.cc:1511] Processing CreateTablet for tablet 74a2f1e7842b46db90d8319a983abaca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ce92467f0f9e4b26ae3cf020c1f37bb0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:43.691345 25188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a2f1e7842b46db90d8319a983abaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.705726 25336 tablet_bootstrap.cc:492] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32: Bootstrap starting.
I20260709 13:10:43.713068 25336 tablet_bootstrap.cc:654] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.723086 25335 tablet_bootstrap.cc:492] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92: Bootstrap starting.
I20260709 13:10:43.723863 25336 tablet_bootstrap.cc:492] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32: No bootstrap required, opened a new log
I20260709 13:10:43.724406 25336 ts_tablet_manager.cc:1403] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:10:43.726815 25338 tablet_bootstrap.cc:492] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49: Bootstrap starting.
I20260709 13:10:43.727286 25336 raft_consensus.cc:359] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.728075 25336 raft_consensus.cc:385] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.728385 25336 raft_consensus.cc:740] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.729149 25336 consensus_queue.cc:260] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.729750 25335 tablet_bootstrap.cc:654] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.732136 25338 tablet_bootstrap.cc:654] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.733150 25336 ts_tablet_manager.cc:1434] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:43.734349 25336 tablet_bootstrap.cc:492] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32: Bootstrap starting.
I20260709 13:10:43.742195 25336 tablet_bootstrap.cc:654] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.746457 25335 tablet_bootstrap.cc:492] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92: No bootstrap required, opened a new log
I20260709 13:10:43.746951 25335 ts_tablet_manager.cc:1403] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.016s
I20260709 13:10:43.747896 25338 tablet_bootstrap.cc:492] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49: No bootstrap required, opened a new log
I20260709 13:10:43.747910 25336 tablet_bootstrap.cc:492] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32: No bootstrap required, opened a new log
I20260709 13:10:43.748533 25338 ts_tablet_manager.cc:1403] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 13:10:43.749723 25335 raft_consensus.cc:359] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.748582 25336 ts_tablet_manager.cc:1403] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:43.750450 25335 raft_consensus.cc:385] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.750789 25335 raft_consensus.cc:740] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.751498 25338 raft_consensus.cc:359] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.751479 25335 consensus_queue.cc:260] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.752317 25338 raft_consensus.cc:385] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.752636 25338 raft_consensus.cc:740] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d4b0865a354ca183997557841cbc49, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.752692 25336 raft_consensus.cc:359] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.753336 25336 raft_consensus.cc:385] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.753573 25336 raft_consensus.cc:740] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.753589 25338 consensus_queue.cc:260] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.754204 25336 consensus_queue.cc:260] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.756392 25336 ts_tablet_manager.cc:1434] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:43.761245 25335 ts_tablet_manager.cc:1434] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:10:43.762331 25335 tablet_bootstrap.cc:492] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92: Bootstrap starting.
I20260709 13:10:43.763304 25338 ts_tablet_manager.cc:1434] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 13:10:43.766716 25338 tablet_bootstrap.cc:492] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: Bootstrap starting.
I20260709 13:10:43.771616 25335 tablet_bootstrap.cc:654] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.772941 25338 tablet_bootstrap.cc:654] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.776772 25335 tablet_bootstrap.cc:492] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92: No bootstrap required, opened a new log
I20260709 13:10:43.777269 25335 ts_tablet_manager.cc:1403] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:10:43.778188 25338 tablet_bootstrap.cc:492] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: No bootstrap required, opened a new log
I20260709 13:10:43.778687 25338 ts_tablet_manager.cc:1403] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:10:43.780092 25335 raft_consensus.cc:359] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.780817 25335 raft_consensus.cc:385] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.781092 25335 raft_consensus.cc:740] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.781385 25338 raft_consensus.cc:359] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.782080 25338 raft_consensus.cc:385] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.781786 25335 consensus_queue.cc:260] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.782367 25338 raft_consensus.cc:740] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d4b0865a354ca183997557841cbc49, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.783243 25338 consensus_queue.cc:260] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.784034 25335 ts_tablet_manager.cc:1434] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:43.785339 25338 ts_tablet_manager.cc:1434] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.007s
I20260709 13:10:43.822608 25319 consensus_queue.cc:1048] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.833195 25326 consensus_queue.cc:1048] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.972194 25343 raft_consensus.cc:493] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.972608 25343 raft_consensus.cc:515] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.974582 25343 leader_election.cc:290] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547), 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3:39959)
I20260709 13:10:43.993994 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1" candidate_uuid: "82d4b0865a354ca183997557841cbc49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92" is_pre_election: true
I20260709 13:10:43.994095 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1" candidate_uuid: "82d4b0865a354ca183997557841cbc49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f5c730ad164b4eaddccedadf445e32" is_pre_election: true
I20260709 13:10:43.994678 25124 raft_consensus.cc:2468] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82d4b0865a354ca183997557841cbc49 in term 0.
I20260709 13:10:43.994870 25273 raft_consensus.cc:2468] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82d4b0865a354ca183997557841cbc49 in term 0.
I20260709 13:10:43.995711 25163 leader_election.cc:304] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d4b0865a354ca183997557841cbc49, e56160cfd54847bc93735e50a85b2f92; no voters: 
I20260709 13:10:43.995985 25326 raft_consensus.cc:493] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.996524 25343 raft_consensus.cc:2804] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.996433 25326 raft_consensus.cc:515] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:43.996927 25343 raft_consensus.cc:493] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.997290 25343 raft_consensus.cc:3060] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.998505 25326 leader_election.cc:290] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547), 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827)
I20260709 13:10:43.999358 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d4b0865a354ca183997557841cbc49" is_pre_election: true
I20260709 13:10:43.999275 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92" is_pre_election: true
I20260709 13:10:44.000028 25199 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 0.
I20260709 13:10:44.000136 25124 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 0.
I20260709 13:10:44.000890 25239 leader_election.cc:304] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, 82d4b0865a354ca183997557841cbc49; no voters: 
I20260709 13:10:44.001627 25326 raft_consensus.cc:2804] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:44.001974 25326 raft_consensus.cc:493] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.002296 25326 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.004436 25343 raft_consensus.cc:515] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.006408 25343 leader_election.cc:290] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [CANDIDATE]: Term 1 election: Requested vote from peers e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547), 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3:39959)
I20260709 13:10:44.006916 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1" candidate_uuid: "82d4b0865a354ca183997557841cbc49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
I20260709 13:10:44.007354 25124 raft_consensus.cc:3060] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.007285 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1" candidate_uuid: "82d4b0865a354ca183997557841cbc49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f5c730ad164b4eaddccedadf445e32"
I20260709 13:10:44.007933 25273 raft_consensus.cc:3060] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.012727 25273 raft_consensus.cc:2468] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d4b0865a354ca183997557841cbc49 in term 1.
I20260709 13:10:44.013597 25165 leader_election.cc:304] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, 82d4b0865a354ca183997557841cbc49; no voters: 
I20260709 13:10:44.012746 25124 raft_consensus.cc:2468] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d4b0865a354ca183997557841cbc49 in term 1.
I20260709 13:10:44.014230 25343 raft_consensus.cc:2804] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.013867 25326 raft_consensus.cc:515] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.015591 25343 raft_consensus.cc:697] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 LEADER]: Becoming Leader. State: Replica: 82d4b0865a354ca183997557841cbc49, State: Running, Role: LEADER
I20260709 13:10:44.016656 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
I20260709 13:10:44.016764 25326 leader_election.cc:290] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 election: Requested vote from peers e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547), 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827)
I20260709 13:10:44.016981 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "68f5c730ad164b4eaddccedadf445e32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d4b0865a354ca183997557841cbc49"
I20260709 13:10:44.016510 25343 consensus_queue.cc:237] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.017343 25124 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.017544 25199 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:44.023012 25124 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 1.
I20260709 13:10:44.023828 25199 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f5c730ad164b4eaddccedadf445e32 in term 1.
I20260709 13:10:44.023947 25237 leader_election.cc:304] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, e56160cfd54847bc93735e50a85b2f92; no voters: 
I20260709 13:10:44.024752 25326 raft_consensus.cc:2804] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:44.025151 25326 raft_consensus.cc:697] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Becoming Leader. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Running, Role: LEADER
I20260709 13:10:44.025166 25022 catalog_manager.cc:5697] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82d4b0865a354ca183997557841cbc49 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "82d4b0865a354ca183997557841cbc49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.025897 25326 consensus_queue.cc:237] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.033161 25021 catalog_manager.cc:5697] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "68f5c730ad164b4eaddccedadf445e32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.079293 25273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc3dd576308143d89119b89209900942"
dest_uuid: "68f5c730ad164b4eaddccedadf445e32"
mode: GRACEFUL
new_leader_uuid: "e56160cfd54847bc93735e50a85b2f92"
 from {username='slave'} at 127.0.0.1:47162
I20260709 13:10:44.079742 25273 raft_consensus.cc:606] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Received request to transfer leadership to TS e56160cfd54847bc93735e50a85b2f92
I20260709 13:10:44.091674 25326 consensus_queue.cc:1048] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.096050 25198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1"
dest_uuid: "82d4b0865a354ca183997557841cbc49"
mode: GRACEFUL
new_leader_uuid: "e56160cfd54847bc93735e50a85b2f92"
 from {username='slave'} at 127.0.0.1:54366
I20260709 13:10:44.096668 25198 raft_consensus.cc:606] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 LEADER]: Received request to transfer leadership to TS e56160cfd54847bc93735e50a85b2f92
I20260709 13:10:44.102959 25273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca"
dest_uuid: "68f5c730ad164b4eaddccedadf445e32"
mode: GRACEFUL
new_leader_uuid: "e56160cfd54847bc93735e50a85b2f92"
 from {username='slave'} at 127.0.0.1:47162
I20260709 13:10:44.103570 25273 raft_consensus.cc:606] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Received request to transfer leadership to TS e56160cfd54847bc93735e50a85b2f92
I20260709 13:10:44.105921 25326 consensus_queue.cc:1048] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.430490 25326 raft_consensus.cc:993] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32: : Instructing follower e56160cfd54847bc93735e50a85b2f92 to start an election
I20260709 13:10:44.430943 25361 raft_consensus.cc:1081] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Signalling peer e56160cfd54847bc93735e50a85b2f92 to start an election
I20260709 13:10:44.432282 25124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc3dd576308143d89119b89209900942"
dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:10:44.432735 25124 raft_consensus.cc:493] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.433043 25124 raft_consensus.cc:3060] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.437597 25124 raft_consensus.cc:515] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.439481 25124 leader_election.cc:290] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [CANDIDATE]: Term 2 election: Requested vote from peers 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827), 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3:39959)
I20260709 13:10:44.448558 25199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3dd576308143d89119b89209900942" candidate_uuid: "e56160cfd54847bc93735e50a85b2f92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d4b0865a354ca183997557841cbc49"
I20260709 13:10:44.449097 25199 raft_consensus.cc:3060] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.449492 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3dd576308143d89119b89209900942" candidate_uuid: "e56160cfd54847bc93735e50a85b2f92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f5c730ad164b4eaddccedadf445e32"
I20260709 13:10:44.450115 25273 raft_consensus.cc:3055] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.450414 25273 raft_consensus.cc:740] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Running, Role: LEADER
I20260709 13:10:44.451215 25273 consensus_queue.cc:260] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.452521 25273 raft_consensus.cc:3060] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.452706 25343 consensus_queue.cc:1048] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.456305 25199 raft_consensus.cc:2468] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56160cfd54847bc93735e50a85b2f92 in term 2.
I20260709 13:10:44.459106 25273 raft_consensus.cc:2468] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56160cfd54847bc93735e50a85b2f92 in term 2.
I20260709 13:10:44.461306 25090 leader_election.cc:304] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, e56160cfd54847bc93735e50a85b2f92; no voters: 
I20260709 13:10:44.462139 25342 raft_consensus.cc:2804] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.464681 25355 consensus_queue.cc:1048] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.466908 25342 raft_consensus.cc:697] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Becoming Leader. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Running, Role: LEADER
I20260709 13:10:44.467784 25342 consensus_queue.cc:237] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.473182 25366 raft_consensus.cc:993] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49: : Instructing follower e56160cfd54847bc93735e50a85b2f92 to start an election
I20260709 13:10:44.473548 25355 raft_consensus.cc:1081] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 LEADER]: Signalling peer e56160cfd54847bc93735e50a85b2f92 to start an election
I20260709 13:10:44.474223 25022 catalog_manager.cc:5697] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 reported cstate change: term changed from 1 to 2, leader changed from 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3) to e56160cfd54847bc93735e50a85b2f92 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56160cfd54847bc93735e50a85b2f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.475016 25124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1"
dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
 from {username='slave'} at 127.0.0.1:39294
I20260709 13:10:44.475472 25124 raft_consensus.cc:493] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.475874 25124 raft_consensus.cc:3060] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.478096 25361 consensus_queue.cc:1048] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.482555 25124 raft_consensus.cc:515] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.485174 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1" candidate_uuid: "e56160cfd54847bc93735e50a85b2f92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d4b0865a354ca183997557841cbc49"
I20260709 13:10:44.485373 25124 leader_election.cc:290] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [CANDIDATE]: Term 2 election: Requested vote from peers 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827), 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3:39959)
I20260709 13:10:44.485745 25198 raft_consensus.cc:3055] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.486078 25198 raft_consensus.cc:740] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82d4b0865a354ca183997557841cbc49, State: Running, Role: LEADER
I20260709 13:10:44.486619 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7046c004a9d24c328b5fe301a67fc3b1" candidate_uuid: "e56160cfd54847bc93735e50a85b2f92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f5c730ad164b4eaddccedadf445e32"
I20260709 13:10:44.487183 25273 raft_consensus.cc:3060] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.486840 25198 consensus_queue.cc:260] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.488131 25198 raft_consensus.cc:3060] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.495514 25273 raft_consensus.cc:2468] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56160cfd54847bc93735e50a85b2f92 in term 2.
I20260709 13:10:44.497471 25198 raft_consensus.cc:2468] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56160cfd54847bc93735e50a85b2f92 in term 2.
I20260709 13:10:44.498142 25361 consensus_queue.cc:1048] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:44.498456 25090 leader_election.cc:304] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d4b0865a354ca183997557841cbc49, e56160cfd54847bc93735e50a85b2f92; no voters: 
I20260709 13:10:44.500120 25342 raft_consensus.cc:2804] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.508615 25326 raft_consensus.cc:993] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32: : Instructing follower e56160cfd54847bc93735e50a85b2f92 to start an election
I20260709 13:10:44.508996 25326 raft_consensus.cc:1081] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Signalling peer e56160cfd54847bc93735e50a85b2f92 to start an election
I20260709 13:10:44.509050 25342 raft_consensus.cc:697] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Becoming Leader. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Running, Role: LEADER
I20260709 13:10:44.511734 25342 consensus_queue.cc:237] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.512251 25124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca"
dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:10:44.512849 25124 raft_consensus.cc:493] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.513263 25124 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.519146 25124 raft_consensus.cc:515] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.521036 25124 leader_election.cc:290] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [CANDIDATE]: Term 2 election: Requested vote from peers 82d4b0865a354ca183997557841cbc49 (127.15.6.2:45827), 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3:39959)
I20260709 13:10:44.522100 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "e56160cfd54847bc93735e50a85b2f92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f5c730ad164b4eaddccedadf445e32"
I20260709 13:10:44.522750 25273 raft_consensus.cc:3055] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.522706 25198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "e56160cfd54847bc93735e50a85b2f92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d4b0865a354ca183997557841cbc49"
I20260709 13:10:44.523317 25273 raft_consensus.cc:740] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68f5c730ad164b4eaddccedadf445e32, State: Running, Role: LEADER
I20260709 13:10:44.523546 25198 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.524319 25273 consensus_queue.cc:260] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.524261 25022 catalog_manager.cc:5697] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 reported cstate change: term changed from 1 to 2, leader changed from 82d4b0865a354ca183997557841cbc49 (127.15.6.2) to e56160cfd54847bc93735e50a85b2f92 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56160cfd54847bc93735e50a85b2f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.525842 25273 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.530113 25198 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56160cfd54847bc93735e50a85b2f92 in term 2.
I20260709 13:10:44.531337 25090 leader_election.cc:304] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d4b0865a354ca183997557841cbc49, e56160cfd54847bc93735e50a85b2f92; no voters: 
I20260709 13:10:44.532106 25342 raft_consensus.cc:2804] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.532609 25342 raft_consensus.cc:697] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Becoming Leader. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Running, Role: LEADER
I20260709 13:10:44.532609 25273 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e56160cfd54847bc93735e50a85b2f92 in term 2.
I20260709 13:10:44.533574 25342 consensus_queue.cc:237] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.538911 25022 catalog_manager.cc:5697] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 reported cstate change: term changed from 1 to 2, leader changed from 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3) to e56160cfd54847bc93735e50a85b2f92 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "e56160cfd54847bc93735e50a85b2f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.801402 15384 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:44.802944 15384 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:44.803287 15384 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:44.813648 25124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca"
dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
mode: GRACEFUL
new_leader_uuid: "82d4b0865a354ca183997557841cbc49"
 from {username='slave'} at 127.0.0.1:39302
I20260709 13:10:44.814096 25124 raft_consensus.cc:606] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Received request to transfer leadership to TS 82d4b0865a354ca183997557841cbc49
I20260709 13:10:44.815053 15384 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:44.905987 25273 raft_consensus.cc:1275] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Refusing update from remote peer e56160cfd54847bc93735e50a85b2f92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.907146 25342 consensus_queue.cc:1048] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.915046 25198 raft_consensus.cc:1275] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Refusing update from remote peer e56160cfd54847bc93735e50a85b2f92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.916706 25371 consensus_queue.cc:1048] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.935299 25273 raft_consensus.cc:1275] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Refusing update from remote peer e56160cfd54847bc93735e50a85b2f92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.936432 25367 consensus_queue.cc:1048] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.943140 25198 raft_consensus.cc:1275] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Refusing update from remote peer e56160cfd54847bc93735e50a85b2f92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.944548 25371 consensus_queue.cc:1048] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.954691 25198 raft_consensus.cc:1275] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Refusing update from remote peer e56160cfd54847bc93735e50a85b2f92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.955760 25371 consensus_queue.cc:1048] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.960139 25367 raft_consensus.cc:993] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92: : Instructing follower 82d4b0865a354ca183997557841cbc49 to start an election
I20260709 13:10:44.960644 25367 raft_consensus.cc:1081] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Signalling peer 82d4b0865a354ca183997557841cbc49 to start an election
I20260709 13:10:44.962280 25197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca"
dest_uuid: "82d4b0865a354ca183997557841cbc49"
 from {username='slave'} at 127.0.0.1:54372
I20260709 13:10:44.962802 25197 raft_consensus.cc:493] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.963315 25197 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.963577 25273 raft_consensus.cc:1275] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Refusing update from remote peer e56160cfd54847bc93735e50a85b2f92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.965109 25367 consensus_queue.cc:1048] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.969870 25197 raft_consensus.cc:515] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.970709 25198 raft_consensus.cc:1240] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 FOLLOWER]: Rejecting Update request from peer e56160cfd54847bc93735e50a85b2f92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:44.971829 25197 leader_election.cc:290] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [CANDIDATE]: Term 3 election: Requested vote from peers e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547), 68f5c730ad164b4eaddccedadf445e32 (127.15.6.3:39959)
I20260709 13:10:44.972510 25124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "82d4b0865a354ca183997557841cbc49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e56160cfd54847bc93735e50a85b2f92"
I20260709 13:10:44.973858 25124 raft_consensus.cc:3055] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:44.974220 25124 raft_consensus.cc:740] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e56160cfd54847bc93735e50a85b2f92, State: Running, Role: LEADER
I20260709 13:10:44.972855 25273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a2f1e7842b46db90d8319a983abaca" candidate_uuid: "82d4b0865a354ca183997557841cbc49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f5c730ad164b4eaddccedadf445e32"
I20260709 13:10:44.974350 25367 consensus_queue.cc:1059] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.975087 25273 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.975751 25124 consensus_queue.cc:260] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.976950 25124 raft_consensus.cc:3060] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.981185 25273 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d4b0865a354ca183997557841cbc49 in term 3.
I20260709 13:10:44.982306 25165 leader_election.cc:304] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f5c730ad164b4eaddccedadf445e32, 82d4b0865a354ca183997557841cbc49; no voters: 
I20260709 13:10:44.983083 25355 raft_consensus.cc:2804] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:44.983574 25124 raft_consensus.cc:2468] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d4b0865a354ca183997557841cbc49 in term 3.
I20260709 13:10:44.984017 25355 raft_consensus.cc:697] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 LEADER]: Becoming Leader. State: Replica: 82d4b0865a354ca183997557841cbc49, State: Running, Role: LEADER
W20260709 13:10:44.984688 25367 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:44.985072 25355 consensus_queue.cc:237] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } }
I20260709 13:10:44.990973 25022 catalog_manager.cc:5697] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 reported cstate change: term changed from 2 to 3, leader changed from e56160cfd54847bc93735e50a85b2f92 (127.15.6.1) to 82d4b0865a354ca183997557841cbc49 (127.15.6.2). New cstate: current_term: 3 leader_uuid: "82d4b0865a354ca183997557841cbc49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e56160cfd54847bc93735e50a85b2f92" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 41547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d4b0865a354ca183997557841cbc49" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 45827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f5c730ad164b4eaddccedadf445e32" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 39959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.008311 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
I20260709 13:10:45.023679 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:45.024279 15384 tablet_replica.cc:333] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92: stopping tablet replica
I20260709 13:10:45.024776 15384 raft_consensus.cc:2243] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.025525 15384 raft_consensus.cc:2272] T 7046c004a9d24c328b5fe301a67fc3b1 P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.027560 15384 tablet_replica.cc:333] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92: stopping tablet replica
I20260709 13:10:45.028081 15384 raft_consensus.cc:2243] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.028463 15384 raft_consensus.cc:2272] T 74a2f1e7842b46db90d8319a983abaca P e56160cfd54847bc93735e50a85b2f92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.030373 15384 tablet_replica.cc:333] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92: stopping tablet replica
I20260709 13:10:45.030822 15384 raft_consensus.cc:2243] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.031514 15384 raft_consensus.cc:2272] T cc3dd576308143d89119b89209900942 P e56160cfd54847bc93735e50a85b2f92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.033516 15384 tablet_replica.cc:333] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92: stopping tablet replica
I20260709 13:10:45.033941 15384 raft_consensus.cc:2243] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.034301 15384 raft_consensus.cc:2272] T edc8d191c0bf45bdb9f523f72ce97666 P e56160cfd54847bc93735e50a85b2f92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.055502 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
I20260709 13:10:45.066654 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
I20260709 13:10:45.080718 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:45.081241 15384 tablet_replica.cc:333] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49: stopping tablet replica
I20260709 13:10:45.081754 15384 raft_consensus.cc:2243] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.082237 15384 raft_consensus.cc:2272] T 7046c004a9d24c328b5fe301a67fc3b1 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.084278 15384 tablet_replica.cc:333] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49: stopping tablet replica
I20260709 13:10:45.084733 15384 raft_consensus.cc:2243] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.085085 15384 raft_consensus.cc:2272] T edc8d191c0bf45bdb9f523f72ce97666 P 82d4b0865a354ca183997557841cbc49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.087289 15384 tablet_replica.cc:333] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: stopping tablet replica
I20260709 13:10:45.087715 15384 raft_consensus.cc:2243] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.088284 15384 pending_rounds.cc:70] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: Trying to abort 2 pending ops.
I20260709 13:10:45.088444 15384 pending_rounds.cc:77] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636433866641408 op_type: NO_OP noop_request { }
I20260709 13:10:45.088688 15384 raft_consensus.cc:2889] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:45.088873 15384 pending_rounds.cc:77] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636432017440768 op_type: NO_OP noop_request { }
I20260709 13:10:45.089052 15384 raft_consensus.cc:2889] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:45.089249 15384 raft_consensus.cc:2272] T 74a2f1e7842b46db90d8319a983abaca P 82d4b0865a354ca183997557841cbc49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.091238 15384 tablet_replica.cc:333] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49: stopping tablet replica
I20260709 13:10:45.091647 15384 raft_consensus.cc:2243] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.092052 15384 raft_consensus.cc:2272] T cc3dd576308143d89119b89209900942 P 82d4b0865a354ca183997557841cbc49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.113010 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
W20260709 13:10:45.123203 25237 consensus_peers.cc:597] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 -> Peer e56160cfd54847bc93735e50a85b2f92 (127.15.6.1:41547): Couldn't send request to peer e56160cfd54847bc93735e50a85b2f92. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:41547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.124058 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
I20260709 13:10:45.139124 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:45.139716 15384 tablet_replica.cc:333] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32: stopping tablet replica
I20260709 13:10:45.140285 15384 raft_consensus.cc:2243] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.140704 15384 raft_consensus.cc:2272] T 7046c004a9d24c328b5fe301a67fc3b1 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.142864 15384 tablet_replica.cc:333] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32: stopping tablet replica
I20260709 13:10:45.143347 15384 raft_consensus.cc:2243] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.143739 15384 raft_consensus.cc:2272] T 74a2f1e7842b46db90d8319a983abaca P 68f5c730ad164b4eaddccedadf445e32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.145745 15384 tablet_replica.cc:333] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32: stopping tablet replica
I20260709 13:10:45.146219 15384 raft_consensus.cc:2243] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.146596 15384 raft_consensus.cc:2272] T cc3dd576308143d89119b89209900942 P 68f5c730ad164b4eaddccedadf445e32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.148636 15384 tablet_replica.cc:333] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32: stopping tablet replica
I20260709 13:10:45.149061 15384 raft_consensus.cc:2243] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.149756 15384 raft_consensus.cc:2272] T edc8d191c0bf45bdb9f523f72ce97666 P 68f5c730ad164b4eaddccedadf445e32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.199195 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
I20260709 13:10:45.221175 15384 master.cc:562] Master@127.15.6.62:34217 shutting down...
I20260709 13:10:45.240542 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:45.241379 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.241710 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P 58e6c5ea7d304779bc64d4607490cbcf: stopping tablet replica
I20260709 13:10:45.261251 15384 master.cc:584] Master@127.15.6.62:34217 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2842 ms)
[----------] 6 tests from LeaderRebalancerTest (307394 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:45.303126 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:40893
I20260709 13:10:45.304183 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:45.309247 25380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:45.309376 25381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:45.312165 25383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:45.317150 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:45.324362 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:45.324549 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:45.324692 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602645324674 us; error 0 us; skew 500 ppm
I20260709 13:10:45.325213 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:45.327448 15384 webserver.cc:533] Webserver started at http://127.15.6.62:37375/ using document root <none> and password file <none>
I20260709 13:10:45.327957 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:45.328132 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:45.328378 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:45.329535 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "033577ac72e64d96b07e88f08d512708"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.333709 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:45.336781 25388 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.337411 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:45.337651 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "033577ac72e64d96b07e88f08d512708"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.337905 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:45.356624 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:45.357758 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:45.393922 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:40893
I20260709 13:10:45.394042 25439 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:40893 every 8 connection(s)
I20260709 13:10:45.397758 25440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.409983 25440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708: Bootstrap starting.
I20260709 13:10:45.414567 25440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:45.418413 25440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708: No bootstrap required, opened a new log
I20260709 13:10:45.421128 25440 raft_consensus.cc:359] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033577ac72e64d96b07e88f08d512708" member_type: VOTER }
I20260709 13:10:45.421665 25440 raft_consensus.cc:385] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:45.421919 25440 raft_consensus.cc:740] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033577ac72e64d96b07e88f08d512708, State: Initialized, Role: FOLLOWER
I20260709 13:10:45.422611 25440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033577ac72e64d96b07e88f08d512708" member_type: VOTER }
I20260709 13:10:45.423195 25440 raft_consensus.cc:399] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:45.423481 25440 raft_consensus.cc:493] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:45.423848 25440 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:45.428234 25440 raft_consensus.cc:515] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033577ac72e64d96b07e88f08d512708" member_type: VOTER }
I20260709 13:10:45.428697 25440 leader_election.cc:304] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 033577ac72e64d96b07e88f08d512708; no voters: 
I20260709 13:10:45.429718 25440 leader_election.cc:290] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:45.429983 25443 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:45.431257 25443 raft_consensus.cc:697] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 1 LEADER]: Becoming Leader. State: Replica: 033577ac72e64d96b07e88f08d512708, State: Running, Role: LEADER
I20260709 13:10:45.431887 25443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033577ac72e64d96b07e88f08d512708" member_type: VOTER }
I20260709 13:10:45.432420 25440 sys_catalog.cc:565] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:45.437426 25444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "033577ac72e64d96b07e88f08d512708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033577ac72e64d96b07e88f08d512708" member_type: VOTER } }
I20260709 13:10:45.438014 25444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:45.439128 25445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 033577ac72e64d96b07e88f08d512708. Latest consensus state: current_term: 1 leader_uuid: "033577ac72e64d96b07e88f08d512708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033577ac72e64d96b07e88f08d512708" member_type: VOTER } }
I20260709 13:10:45.439734 25445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:45.439782 25451 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:45.445748 25451 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:45.446729 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:45.453926 25451 catalog_manager.cc:1383] Generated new cluster ID: dda7bc0c21fb46b6b2ca72b4b3916833
I20260709 13:10:45.454145 25451 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:45.476729 25451 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:45.477936 25451 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:45.490952 25451 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708: Generated new TSK 0
I20260709 13:10:45.491420 25451 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:45.512850 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:45.518457 25461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:45.519537 25462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:45.520740 15384 server_base.cc:1061] running on GCE node
W20260709 13:10:45.521134 25464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:45.521962 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:45.522141 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:45.522295 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602645522277 us; error 0 us; skew 500 ppm
I20260709 13:10:45.522817 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:45.524844 15384 webserver.cc:533] Webserver started at http://127.15.6.1:35935/ using document root <none> and password file <none>
I20260709 13:10:45.525272 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:45.525435 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:45.525657 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:45.526795 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "5a73c63415df44d288d7637181fd9453"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.530889 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:45.533890 25469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.534551 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:45.534808 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "5a73c63415df44d288d7637181fd9453"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.535053 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:45.550297 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:45.551352 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:45.552696 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:45.554812 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:45.554996 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.555200 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:45.555359 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.592657 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:34445
I20260709 13:10:45.592772 25531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:34445 every 8 connection(s)
I20260709 13:10:45.597500 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:45.604209 25536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:45.605377 25537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:45.609755 25539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:45.610239 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:45.610821 25532 heartbeater.cc:344] Connected to a master server at 127.15.6.62:40893
I20260709 13:10:45.611176 25532 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:45.611943 25532 heartbeater.cc:507] Master 127.15.6.62:40893 requested a full tablet report, sending...
I20260709 13:10:45.611949 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:45.612305 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:45.612457 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602645612439 us; error 0 us; skew 500 ppm
I20260709 13:10:45.613072 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:45.614086 25405 ts_manager.cc:194] Registered new tserver with Master: 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445)
I20260709 13:10:45.615581 15384 webserver.cc:533] Webserver started at http://127.15.6.2:36149/ using document root <none> and password file <none>
I20260709 13:10:45.616285 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:45.616497 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:45.616802 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:45.616743 25405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38058
I20260709 13:10:45.618446 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.622597 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:45.625690 25544 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.626384 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:45.626636 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.626892 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:45.647465 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:45.648573 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:45.649916 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:45.652037 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:45.652228 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.652436 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:45.652580 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.690114 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:38661
I20260709 13:10:45.690243 25606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:38661 every 8 connection(s)
I20260709 13:10:45.694916 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:45.702242 25610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:45.703146 25611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:45.705806 25607 heartbeater.cc:344] Connected to a master server at 127.15.6.62:40893
I20260709 13:10:45.706194 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:45.706278 25607 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:45.706683 25613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:45.707473 25607 heartbeater.cc:507] Master 127.15.6.62:40893 requested a full tablet report, sending...
I20260709 13:10:45.707609 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:45.707952 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:45.708105 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602645708091 us; error 0 us; skew 500 ppm
I20260709 13:10:45.708833 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:45.709565 25405 ts_manager.cc:194] Registered new tserver with Master: 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:45.711355 15384 webserver.cc:533] Webserver started at http://127.15.6.3:34627/ using document root <none> and password file <none>
I20260709 13:10:45.711476 25405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38072
I20260709 13:10:45.712067 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:45.712329 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:45.712627 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:45.713845 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "780fb48ea3e1431d9e16af33af84f302"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.718004 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:45.721098 25618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.721817 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:45.722069 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "780fb48ea3e1431d9e16af33af84f302"
format_stamp: "Formatted at 2026-07-09 13:10:45 on dist-test-slave-pqzm"
I20260709 13:10:45.722323 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:45.750417 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:45.751583 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:45.753042 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:45.755223 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:45.755410 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.755635 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:45.755785 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:45.795101 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:34193
I20260709 13:10:45.795217 25680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:34193 every 8 connection(s)
I20260709 13:10:45.812752 25681 heartbeater.cc:344] Connected to a master server at 127.15.6.62:40893
I20260709 13:10:45.813122 25681 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:45.813830 25681 heartbeater.cc:507] Master 127.15.6.62:40893 requested a full tablet report, sending...
I20260709 13:10:45.815553 25405 ts_manager.cc:194] Registered new tserver with Master: 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:45.815749 15384 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017734737s
I20260709 13:10:45.816879 25405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38080
I20260709 13:10:45.839620 25405 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38084:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:45.842442 25405 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:45.907462 25572 tablet_service.cc:1511] Processing CreateTablet for tablet 60cd0401c21747449dd137981ede25bd (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:45.909039 25572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60cd0401c21747449dd137981ede25bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.909853 25570 tablet_service.cc:1511] Processing CreateTablet for tablet 94dba1d9c0384998b9239239f9cda908 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:45.910470 25646 tablet_service.cc:1511] Processing CreateTablet for tablet 60cd0401c21747449dd137981ede25bd (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:45.911311 25570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dba1d9c0384998b9239239f9cda908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.911761 25646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60cd0401c21747449dd137981ede25bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.915593 25571 tablet_service.cc:1511] Processing CreateTablet for tablet da3d747c93c74d11afd520b5cbb00f09 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:45.916917 25645 tablet_service.cc:1511] Processing CreateTablet for tablet da3d747c93c74d11afd520b5cbb00f09 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:45.917471 25569 tablet_service.cc:1511] Processing CreateTablet for tablet b409484eb99141c18c2cf53452f51367 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:45.918256 25645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3d747c93c74d11afd520b5cbb00f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.920920 25644 tablet_service.cc:1511] Processing CreateTablet for tablet 94dba1d9c0384998b9239239f9cda908 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:45.922253 25644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dba1d9c0384998b9239239f9cda908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.916936 25571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3d747c93c74d11afd520b5cbb00f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.926896 25497 tablet_service.cc:1511] Processing CreateTablet for tablet 60cd0401c21747449dd137981ede25bd (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:45.928251 25497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60cd0401c21747449dd137981ede25bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.932963 25495 tablet_service.cc:1511] Processing CreateTablet for tablet 94dba1d9c0384998b9239239f9cda908 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:45.934418 25495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dba1d9c0384998b9239239f9cda908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.937026 25494 tablet_service.cc:1511] Processing CreateTablet for tablet b409484eb99141c18c2cf53452f51367 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:45.938396 25494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b409484eb99141c18c2cf53452f51367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.939704 25569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b409484eb99141c18c2cf53452f51367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.942446 25496 tablet_service.cc:1511] Processing CreateTablet for tablet da3d747c93c74d11afd520b5cbb00f09 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:45.943696 25496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3d747c93c74d11afd520b5cbb00f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.944077 25643 tablet_service.cc:1511] Processing CreateTablet for tablet b409484eb99141c18c2cf53452f51367 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:45.945309 25643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b409484eb99141c18c2cf53452f51367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.949771 25493 tablet_service.cc:1511] Processing CreateTablet for tablet c2976a399b1541ebaf14c16305465752 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:45.951028 25493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2976a399b1541ebaf14c16305465752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.952951 25642 tablet_service.cc:1511] Processing CreateTablet for tablet c2976a399b1541ebaf14c16305465752 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:45.954255 25642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2976a399b1541ebaf14c16305465752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.956948 25492 tablet_service.cc:1511] Processing CreateTablet for tablet cf143ba7d8ba4b9980f471980b1901b1 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:45.958226 25492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf143ba7d8ba4b9980f471980b1901b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.960914 25491 tablet_service.cc:1511] Processing CreateTablet for tablet 20f5d95edbaf47d89bca383608303eb0 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:45.962167 25491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f5d95edbaf47d89bca383608303eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.964900 25490 tablet_service.cc:1511] Processing CreateTablet for tablet 71ce9cbd4c7b495d8c571b0ac6c9a0bf (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:45.966142 25490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ce9cbd4c7b495d8c571b0ac6c9a0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.968905 25489 tablet_service.cc:1511] Processing CreateTablet for tablet 66dd4c1aca514e0fabd5e62af1a77f09 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:45.970095 25489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66dd4c1aca514e0fabd5e62af1a77f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.975428 25566 tablet_service.cc:1511] Processing CreateTablet for tablet 71ce9cbd4c7b495d8c571b0ac6c9a0bf (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:45.976758 25566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ce9cbd4c7b495d8c571b0ac6c9a0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.977316 25567 tablet_service.cc:1511] Processing CreateTablet for tablet 20f5d95edbaf47d89bca383608303eb0 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:45.978689 25567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f5d95edbaf47d89bca383608303eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.980927 25565 tablet_service.cc:1511] Processing CreateTablet for tablet 66dd4c1aca514e0fabd5e62af1a77f09 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:45.982102 25565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66dd4c1aca514e0fabd5e62af1a77f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.983850 25641 tablet_service.cc:1511] Processing CreateTablet for tablet cf143ba7d8ba4b9980f471980b1901b1 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:45.985286 25641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf143ba7d8ba4b9980f471980b1901b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.989023 25640 tablet_service.cc:1511] Processing CreateTablet for tablet 20f5d95edbaf47d89bca383608303eb0 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:45.990383 25640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f5d95edbaf47d89bca383608303eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.993014 25639 tablet_service.cc:1511] Processing CreateTablet for tablet 71ce9cbd4c7b495d8c571b0ac6c9a0bf (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:45.994396 25639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ce9cbd4c7b495d8c571b0ac6c9a0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.997031 25638 tablet_service.cc:1511] Processing CreateTablet for tablet 66dd4c1aca514e0fabd5e62af1a77f09 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:45.998411 25638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66dd4c1aca514e0fabd5e62af1a77f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.001030 25570 tablet_service.cc:1511] Processing CreateTablet for tablet c2976a399b1541ebaf14c16305465752 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:45.975857 25568 tablet_service.cc:1511] Processing CreateTablet for tablet cf143ba7d8ba4b9980f471980b1901b1 (DEFAULT_TABLE table=test-workload [id=99bd0a66df154410a25293cebe8455bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:46.039909 25570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2976a399b1541ebaf14c16305465752. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:46.085289 25391 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.6.2:38661, user_credentials={real_user=slave}} blocked reactor thread for 64920.5us
I20260709 13:10:46.086763 25568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf143ba7d8ba4b9980f471980b1901b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.086970 25698 tablet_bootstrap.cc:492] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.089316 25696 tablet_bootstrap.cc:492] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.093182 25698 tablet_bootstrap.cc:654] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.095431 25696 tablet_bootstrap.cc:654] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.085579 25697 tablet_bootstrap.cc:492] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.102005 25697 tablet_bootstrap.cc:654] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.123883 25697 tablet_bootstrap.cc:492] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.124598 25697 ts_tablet_manager.cc:1403] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.010s
I20260709 13:10:46.127377 25697 raft_consensus.cc:359] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.123894 25698 tablet_bootstrap.cc:492] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.128367 25698 ts_tablet_manager.cc:1403] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.017s
I20260709 13:10:46.131122 25698 raft_consensus.cc:359] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.131783 25698 raft_consensus.cc:385] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.132396 25698 raft_consensus.cc:740] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.132114 25697 raft_consensus.cc:385] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.133195 25697 raft_consensus.cc:740] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.133996 25697 consensus_queue.cc:260] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.134877 25698 consensus_queue.cc:260] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.140013 25697 ts_tablet_manager.cc:1434] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:10:46.140239 25532 heartbeater.cc:499] Master 127.15.6.62:40893 was elected leader, sending a full tablet report...
I20260709 13:10:46.141053 25697 tablet_bootstrap.cc:492] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.143102 25698 ts_tablet_manager.cc:1434] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:10:46.149508 25697 tablet_bootstrap.cc:654] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.151558 25681 heartbeater.cc:499] Master 127.15.6.62:40893 was elected leader, sending a full tablet report...
I20260709 13:10:46.152557 25698 tablet_bootstrap.cc:492] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.159389 25698 tablet_bootstrap.cc:654] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.171232 25696 tablet_bootstrap.cc:492] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.171805 25696 ts_tablet_manager.cc:1403] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.022s
I20260709 13:10:46.171829 25697 tablet_bootstrap.cc:492] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.172171 25698 tablet_bootstrap.cc:492] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.172545 25697 ts_tablet_manager.cc:1403] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:10:46.172746 25698 ts_tablet_manager.cc:1403] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:10:46.174880 25696 raft_consensus.cc:359] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.175680 25696 raft_consensus.cc:385] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.175616 25697 raft_consensus.cc:359] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.175897 25698 raft_consensus.cc:359] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.176337 25696 raft_consensus.cc:740] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.176574 25697 raft_consensus.cc:385] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.176749 25698 raft_consensus.cc:385] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.176985 25697 raft_consensus.cc:740] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.177145 25698 raft_consensus.cc:740] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.177507 25696 consensus_queue.cc:260] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.177925 25697 consensus_queue.cc:260] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.178108 25698 consensus_queue.cc:260] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.180147 25697 ts_tablet_manager.cc:1434] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:46.180424 25698 ts_tablet_manager.cc:1434] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:10:46.181087 25697 tablet_bootstrap.cc:492] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.181510 25698 tablet_bootstrap.cc:492] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.187027 25696 ts_tablet_manager.cc:1434] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:10:46.187474 25697 tablet_bootstrap.cc:654] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.187819 25607 heartbeater.cc:499] Master 127.15.6.62:40893 was elected leader, sending a full tablet report...
I20260709 13:10:46.188470 25698 tablet_bootstrap.cc:654] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.199283 25697 tablet_bootstrap.cc:492] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.199656 25697 ts_tablet_manager.cc:1403] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:10:46.201105 25696 tablet_bootstrap.cc:492] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.202015 25697 raft_consensus.cc:359] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.202560 25697 raft_consensus.cc:385] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.202780 25697 raft_consensus.cc:740] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.203397 25697 consensus_queue.cc:260] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.205343 25697 ts_tablet_manager.cc:1434] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:10:46.206272 25697 tablet_bootstrap.cc:492] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.212051 25697 tablet_bootstrap.cc:654] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.213843 25703 raft_consensus.cc:493] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.214411 25703 raft_consensus.cc:515] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.222134 25697 tablet_bootstrap.cc:492] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.222653 25697 ts_tablet_manager.cc:1403] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.012s
I20260709 13:10:46.225397 25697 raft_consensus.cc:359] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.226058 25697 raft_consensus.cc:385] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.226373 25697 raft_consensus.cc:740] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.227223 25697 consensus_queue.cc:260] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.228101 25703 leader_election.cc:290] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.231015 25697 ts_tablet_manager.cc:1434] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:46.232004 25697 tablet_bootstrap.cc:492] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.232434 25696 tablet_bootstrap.cc:654] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.232786 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dba1d9c0384998b9239239f9cda908" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
W20260709 13:10:46.235944 25620 leader_election.cc:343] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.238091 25697 tablet_bootstrap.cc:654] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.239161 25698 tablet_bootstrap.cc:492] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.239719 25698 ts_tablet_manager.cc:1403] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.058s	user 0.032s	sys 0.020s
I20260709 13:10:46.242931 25698 raft_consensus.cc:359] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.243559 25698 raft_consensus.cc:385] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.243870 25698 raft_consensus.cc:740] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.244663 25698 consensus_queue.cc:260] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.245968 25697 tablet_bootstrap.cc:492] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.246474 25697 ts_tablet_manager.cc:1403] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:10:46.246773 25698 ts_tablet_manager.cc:1434] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:10:46.248014 25702 raft_consensus.cc:493] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.248492 25702 raft_consensus.cc:515] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.249290 25697 raft_consensus.cc:359] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.249974 25697 raft_consensus.cc:385] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.250231 25697 raft_consensus.cc:740] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.250877 25697 consensus_queue.cc:260] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.251847 25698 tablet_bootstrap.cc:492] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.259239 25702 leader_election.cc:290] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.260308 25697 ts_tablet_manager.cc:1434] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 13:10:46.265617 25697 tablet_bootstrap.cc:492] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.260991 25698 tablet_bootstrap.cc:654] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.263001 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dba1d9c0384998b9239239f9cda908" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
W20260709 13:10:46.269099 25621 leader_election.cc:343] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.269623 25621 leader_election.cc:304] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 780fb48ea3e1431d9e16af33af84f302; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453
I20260709 13:10:46.270466 25703 raft_consensus.cc:2749] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.275678 25698 tablet_bootstrap.cc:492] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.276239 25698 ts_tablet_manager.cc:1403] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.003s
I20260709 13:10:46.279253 25698 raft_consensus.cc:359] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.280011 25698 raft_consensus.cc:385] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.280334 25698 raft_consensus.cc:740] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.281127 25696 tablet_bootstrap.cc:492] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.281075 25698 consensus_queue.cc:260] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.281754 25696 ts_tablet_manager.cc:1403] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.019s
I20260709 13:10:46.281754 25697 tablet_bootstrap.cc:654] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.284801 25696 raft_consensus.cc:359] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.288403 25696 raft_consensus.cc:385] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.288792 25696 raft_consensus.cc:740] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.289636 25696 consensus_queue.cc:260] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.291906 25696 ts_tablet_manager.cc:1434] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:46.287989 25698 ts_tablet_manager.cc:1434] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:46.294355 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.294809 25698 tablet_bootstrap.cc:492] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
W20260709 13:10:46.295928 25472 leader_election.cc:343] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.296248 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
W20260709 13:10:46.297827 25473 leader_election.cc:343] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.298251 25473 leader_election.cc:304] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a73c63415df44d288d7637181fd9453; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:46.301147 25702 raft_consensus.cc:2749] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.301427 25698 tablet_bootstrap.cc:654] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.304473 25696 tablet_bootstrap.cc:492] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.309703 25696 tablet_bootstrap.cc:654] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.311391 25698 tablet_bootstrap.cc:492] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.311412 25697 tablet_bootstrap.cc:492] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.312039 25698 ts_tablet_manager.cc:1403] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:10:46.312115 25697 ts_tablet_manager.cc:1403] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.006s
I20260709 13:10:46.314953 25696 tablet_bootstrap.cc:492] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.315553 25696 ts_tablet_manager.cc:1403] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.002s
I20260709 13:10:46.315032 25698 raft_consensus.cc:359] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.316022 25698 raft_consensus.cc:385] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.316330 25698 raft_consensus.cc:740] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.317036 25698 consensus_queue.cc:260] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.318445 25696 raft_consensus.cc:359] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.319161 25696 raft_consensus.cc:385] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.319270 25698 ts_tablet_manager.cc:1434] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:46.315089 25697 raft_consensus.cc:359] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.319536 25696 raft_consensus.cc:740] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.319810 25697 raft_consensus.cc:385] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.320199 25697 raft_consensus.cc:740] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.320431 25698 tablet_bootstrap.cc:492] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.320662 25696 consensus_queue.cc:260] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.321060 25697 consensus_queue.cc:260] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.325408 25697 ts_tablet_manager.cc:1434] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:10:46.326406 25697 tablet_bootstrap.cc:492] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.327438 25696 ts_tablet_manager.cc:1434] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:10:46.332034 25698 tablet_bootstrap.cc:654] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.332428 25703 raft_consensus.cc:493] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.333647 25703 raft_consensus.cc:515] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.335130 25697 tablet_bootstrap.cc:654] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.335762 25703 leader_election.cc:290] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.337044 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.332747 25696 tablet_bootstrap.cc:492] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.338501 25507 raft_consensus.cc:2468] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.337996 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.339783 25620 leader_election.cc:304] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
W20260709 13:10:46.340533 25621 leader_election.cc:343] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.341480 25703 raft_consensus.cc:2804] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.341893 25703 raft_consensus.cc:493] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.342178 25703 raft_consensus.cc:3060] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.343448 25697 tablet_bootstrap.cc:492] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.343930 25697 ts_tablet_manager.cc:1403] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.006s
I20260709 13:10:46.344715 25696 tablet_bootstrap.cc:654] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.346427 25723 raft_consensus.cc:493] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.346971 25723 raft_consensus.cc:515] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.349716 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60cd0401c21747449dd137981ede25bd" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.349545 25697 raft_consensus.cc:359] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.350363 25697 raft_consensus.cc:385] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.350121 25703 raft_consensus.cc:515] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.350874 25697 raft_consensus.cc:740] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.350396 25582 raft_consensus.cc:2468] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.352324 25621 leader_election.cc:304] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.352419 25697 consensus_queue.cc:260] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.353609 25698 tablet_bootstrap.cc:492] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.354154 25698 ts_tablet_manager.cc:1403] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:10:46.355085 25697 ts_tablet_manager.cc:1434] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:10:46.356014 25696 tablet_bootstrap.cc:492] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.356132 25697 tablet_bootstrap.cc:492] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.356613 25696 ts_tablet_manager.cc:1403] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 13:10:46.357344 25698 raft_consensus.cc:359] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.358107 25698 raft_consensus.cc:385] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.358461 25698 raft_consensus.cc:740] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.359380 25698 consensus_queue.cc:260] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.359557 25696 raft_consensus.cc:359] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.360442 25696 raft_consensus.cc:385] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.360800 25696 raft_consensus.cc:740] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.361716 25696 consensus_queue.cc:260] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.362739 25697 tablet_bootstrap.cc:654] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.370496 25696 ts_tablet_manager.cc:1434] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:10:46.372486 25696 tablet_bootstrap.cc:492] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.373327 25703 leader_election.cc:290] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.373961 25703 raft_consensus.cc:2804] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.374330 25703 raft_consensus.cc:493] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.374691 25697 tablet_bootstrap.cc:492] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.374701 25703 raft_consensus.cc:3060] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.375275 25697 ts_tablet_manager.cc:1403] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.013s
I20260709 13:10:46.378137 25696 tablet_bootstrap.cc:654] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.377926 25697 raft_consensus.cc:359] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.378595 25697 raft_consensus.cc:385] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.378867 25697 raft_consensus.cc:740] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.382021 25703 raft_consensus.cc:515] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.379539 25697 consensus_queue.cc:260] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.382848 25696 tablet_bootstrap.cc:492] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.383668 25696 ts_tablet_manager.cc:1403] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:10:46.384198 25697 ts_tablet_manager.cc:1434] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:46.385952 25696 raft_consensus.cc:359] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.386574 25696 raft_consensus.cc:385] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.386889 25696 raft_consensus.cc:740] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.386401 25723 leader_election.cc:290] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445)
I20260709 13:10:46.387758 25696 consensus_queue.cc:260] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.388473 25697 tablet_bootstrap.cc:492] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:46.388801 25506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.389410 25506 raft_consensus.cc:3060] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.389964 25696 ts_tablet_manager.cc:1434] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:10:46.388073 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60cd0401c21747449dd137981ede25bd" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.390913 25696 tablet_bootstrap.cc:492] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.391131 25507 raft_consensus.cc:2468] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.394495 25703 leader_election.cc:290] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445)
I20260709 13:10:46.396689 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60cd0401c21747449dd137981ede25bd" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.396932 25697 tablet_bootstrap.cc:654] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.396963 25696 tablet_bootstrap.cc:654] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.390831 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.398311 25506 raft_consensus.cc:2468] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
W20260709 13:10:46.398747 25621 leader_election.cc:343] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.400279 25620 leader_election.cc:304] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:46.401643 25726 raft_consensus.cc:2804] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.402412 25726 raft_consensus.cc:697] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:46.397346 25581 raft_consensus.cc:3060] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.403885 25726 consensus_queue.cc:237] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.406919 25696 tablet_bootstrap.cc:492] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.407472 25696 ts_tablet_manager.cc:1403] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:10:46.409173 25506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60cd0401c21747449dd137981ede25bd" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.411437 25506 raft_consensus.cc:3060] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.410351 25696 raft_consensus.cc:359] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.412148 25696 raft_consensus.cc:385] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.412477 25696 raft_consensus.cc:740] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.413298 25697 tablet_bootstrap.cc:492] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:46.413224 25696 consensus_queue.cc:260] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.413846 25697 ts_tablet_manager.cc:1403] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:10:46.417825 25506 raft_consensus.cc:2468] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.410919 25698 ts_tablet_manager.cc:1434] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.056s	user 0.015s	sys 0.006s
I20260709 13:10:46.418232 25581 raft_consensus.cc:2468] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.419277 25698 tablet_bootstrap.cc:492] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.419361 25621 leader_election.cc:304] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.420217 25703 raft_consensus.cc:2804] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.420701 25703 raft_consensus.cc:697] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:46.421644 25696 ts_tablet_manager.cc:1434] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:10:46.421497 25703 consensus_queue.cc:237] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.422538 25696 tablet_bootstrap.cc:492] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.424067 25697 raft_consensus.cc:359] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.424801 25697 raft_consensus.cc:385] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.425101 25697 raft_consensus.cc:740] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.425765 25697 consensus_queue.cc:260] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.427978 25697 ts_tablet_manager.cc:1434] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:46.429052 25696 tablet_bootstrap.cc:654] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.433144 25402 catalog_manager.cc:5697] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.430817 25698 tablet_bootstrap.cc:654] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:46.442308 25453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:46.443070 25703 raft_consensus.cc:493] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.443718 25703 raft_consensus.cc:515] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.446630 25506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b409484eb99141c18c2cf53452f51367" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.447361 25506 raft_consensus.cc:2468] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.442430 25698 tablet_bootstrap.cc:492] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.448480 25620 leader_election.cc:304] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.449163 25698 ts_tablet_manager.cc:1403] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:10:46.449469 25723 raft_consensus.cc:2804] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.450021 25723 raft_consensus.cc:493] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.450363 25723 raft_consensus.cc:3060] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.448391 25703 leader_election.cc:290] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.449446 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b409484eb99141c18c2cf53452f51367" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.452597 25581 raft_consensus.cc:2468] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.456580 25698 raft_consensus.cc:359] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.457229 25698 raft_consensus.cc:385] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.457540 25698 raft_consensus.cc:740] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.458024 25723 raft_consensus.cc:515] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.458379 25698 consensus_queue.cc:260] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.460737 25698 ts_tablet_manager.cc:1434] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:46.461030 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b409484eb99141c18c2cf53452f51367" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.462203 25696 tablet_bootstrap.cc:492] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.462324 25581 raft_consensus.cc:3060] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.462720 25696 ts_tablet_manager.cc:1403] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.009s
I20260709 13:10:46.461011 25506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b409484eb99141c18c2cf53452f51367" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.464126 25506 raft_consensus.cc:3060] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.465378 25696 raft_consensus.cc:359] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.466100 25696 raft_consensus.cc:385] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.466382 25696 raft_consensus.cc:740] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.467252 25696 consensus_queue.cc:260] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.468937 25581 raft_consensus.cc:2468] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.469066 25402 catalog_manager.cc:5697] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.470121 25621 leader_election.cc:304] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.471153 25506 raft_consensus.cc:2468] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.471750 25703 raft_consensus.cc:2804] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.472247 25703 raft_consensus.cc:697] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:46.473295 25698 tablet_bootstrap.cc:492] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.473054 25703 consensus_queue.cc:237] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.475286 25696 ts_tablet_manager.cc:1434] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:10:46.476344 25696 tablet_bootstrap.cc:492] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.480746 25698 tablet_bootstrap.cc:654] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.461786 25723 leader_election.cc:290] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.484781 25696 tablet_bootstrap.cc:654] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.487632 25698 tablet_bootstrap.cc:492] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.488049 25698 ts_tablet_manager.cc:1403] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:10:46.490125 25696 tablet_bootstrap.cc:492] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.489279 25403 catalog_manager.cc:5697] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.490051 25698 raft_consensus.cc:359] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.490661 25696 ts_tablet_manager.cc:1403] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:10:46.490670 25698 raft_consensus.cc:385] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.491158 25698 raft_consensus.cc:740] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.491708 25698 consensus_queue.cc:260] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.493417 25698 ts_tablet_manager.cc:1434] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:46.493424 25696 raft_consensus.cc:359] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.494097 25696 raft_consensus.cc:385] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.494292 25696 raft_consensus.cc:740] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.494370 25698 tablet_bootstrap.cc:492] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:46.494879 25696 consensus_queue.cc:260] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.496708 25696 ts_tablet_manager.cc:1434] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:46.497623 25696 tablet_bootstrap.cc:492] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:46.499912 25698 tablet_bootstrap.cc:654] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.503000 25696 tablet_bootstrap.cc:654] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.512121 25698 tablet_bootstrap.cc:492] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:46.512462 25698 ts_tablet_manager.cc:1403] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:10:46.513386 25696 tablet_bootstrap.cc:492] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:46.513370 25702 raft_consensus.cc:493] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.514045 25696 ts_tablet_manager.cc:1403] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:10:46.514077 25702 raft_consensus.cc:515] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.515228 25698 raft_consensus.cc:359] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.515878 25698 raft_consensus.cc:385] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.516162 25698 raft_consensus.cc:740] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.516381 25702 leader_election.cc:290] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.516865 25698 consensus_queue.cc:260] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.516975 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dba1d9c0384998b9239239f9cda908" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.517513 25706 raft_consensus.cc:493] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.517761 25581 raft_consensus.cc:2468] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:46.518107 25706 raft_consensus.cc:515] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.518906 25698 ts_tablet_manager.cc:1434] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:46.519266 25472 leader_election.cc:304] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:46.520131 25702 raft_consensus.cc:2804] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.520162 25714 raft_consensus.cc:493] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.520547 25702 raft_consensus.cc:493] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.520833 25714 raft_consensus.cc:515] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.517534 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dba1d9c0384998b9239239f9cda908" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:46.522490 25702 raft_consensus.cc:3060] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.522679 25656 raft_consensus.cc:2468] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:46.522920 25714 leader_election.cc:290] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.526479 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:46.527051 25656 raft_consensus.cc:2468] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:46.527737 25706 leader_election.cc:290] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.528170 25473 leader_election.cc:304] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.528913 25714 raft_consensus.cc:2804] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.529273 25714 raft_consensus.cc:493] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.529518 25714 raft_consensus.cc:3060] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.516325 25696 raft_consensus.cc:359] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.534497 25702 raft_consensus.cc:515] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.534535 25696 raft_consensus.cc:385] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.535499 25696 raft_consensus.cc:740] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.535513 25714 raft_consensus.cc:515] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.537452 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dba1d9c0384998b9239239f9cda908" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:46.538086 25656 raft_consensus.cc:3060] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.540117 25702 leader_election.cc:290] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.540174 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.540916 25581 raft_consensus.cc:2468] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:46.542279 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dba1d9c0384998b9239239f9cda908" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.542753 25581 raft_consensus.cc:3060] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.543303 25714 leader_election.cc:290] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.544250 25696 consensus_queue.cc:260] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.544529 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:46.545214 25655 raft_consensus.cc:3060] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.545329 25656 raft_consensus.cc:2468] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:46.546510 25473 leader_election.cc:304] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.547358 25714 raft_consensus.cc:2804] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.547858 25714 raft_consensus.cc:697] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:46.548800 25714 consensus_queue.cc:237] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.554241 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.554383 25655 raft_consensus.cc:2468] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:46.554824 25582 raft_consensus.cc:3060] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.555121 25696 ts_tablet_manager.cc:1434] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:10:46.555660 25473 leader_election.cc:304] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.558236 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:46.559033 25656 raft_consensus.cc:2393] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in current term 1: Already voted for candidate 5a73c63415df44d288d7637181fd9453 in this term.
I20260709 13:10:46.562284 25702 raft_consensus.cc:2804] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.562748 25582 raft_consensus.cc:2468] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:46.562813 25702 raft_consensus.cc:697] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:46.564569 25702 consensus_queue.cc:237] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.567451 25703 raft_consensus.cc:493] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.567945 25703 raft_consensus.cc:515] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.568212 25723 raft_consensus.cc:493] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.568513 25581 raft_consensus.cc:2468] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:46.568769 25723 raft_consensus.cc:515] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.569872 25703 leader_election.cc:290] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.570856 25723 leader_election.cc:290] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.571022 25506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66dd4c1aca514e0fabd5e62af1a77f09" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.571604 25506 raft_consensus.cc:2468] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.572508 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.572926 25506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.573150 25620 leader_election.cc:304] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.573551 25506 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.573606 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66dd4c1aca514e0fabd5e62af1a77f09" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:46.574190 25723 raft_consensus.cc:2804] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.574585 25581 raft_consensus.cc:2468] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.574695 25723 raft_consensus.cc:493] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.574846 25620 leader_election.cc:304] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.575536 25723 raft_consensus.cc:3060] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.575948 25703 raft_consensus.cc:2804] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.576311 25703 raft_consensus.cc:493] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.576689 25703 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.573159 25582 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:46.583108 25703 raft_consensus.cc:515] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.583889 25706 raft_consensus.cc:493] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.584364 25706 raft_consensus.cc:515] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.585794 25506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.586347 25506 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.586774 25706 leader_election.cc:290] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.583168 25723 raft_consensus.cc:515] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.588409 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ce9cbd4c7b495d8c571b0ac6c9a0bf" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:46.589789 25655 raft_consensus.cc:2468] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:46.590507 25723 leader_election.cc:290] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.591176 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66dd4c1aca514e0fabd5e62af1a77f09" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.591606 25581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66dd4c1aca514e0fabd5e62af1a77f09" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.591763 25507 raft_consensus.cc:3060] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.592279 25581 raft_consensus.cc:3060] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.596191 25506 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.597178 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.596748 25402 catalog_manager.cc:5697] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.601049 25703 leader_election.cc:290] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.601694 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.602227 25582 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.603153 25620 leader_election.cc:304] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.598114 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ce9cbd4c7b495d8c571b0ac6c9a0bf" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.599115 25548 leader_election.cc:304] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.603930 25703 raft_consensus.cc:2804] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.604144 25504 raft_consensus.cc:2468] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:46.604452 25706 raft_consensus.cc:2804] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.604868 25706 raft_consensus.cc:493] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.605165 25706 raft_consensus.cc:3060] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.605466 25546 leader_election.cc:304] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c; no voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:46.607811 25581 raft_consensus.cc:2468] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.604462 25703 raft_consensus.cc:697] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:46.609050 25621 leader_election.cc:304] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.610412 25723 raft_consensus.cc:2804] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.610847 25723 raft_consensus.cc:697] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:46.611593 25723 consensus_queue.cc:237] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.613926 25706 raft_consensus.cc:515] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.615785 25706 leader_election.cc:290] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.616761 25706 raft_consensus.cc:2749] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.617641 25582 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.618062 25507 raft_consensus.cc:2468] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
I20260709 13:10:46.621387 25703 consensus_queue.cc:237] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.623551 25401 catalog_manager.cc:5697] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.621731 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ce9cbd4c7b495d8c571b0ac6c9a0bf" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:46.627401 25655 raft_consensus.cc:3060] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.629540 25706 raft_consensus.cc:493] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.629462 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ce9cbd4c7b495d8c571b0ac6c9a0bf" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.630136 25706 raft_consensus.cc:515] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.630354 25507 raft_consensus.cc:3060] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.632149 25706 leader_election.cc:290] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.633774 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:46.634514 25656 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:46.635617 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.636257 25504 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:46.636579 25655 raft_consensus.cc:2468] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:46.637223 25546 leader_election.cc:304] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:46.639824 25748 raft_consensus.cc:2804] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.640197 25748 raft_consensus.cc:493] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.640548 25748 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.640558 25402 catalog_manager.cc:5697] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.642395 25507 raft_consensus.cc:2468] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:46.644196 25548 leader_election.cc:304] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:46.644963 25706 raft_consensus.cc:2804] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.646123 25748 raft_consensus.cc:515] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.647244 25706 raft_consensus.cc:697] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:46.648007 25748 leader_election.cc:290] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.648145 25706 consensus_queue.cc:237] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.649729 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.650346 25507 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.652336 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:46.652938 25655 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.657244 25402 catalog_manager.cc:5697] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.659303 25507 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:46.660084 25655 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:46.661180 25546 leader_election.cc:304] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:46.662114 25706 raft_consensus.cc:2804] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.662580 25706 raft_consensus.cc:697] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:46.663316 25706 consensus_queue.cc:237] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.665844 25401 catalog_manager.cc:5697] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.676785 25401 catalog_manager.cc:5697] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.777312 25655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60cd0401c21747449dd137981ede25bd"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
mode: GRACEFUL
new_leader_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:10:46.777833 25655 raft_consensus.cc:606] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Received request to transfer leadership to TS 5a73c63415df44d288d7637181fd9453
I20260709 13:10:46.788537 25582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
mode: GRACEFUL
new_leader_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:54150
I20260709 13:10:46.788997 25582 raft_consensus.cc:606] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Received request to transfer leadership to TS 5a73c63415df44d288d7637181fd9453
I20260709 13:10:46.789402 25706 raft_consensus.cc:493] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.789836 25706 raft_consensus.cc:515] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.791558 25706 leader_election.cc:290] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.792366 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:46.792678 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:46.793179 25507 raft_consensus.cc:2393] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in current term 1: Already voted for candidate 780fb48ea3e1431d9e16af33af84f302 in this term.
I20260709 13:10:46.794231 25546 leader_election.cc:304] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c; no voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:46.794853 25706 raft_consensus.cc:3060] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.796726 25655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b409484eb99141c18c2cf53452f51367"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
mode: GRACEFUL
new_leader_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:10:46.797205 25655 raft_consensus.cc:606] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Received request to transfer leadership to TS 5a73c63415df44d288d7637181fd9453
I20260709 13:10:46.799998 25706 raft_consensus.cc:2749] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.801664 25655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2976a399b1541ebaf14c16305465752"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
mode: GRACEFUL
new_leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:10:46.802131 25655 raft_consensus.cc:606] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Received request to transfer leadership to TS 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:46.806407 25655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
mode: GRACEFUL
new_leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:10:46.806802 25655 raft_consensus.cc:606] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Received request to transfer leadership to TS 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:46.817867 25507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
mode: GRACEFUL
new_leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:55288
I20260709 13:10:46.818284 25507 raft_consensus.cc:606] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Received request to transfer leadership to TS 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:46.880908 25703 consensus_queue.cc:1048] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.891652 25726 consensus_queue.cc:1048] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.899305 25723 raft_consensus.cc:993] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302: : Instructing follower 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:46.899701 25726 raft_consensus.cc:1081] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Signalling peer 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:46.901050 25582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:54136
I20260709 13:10:46.901503 25582 raft_consensus.cc:493] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.901775 25582 raft_consensus.cc:3060] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:46.906365 25582 raft_consensus.cc:515] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.908257 25582 leader_election.cc:290] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:46.908823 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:46.909165 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf143ba7d8ba4b9980f471980b1901b1" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:46.909502 25655 raft_consensus.cc:3055] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:46.909783 25507 raft_consensus.cc:3060] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:46.909879 25655 raft_consensus.cc:740] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:46.910766 25655 consensus_queue.cc:260] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.912174 25655 raft_consensus.cc:3060] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:46.916501 25507 raft_consensus.cc:2468] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:46.917547 25546 leader_election.cc:304] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:46.918171 25706 raft_consensus.cc:2804] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:46.918390 25655 raft_consensus.cc:2468] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:46.918685 25706 raft_consensus.cc:697] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:46.919492 25706 consensus_queue.cc:237] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:46.925061 25402 catalog_manager.cc:5697] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 1 to 2, leader changed from 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3) to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 2 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.941044 25726 consensus_queue.cc:1048] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.944667 25723 consensus_queue.cc:1048] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.959009 25702 consensus_queue.cc:1048] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.961162 25723 raft_consensus.cc:993] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302: : Instructing follower 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:46.961570 25723 raft_consensus.cc:1081] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Signalling peer 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:46.967389 25504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60cd0401c21747449dd137981ede25bd"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:55272
I20260709 13:10:46.967943 25504 raft_consensus.cc:493] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.968336 25504 raft_consensus.cc:3060] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:46.968812 25714 consensus_queue.cc:1048] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:46.978591 25504 raft_consensus.cc:515] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.981348 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60cd0401c21747449dd137981ede25bd" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:46.981906 25655 raft_consensus.cc:3055] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:46.982234 25655 raft_consensus.cc:740] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:46.982132 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60cd0401c21747449dd137981ede25bd" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:46.982386 25504 leader_election.cc:290] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Requested vote from peers 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:46.983081 25582 raft_consensus.cc:3060] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:46.983069 25655 consensus_queue.cc:260] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.984598 25655 raft_consensus.cc:3060] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:46.990290 25582 raft_consensus.cc:2468] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:46.991250 25655 raft_consensus.cc:2468] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:46.991333 25472 leader_election.cc:304] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:46.992050 25714 raft_consensus.cc:2804] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:46.992451 25714 raft_consensus.cc:697] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:46.993093 25714 consensus_queue.cc:237] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } }
I20260709 13:10:46.998642 25402 catalog_manager.cc:5697] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 1 to 2, leader changed from 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3) to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.023696 25714 consensus_queue.cc:1048] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.033073 25702 consensus_queue.cc:1048] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.039606 25746 raft_consensus.cc:993] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453: : Instructing follower 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:47.039999 25702 raft_consensus.cc:1081] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Signalling peer 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:47.041388 25582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:54138
I20260709 13:10:47.041808 25582 raft_consensus.cc:493] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.042068 25582 raft_consensus.cc:3060] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.045047 25726 consensus_queue.cc:1048] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.048038 25582 raft_consensus.cc:515] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.050920 25507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:47.051448 25507 raft_consensus.cc:3055] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.051725 25507 raft_consensus.cc:740] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:47.052177 25582 leader_election.cc:290] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:47.053241 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f5d95edbaf47d89bca383608303eb0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:47.053805 25655 raft_consensus.cc:3060] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.052584 25507 consensus_queue.cc:260] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.055024 25507 raft_consensus.cc:3060] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.056559 25723 consensus_queue.cc:1048] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.058956 25726 consensus_queue.cc:1048] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.062980 25507 raft_consensus.cc:2468] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:47.064172 25546 leader_election.cc:304] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:47.064975 25706 raft_consensus.cc:2804] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.065518 25748 consensus_queue.cc:1048] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.066628 25706 raft_consensus.cc:697] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:47.067515 25706 consensus_queue.cc:237] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.067417 25655 raft_consensus.cc:2468] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:47.075491 25723 consensus_queue.cc:1048] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.078215 25726 consensus_queue.cc:1048] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.083477 25748 consensus_queue.cc:1048] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.091614 25726 consensus_queue.cc:1048] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.108887 25723 raft_consensus.cc:993] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302: : Instructing follower 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:47.110078 25726 raft_consensus.cc:1081] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Signalling peer 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:47.111557 25402 catalog_manager.cc:5697] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 1 to 2, leader changed from 5a73c63415df44d288d7637181fd9453 (127.15.6.1) to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 2 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.112648 25504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b409484eb99141c18c2cf53452f51367"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:55272
I20260709 13:10:47.116147 25504 raft_consensus.cc:493] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.116521 25504 raft_consensus.cc:3060] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.123397 25768 raft_consensus.cc:993] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302: : Instructing follower 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:47.123960 25768 raft_consensus.cc:1081] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Signalling peer 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:47.125931 25582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2976a399b1541ebaf14c16305465752"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:54136
I20260709 13:10:47.126571 25582 raft_consensus.cc:493] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.126976 25582 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.127570 25504 raft_consensus.cc:515] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.130026 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b409484eb99141c18c2cf53452f51367" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:47.130343 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b409484eb99141c18c2cf53452f51367" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:47.130545 25580 raft_consensus.cc:3060] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.130916 25656 raft_consensus.cc:3055] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.131219 25656 raft_consensus.cc:740] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:47.132027 25656 consensus_queue.cc:260] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.133069 25656 raft_consensus.cc:3060] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.133582 25582 raft_consensus.cc:515] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.137472 25580 raft_consensus.cc:2468] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:47.138512 25472 leader_election.cc:304] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:47.139283 25702 raft_consensus.cc:2804] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.139747 25702 raft_consensus.cc:697] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:47.139968 25504 leader_election.cc:290] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:47.140625 25702 consensus_queue.cc:237] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.141108 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:47.142267 25505 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.141963 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:47.142835 25655 raft_consensus.cc:3055] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.143142 25655 raft_consensus.cc:740] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:47.143951 25655 consensus_queue.cc:260] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.144976 25655 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.147763 25505 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:47.148921 25546 leader_election.cc:304] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:47.141670 25656 raft_consensus.cc:2468] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:47.149747 25706 raft_consensus.cc:2804] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.150242 25706 raft_consensus.cc:697] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:47.150951 25706 consensus_queue.cc:237] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.149472 25404 catalog_manager.cc:5697] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 1 to 2, leader changed from 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3) to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.157595 25401 catalog_manager.cc:5697] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 1 to 2, leader changed from 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3) to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 2 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.159015 25655 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:47.160254 25582 leader_election.cc:290] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:47.255301 25706 consensus_queue.cc:1048] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.261524 25751 raft_consensus.cc:993] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: : Instructing follower 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:47.261955 25748 raft_consensus.cc:1081] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Signalling peer 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:47.264145 25504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:55286
I20260709 13:10:47.265416 25504 raft_consensus.cc:493] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.265844 25504 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.267066 25748 consensus_queue.cc:1048] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.272812 25504 raft_consensus.cc:515] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.275444 25504 leader_election.cc:290] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:47.275415 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:47.276847 25582 raft_consensus.cc:3055] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.277191 25582 raft_consensus.cc:740] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:47.276126 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:47.277884 25655 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.277982 25582 consensus_queue.cc:260] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.279357 25582 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.283365 25655 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:47.284394 25473 leader_election.cc:304] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:47.284514 25582 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:47.285175 25702 raft_consensus.cc:2804] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.285645 25702 raft_consensus.cc:697] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:47.286280 25702 consensus_queue.cc:237] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:47.291950 25401 catalog_manager.cc:5697] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 1 to 2, leader changed from 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2) to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.381040 25655 raft_consensus.cc:1275] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.382201 25748 consensus_queue.cc:1048] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.389029 25504 raft_consensus.cc:1275] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.390918 25777 consensus_queue.cc:1048] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.460371 25504 raft_consensus.cc:1275] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.461611 25751 consensus_queue.cc:1048] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.469182 25655 raft_consensus.cc:1275] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.470927 25751 consensus_queue.cc:1048] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.536437 25655 raft_consensus.cc:1275] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.537552 25702 consensus_queue.cc:1048] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.544376 25582 raft_consensus.cc:1275] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.545868 25746 consensus_queue.cc:1048] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.645083 25655 raft_consensus.cc:1275] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.646201 25751 consensus_queue.cc:1048] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.653072 25504 raft_consensus.cc:1275] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.654634 25706 consensus_queue.cc:1048] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.692093 25582 raft_consensus.cc:1275] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.693073 25779 consensus_queue.cc:1048] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.699530 25655 raft_consensus.cc:1275] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.701968 25779 consensus_queue.cc:1048] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.855648 25655 raft_consensus.cc:1275] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.856882 25779 consensus_queue.cc:1048] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.864830 25582 raft_consensus.cc:1275] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:47.866364 25746 consensus_queue.cc:1048] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.846876 25401 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48112:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:49.849174 25401 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:49.897743 25495 tablet_service.cc:1511] Processing CreateTablet for tablet ead639d421314b5f9108d5daa78e30a0 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:49.899246 25570 tablet_service.cc:1511] Processing CreateTablet for tablet ead639d421314b5f9108d5daa78e30a0 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:49.900503 25570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead639d421314b5f9108d5daa78e30a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.902760 25640 tablet_service.cc:1511] Processing CreateTablet for tablet ead639d421314b5f9108d5daa78e30a0 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:49.903959 25640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead639d421314b5f9108d5daa78e30a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.899580 25495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead639d421314b5f9108d5daa78e30a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.932718 25489 tablet_service.cc:1511] Processing CreateTablet for tablet abe9de326bde4f54b3330e2debb90605 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:49.936709 25645 tablet_service.cc:1511] Processing CreateTablet for tablet abe9de326bde4f54b3330e2debb90605 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:49.937347 25490 tablet_service.cc:1511] Processing CreateTablet for tablet d4ea36ec13074727aa4a7b3890cb9c52 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:49.938031 25645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe9de326bde4f54b3330e2debb90605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.935184 25568 tablet_service.cc:1511] Processing CreateTablet for tablet abe9de326bde4f54b3330e2debb90605 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:49.940631 25568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe9de326bde4f54b3330e2debb90605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.943004 25572 tablet_service.cc:1511] Processing CreateTablet for tablet d4ea36ec13074727aa4a7b3890cb9c52 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:49.944276 25572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ea36ec13074727aa4a7b3890cb9c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.944730 25790 tablet_bootstrap.cc:492] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:49.937062 25489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe9de326bde4f54b3330e2debb90605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.950152 25640 tablet_service.cc:1511] Processing CreateTablet for tablet d4ea36ec13074727aa4a7b3890cb9c52 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:49.951856 25493 tablet_service.cc:1511] Processing CreateTablet for tablet 34eee54ac6e9414b94f2d0d550338839 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:49.953725 25567 tablet_service.cc:1511] Processing CreateTablet for tablet 34eee54ac6e9414b94f2d0d550338839 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:49.954914 25567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34eee54ac6e9414b94f2d0d550338839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.957038 25496 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc1883577e848dbb8769a897328350d (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:49.957743 25639 tablet_service.cc:1511] Processing CreateTablet for tablet 34eee54ac6e9414b94f2d0d550338839 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:49.958839 25566 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc1883577e848dbb8769a897328350d (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:49.960842 25566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc1883577e848dbb8769a897328350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.961525 25497 tablet_service.cc:1511] Processing CreateTablet for tablet f519a5da93d044ec8b20935e9ec8fe79 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:49.961440 25638 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc1883577e848dbb8769a897328350d (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:49.964905 25565 tablet_service.cc:1511] Processing CreateTablet for tablet f519a5da93d044ec8b20935e9ec8fe79 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:49.966118 25565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f519a5da93d044ec8b20935e9ec8fe79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.966187 25491 tablet_service.cc:1511] Processing CreateTablet for tablet d4f6225a0f474e6e9472c1e3c4536797 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:49.967598 25491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f6225a0f474e6e9472c1e3c4536797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.952435 25640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ea36ec13074727aa4a7b3890cb9c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.968230 25497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f519a5da93d044ec8b20935e9ec8fe79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.968796 25493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34eee54ac6e9414b94f2d0d550338839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.969391 25490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ea36ec13074727aa4a7b3890cb9c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.969108 25641 tablet_service.cc:1511] Processing CreateTablet for tablet f519a5da93d044ec8b20935e9ec8fe79 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:49.971428 25641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f519a5da93d044ec8b20935e9ec8fe79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.976114 25639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34eee54ac6e9414b94f2d0d550338839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.980610 25638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc1883577e848dbb8769a897328350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.982107 25791 tablet_bootstrap.cc:492] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:49.982268 25496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc1883577e848dbb8769a897328350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.986362 25570 tablet_service.cc:1511] Processing CreateTablet for tablet d4f6225a0f474e6e9472c1e3c4536797 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:49.987563 25570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f6225a0f474e6e9472c1e3c4536797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.994552 25644 tablet_service.cc:1511] Processing CreateTablet for tablet d4f6225a0f474e6e9472c1e3c4536797 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:49.995815 25644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f6225a0f474e6e9472c1e3c4536797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.995652 25492 tablet_service.cc:1511] Processing CreateTablet for tablet 4f32422564274edbbb9fc28693166301 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:49.996897 25492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f32422564274edbbb9fc28693166301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.996094 25790 tablet_bootstrap.cc:654] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.005827 25569 tablet_service.cc:1511] Processing CreateTablet for tablet 4f32422564274edbbb9fc28693166301 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:50.007455 25642 tablet_service.cc:1511] Processing CreateTablet for tablet 4f32422564274edbbb9fc28693166301 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:50.008687 25642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f32422564274edbbb9fc28693166301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.020115 25791 tablet_bootstrap.cc:654] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.024049 25790 tablet_bootstrap.cc:492] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.026871 25790 ts_tablet_manager.cc:1403] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 13:10:50.031039 25494 tablet_service.cc:1511] Processing CreateTablet for tablet 123fd53c54ab4f0e91085dc28ff17971 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:50.032318 25494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123fd53c54ab4f0e91085dc28ff17971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.034608 25793 tablet_bootstrap.cc:492] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.035928 25569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f32422564274edbbb9fc28693166301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.029816 25790 raft_consensus.cc:359] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.042490 25790 raft_consensus.cc:385] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.042809 25790 raft_consensus.cc:740] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.043949 25793 tablet_bootstrap.cc:654] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.047698 25565 tablet_service.cc:1511] Processing CreateTablet for tablet 123fd53c54ab4f0e91085dc28ff17971 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:50.048305 25643 tablet_service.cc:1511] Processing CreateTablet for tablet 123fd53c54ab4f0e91085dc28ff17971 (DEFAULT_TABLE table=soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:50.048918 25565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123fd53c54ab4f0e91085dc28ff17971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.049568 25643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123fd53c54ab4f0e91085dc28ff17971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.043545 25790 consensus_queue.cc:260] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.078421 25790 ts_tablet_manager.cc:1434] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:10:50.082842 25791 tablet_bootstrap.cc:492] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.083478 25791 ts_tablet_manager.cc:1403] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.102s	user 0.006s	sys 0.003s
I20260709 13:10:50.086580 25791 raft_consensus.cc:359] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.087342 25791 raft_consensus.cc:385] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.090842 25790 tablet_bootstrap.cc:492] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.087630 25791 raft_consensus.cc:740] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.092729 25791 consensus_queue.cc:260] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.097580 25790 tablet_bootstrap.cc:654] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.097828 25791 ts_tablet_manager.cc:1434] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:10:50.098961 25791 tablet_bootstrap.cc:492] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.105841 25791 tablet_bootstrap.cc:654] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.115782 25790 tablet_bootstrap.cc:492] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.116343 25790 ts_tablet_manager.cc:1403] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:10:50.119349 25790 raft_consensus.cc:359] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.120101 25790 raft_consensus.cc:385] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.120389 25790 raft_consensus.cc:740] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.122396 25790 consensus_queue.cc:260] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.125548 25791 tablet_bootstrap.cc:492] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.126206 25791 ts_tablet_manager.cc:1403] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.005s
I20260709 13:10:50.127444 25790 ts_tablet_manager.cc:1434] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:50.129407 25791 raft_consensus.cc:359] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.130136 25791 raft_consensus.cc:385] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.130393 25791 raft_consensus.cc:740] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.131268 25791 consensus_queue.cc:260] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.140615 25790 tablet_bootstrap.cc:492] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.130293 25706 raft_consensus.cc:493] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.144094 25706 raft_consensus.cc:515] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.144347 25791 ts_tablet_manager.cc:1434] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:10:50.146643 25706 leader_election.cc:290] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.148154 25790 tablet_bootstrap.cc:654] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.148191 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.149199 25655 raft_consensus.cc:2468] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.147710 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:50.150604 25548 leader_election.cc:304] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.151959 25799 raft_consensus.cc:2804] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:50.152092 25546 leader_election.cc:343] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.152511 25799 raft_consensus.cc:493] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.152954 25799 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.156772 25791 tablet_bootstrap.cc:492] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.161036 25793 tablet_bootstrap.cc:492] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.161535 25793 ts_tablet_manager.cc:1403] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.127s	user 0.050s	sys 0.051s
I20260709 13:10:50.163434 25791 tablet_bootstrap.cc:654] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.165571 25793 raft_consensus.cc:359] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.166219 25793 raft_consensus.cc:385] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.166549 25793 raft_consensus.cc:740] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.167347 25793 consensus_queue.cc:260] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.169680 25799 raft_consensus.cc:515] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.172219 25793 ts_tablet_manager.cc:1434] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:50.173252 25793 tablet_bootstrap.cc:492] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.177374 25779 raft_consensus.cc:493] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.177814 25779 raft_consensus.cc:515] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.179215 25793 tablet_bootstrap.cc:654] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.181378 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f6225a0f474e6e9472c1e3c4536797" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
W20260709 13:10:50.182968 25472 leader_election.cc:343] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.187278 25779 leader_election.cc:290] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.188938 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f6225a0f474e6e9472c1e3c4536797" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
W20260709 13:10:50.190337 25473 leader_election.cc:343] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.190492 25793 tablet_bootstrap.cc:492] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.190783 25473 leader_election.cc:304] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a73c63415df44d288d7637181fd9453; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:50.191045 25793 ts_tablet_manager.cc:1403] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:10:50.191905 25779 raft_consensus.cc:2749] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.193931 25793 raft_consensus.cc:359] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.194602 25793 raft_consensus.cc:385] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.194451 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:50.194931 25793 raft_consensus.cc:740] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
W20260709 13:10:50.195996 25546 leader_election.cc:343] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.195734 25793 consensus_queue.cc:260] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.197955 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.198452 25655 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.200263 25793 ts_tablet_manager.cc:1434] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:50.201177 25793 tablet_bootstrap.cc:492] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.207103 25793 tablet_bootstrap.cc:654] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.209327 25655 raft_consensus.cc:2468] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:50.215456 25548 leader_election.cc:304] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 5a73c63415df44d288d7637181fd9453
I20260709 13:10:50.216490 25706 raft_consensus.cc:2804] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.221436 25799 leader_election.cc:290] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.236960 25706 raft_consensus.cc:697] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:50.238132 25706 consensus_queue.cc:237] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.245065 25790 tablet_bootstrap.cc:492] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.245676 25790 ts_tablet_manager.cc:1403] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.105s	user 0.043s	sys 0.038s
I20260709 13:10:50.249327 25790 raft_consensus.cc:359] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.249871 25790 raft_consensus.cc:385] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.250097 25790 raft_consensus.cc:740] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.250900 25790 consensus_queue.cc:260] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.251695 25791 tablet_bootstrap.cc:492] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.252301 25791 ts_tablet_manager.cc:1403] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.096s	user 0.029s	sys 0.061s
I20260709 13:10:50.253451 25793 tablet_bootstrap.cc:492] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.253861 25793 ts_tablet_manager.cc:1403] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.053s	user 0.038s	sys 0.013s
I20260709 13:10:50.255188 25791 raft_consensus.cc:359] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.255913 25791 raft_consensus.cc:385] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.256199 25791 raft_consensus.cc:740] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.256129 25793 raft_consensus.cc:359] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.257017 25793 raft_consensus.cc:385] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.257349 25793 raft_consensus.cc:740] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.257117 25791 consensus_queue.cc:260] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.258152 25793 consensus_queue.cc:260] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.259418 25791 ts_tablet_manager.cc:1434] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:10:50.260392 25791 tablet_bootstrap.cc:492] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.259895 25401 catalog_manager.cc:5697] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.262974 25790 ts_tablet_manager.cc:1434] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.005s
I20260709 13:10:50.264019 25790 tablet_bootstrap.cc:492] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.265163 25793 ts_tablet_manager.cc:1434] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:10:50.266096 25793 tablet_bootstrap.cc:492] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.267261 25791 tablet_bootstrap.cc:654] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.270081 25790 tablet_bootstrap.cc:654] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.272028 25793 tablet_bootstrap.cc:654] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.293464 25790 tablet_bootstrap.cc:492] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.293852 25791 tablet_bootstrap.cc:492] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.293869 25790 ts_tablet_manager.cc:1403] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.016s
I20260709 13:10:50.293870 25793 tablet_bootstrap.cc:492] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.294463 25791 ts_tablet_manager.cc:1403] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.025s
I20260709 13:10:50.294809 25793 ts_tablet_manager.cc:1403] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.006s
I20260709 13:10:50.297148 25790 raft_consensus.cc:359] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.297477 25791 raft_consensus.cc:359] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.297878 25790 raft_consensus.cc:385] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.298107 25791 raft_consensus.cc:385] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.298242 25790 raft_consensus.cc:740] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.298029 25793 raft_consensus.cc:359] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.298653 25791 raft_consensus.cc:740] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.298862 25793 raft_consensus.cc:385] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.299226 25793 raft_consensus.cc:740] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.299400 25791 consensus_queue.cc:260] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.299309 25790 consensus_queue.cc:260] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.300022 25793 consensus_queue.cc:260] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.301771 25791 ts_tablet_manager.cc:1434] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:50.302132 25793 ts_tablet_manager.cc:1434] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:50.302701 25791 tablet_bootstrap.cc:492] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.303081 25793 tablet_bootstrap.cc:492] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.307740 25790 ts_tablet_manager.cc:1434] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:50.308719 25790 tablet_bootstrap.cc:492] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.309218 25793 tablet_bootstrap.cc:654] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.309340 25791 tablet_bootstrap.cc:654] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.322715 25790 tablet_bootstrap.cc:654] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.328648 25793 tablet_bootstrap.cc:492] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.329185 25793 ts_tablet_manager.cc:1403] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 13:10:50.332049 25790 tablet_bootstrap.cc:492] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.331926 25793 raft_consensus.cc:359] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.332594 25793 raft_consensus.cc:385] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.332736 25790 ts_tablet_manager.cc:1403] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.006s
I20260709 13:10:50.332142 25791 tablet_bootstrap.cc:492] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.332916 25793 raft_consensus.cc:740] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.333320 25791 ts_tablet_manager.cc:1403] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.020s
I20260709 13:10:50.333659 25793 consensus_queue.cc:260] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.336016 25793 ts_tablet_manager.cc:1434] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:50.337001 25793 tablet_bootstrap.cc:492] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.337711 25790 raft_consensus.cc:359] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.338466 25790 raft_consensus.cc:385] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.338737 25790 raft_consensus.cc:740] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.341307 25791 raft_consensus.cc:359] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.342031 25791 raft_consensus.cc:385] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.342308 25791 raft_consensus.cc:740] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.343118 25791 consensus_queue.cc:260] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.344080 25793 tablet_bootstrap.cc:654] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.345534 25791 ts_tablet_manager.cc:1434] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:50.346599 25791 tablet_bootstrap.cc:492] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.339538 25790 consensus_queue.cc:260] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.352830 25791 tablet_bootstrap.cc:654] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.357753 25796 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.358224 25796 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.360272 25796 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:50.360898 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:50.361728 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:50.362078 25793 tablet_bootstrap.cc:492] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
W20260709 13:10:50.362278 25620 leader_election.cc:343] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.362342 25580 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 0.
I20260709 13:10:50.362655 25793 ts_tablet_manager.cc:1403] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 13:10:50.363680 25621 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 5a73c63415df44d288d7637181fd9453
I20260709 13:10:50.364480 25796 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.364753 25790 ts_tablet_manager.cc:1434] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:10:50.364827 25796 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.365321 25796 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.366938 25706 raft_consensus.cc:493] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.366727 25793 raft_consensus.cc:359] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.367444 25793 raft_consensus.cc:385] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.367398 25706 raft_consensus.cc:515] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.367877 25793 raft_consensus.cc:740] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.368599 25793 consensus_queue.cc:260] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.369467 25706 leader_election.cc:290] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.370720 25793 ts_tablet_manager.cc:1434] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:50.371690 25793 tablet_bootstrap.cc:492] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.372248 25796 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.372659 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:50.373623 25790 tablet_bootstrap.cc:492] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.375550 25504 raft_consensus.cc:2468] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.376849 25546 leader_election.cc:304] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.377569 25706 raft_consensus.cc:2804] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.377600 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.378162 25706 raft_consensus.cc:493] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.378611 25706 raft_consensus.cc:3060] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:50.379145 25548 leader_election.cc:343] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.379585 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:50.375032 25791 tablet_bootstrap.cc:492] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
W20260709 13:10:50.380957 25620 leader_election.cc:343] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.381313 25791 ts_tablet_manager.cc:1403] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.008s
I20260709 13:10:50.383033 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:50.383587 25580 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.385931 25791 raft_consensus.cc:359] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.386643 25791 raft_consensus.cc:385] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.386904 25791 raft_consensus.cc:740] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.385169 25706 raft_consensus.cc:515] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.387368 25793 tablet_bootstrap.cc:654] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.387725 25791 consensus_queue.cc:260] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.389211 25706 leader_election.cc:290] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.389842 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:50.390340 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.390465 25504 raft_consensus.cc:3060] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.392613 25790 tablet_bootstrap.cc:654] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.392004 25580 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 1.
W20260709 13:10:50.392505 25548 leader_election.cc:343] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.389997 25791 ts_tablet_manager.cc:1434] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:50.398715 25621 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 5a73c63415df44d288d7637181fd9453
I20260709 13:10:50.399524 25791 tablet_bootstrap.cc:492] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.399619 25768 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.401827 25790 tablet_bootstrap.cc:492] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.402315 25790 ts_tablet_manager.cc:1403] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.005s
I20260709 13:10:50.398748 25796 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:50.405257 25790 raft_consensus.cc:359] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.405948 25790 raft_consensus.cc:385] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.406240 25790 raft_consensus.cc:740] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.406935 25790 consensus_queue.cc:260] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.398327 25504 raft_consensus.cc:2468] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:50.409155 25790 ts_tablet_manager.cc:1434] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:10:50.409204 25546 leader_election.cc:304] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:50.410205 25790 tablet_bootstrap.cc:492] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.410365 25706 raft_consensus.cc:2804] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.410846 25706 raft_consensus.cc:697] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:50.411458 25791 tablet_bootstrap.cc:654] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.411607 25706 consensus_queue.cc:237] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.415936 25804 raft_consensus.cc:493] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.416456 25804 raft_consensus.cc:515] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.417244 25790 tablet_bootstrap.cc:654] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.418524 25804 leader_election.cc:290] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.420140 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f6225a0f474e6e9472c1e3c4536797" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.420742 25655 raft_consensus.cc:2468] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.422152 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f6225a0f474e6e9472c1e3c4536797" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:50.422811 25505 raft_consensus.cc:2468] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.425554 25548 leader_election.cc:304] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.426292 25804 raft_consensus.cc:2804] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.426669 25804 raft_consensus.cc:493] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.427044 25804 raft_consensus.cc:3060] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.431442 25790 tablet_bootstrap.cc:492] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.431953 25790 ts_tablet_manager.cc:1403] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:10:50.433755 25791 tablet_bootstrap.cc:492] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.434274 25791 ts_tablet_manager.cc:1403] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.016s
I20260709 13:10:50.434780 25790 raft_consensus.cc:359] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.435523 25790 raft_consensus.cc:385] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.435865 25790 raft_consensus.cc:740] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.436550 25790 consensus_queue.cc:260] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.437320 25791 raft_consensus.cc:359] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.438004 25791 raft_consensus.cc:385] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.438274 25791 raft_consensus.cc:740] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.438815 25790 ts_tablet_manager.cc:1434] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:50.439077 25791 consensus_queue.cc:260] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.440016 25790 tablet_bootstrap.cc:492] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.435268 25804 raft_consensus.cc:515] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.441651 25791 ts_tablet_manager.cc:1434] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:50.446534 25790 tablet_bootstrap.cc:654] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.445667 25768 raft_consensus.cc:697] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:50.446884 25791 tablet_bootstrap.cc:492] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.448143 25403 catalog_manager.cc:5697] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.447540 25768 consensus_queue.cc:237] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.449532 25804 leader_election.cc:290] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.452493 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f6225a0f474e6e9472c1e3c4536797" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.452454 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f6225a0f474e6e9472c1e3c4536797" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:50.453172 25655 raft_consensus.cc:3060] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.453239 25504 raft_consensus.cc:3060] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.454973 25793 tablet_bootstrap.cc:492] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.455509 25793 ts_tablet_manager.cc:1403] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.021s
I20260709 13:10:50.458536 25793 raft_consensus.cc:359] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.459220 25793 raft_consensus.cc:385] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.459489 25793 raft_consensus.cc:740] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.459702 25504 raft_consensus.cc:2468] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:50.453502 25791 tablet_bootstrap.cc:654] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.463130 25546 leader_election.cc:304] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.464704 25706 raft_consensus.cc:2804] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.465123 25706 raft_consensus.cc:697] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:50.465449 25816 raft_consensus.cc:493] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.465220 25793 consensus_queue.cc:260] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.465934 25706 consensus_queue.cc:237] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.468251 25793 ts_tablet_manager.cc:1434] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:50.469235 25793 tablet_bootstrap.cc:492] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.469372 25799 raft_consensus.cc:493] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.469870 25799 raft_consensus.cc:515] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.465891 25816 raft_consensus.cc:515] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.472711 25816 leader_election.cc:290] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:50.474454 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe9de326bde4f54b3330e2debb90605" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.475399 25793 tablet_bootstrap.cc:654] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.475764 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea36ec13074727aa4a7b3890cb9c52" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:50.478003 25655 raft_consensus.cc:2468] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
W20260709 13:10:50.478782 25548 leader_election.cc:343] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:50.479202 25453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:50.481477 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe9de326bde4f54b3330e2debb90605" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:50.471742 25799 leader_election.cc:290] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
W20260709 13:10:50.483315 25546 leader_election.cc:343] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.483855 25546 leader_election.cc:304] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c; no voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302
W20260709 13:10:50.478072 25621 leader_election.cc:343] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.485126 25804 raft_consensus.cc:2749] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.502097 25401 catalog_manager.cc:5697] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.505323 25791 tablet_bootstrap.cc:492] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.505787 25791 ts_tablet_manager.cc:1403] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.010s
I20260709 13:10:50.505856 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea36ec13074727aa4a7b3890cb9c52" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
W20260709 13:10:50.507000 25620 leader_election.cc:343] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.507405 25620 leader_election.cc:304] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 780fb48ea3e1431d9e16af33af84f302; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453
I20260709 13:10:50.508396 25816 raft_consensus.cc:2749] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.511507 25791 raft_consensus.cc:359] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.512127 25791 raft_consensus.cc:385] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.512368 25791 raft_consensus.cc:740] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.513273 25791 consensus_queue.cc:260] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.515473 25706 raft_consensus.cc:493] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.515839 25706 raft_consensus.cc:515] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.517647 25791 ts_tablet_manager.cc:1434] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:50.518419 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f32422564274edbbb9fc28693166301" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:50.518570 25706 leader_election.cc:290] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.518631 25791 tablet_bootstrap.cc:492] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Bootstrap starting.
I20260709 13:10:50.519486 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f32422564274edbbb9fc28693166301" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.520049 25655 raft_consensus.cc:2468] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.520874 25793 tablet_bootstrap.cc:492] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.521303 25793 ts_tablet_manager.cc:1403] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.004s
I20260709 13:10:50.521159 25548 leader_election.cc:304] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.522038 25823 raft_consensus.cc:493] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.522898 25706 raft_consensus.cc:2804] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.523193 25706 raft_consensus.cc:493] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.523453 25706 raft_consensus.cc:3060] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.525223 25504 raft_consensus.cc:2468] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.522557 25823 raft_consensus.cc:515] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.527278 25791 tablet_bootstrap.cc:654] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.529945 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc1883577e848dbb8769a897328350d" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:50.530535 25580 raft_consensus.cc:2468] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:50.531216 25706 raft_consensus.cc:515] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.525626 25403 catalog_manager.cc:5697] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.531997 25472 leader_election.cc:304] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.533747 25790 tablet_bootstrap.cc:492] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.533562 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc1883577e848dbb8769a897328350d" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.534533 25779 raft_consensus.cc:2804] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.535022 25779 raft_consensus.cc:493] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.535359 25779 raft_consensus.cc:3060] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:50.535781 25473 leader_election.cc:343] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:50.536727 25790 ts_tablet_manager.cc:1403] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.097s	user 0.026s	sys 0.029s
I20260709 13:10:50.538002 25791 tablet_bootstrap.cc:492] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c: No bootstrap required, opened a new log
I20260709 13:10:50.538452 25791 ts_tablet_manager.cc:1403] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 13:10:50.534513 25823 leader_election.cc:290] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.540194 25790 raft_consensus.cc:359] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.540858 25790 raft_consensus.cc:385] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.541199 25790 raft_consensus.cc:740] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.541052 25791 raft_consensus.cc:359] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.541757 25791 raft_consensus.cc:385] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.542032 25791 raft_consensus.cc:740] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.542068 25790 consensus_queue.cc:260] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.542558 25779 raft_consensus.cc:515] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.542903 25791 consensus_queue.cc:260] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.544263 25790 ts_tablet_manager.cc:1434] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:50.544929 25791 ts_tablet_manager.cc:1434] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:50.545128 25790 tablet_bootstrap.cc:492] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302: Bootstrap starting.
I20260709 13:10:50.546378 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc1883577e848dbb8769a897328350d" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:50.546928 25580 raft_consensus.cc:3060] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.547472 25793 raft_consensus.cc:359] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.549156 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc1883577e848dbb8769a897328350d" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.549564 25779 leader_election.cc:290] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.554049 25655 raft_consensus.cc:3060] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.551565 25790 tablet_bootstrap.cc:654] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.553143 25580 raft_consensus.cc:2468] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:50.553579 25804 raft_consensus.cc:493] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.556847 25804 raft_consensus.cc:515] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.557332 25706 leader_election.cc:290] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.557524 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f32422564274edbbb9fc28693166301" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.558135 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f32422564274edbbb9fc28693166301" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:50.558717 25504 raft_consensus.cc:3060] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.558928 25804 leader_election.cc:290] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.560313 25472 leader_election.cc:304] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.560680 25654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.558118 25656 raft_consensus.cc:3060] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.561406 25654 raft_consensus.cc:2468] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.561800 25779 raft_consensus.cc:2804] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.562402 25779 raft_consensus.cc:697] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:50.563357 25548 leader_election.cc:304] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.564110 25779 consensus_queue.cc:237] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.564450 25804 raft_consensus.cc:2804] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.565229 25804 raft_consensus.cc:493] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.563424 25655 raft_consensus.cc:2468] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:50.565672 25804 raft_consensus.cc:3060] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.561091 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:50.568802 25505 raft_consensus.cc:2468] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 0.
I20260709 13:10:50.573119 25793 raft_consensus.cc:385] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.573417 25793 raft_consensus.cc:740] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.574019 25793 consensus_queue.cc:260] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.567472 25656 raft_consensus.cc:2468] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:50.575093 25804 raft_consensus.cc:515] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.575994 25548 leader_election.cc:304] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.576792 25706 raft_consensus.cc:2804] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.577184 25706 raft_consensus.cc:697] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:50.576014 25793 ts_tablet_manager.cc:1434] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.003s
I20260709 13:10:50.577888 25706 consensus_queue.cc:237] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.578696 25793 tablet_bootstrap.cc:492] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453: Bootstrap starting.
I20260709 13:10:50.578980 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:50.579715 25505 raft_consensus.cc:3060] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.575012 25504 raft_consensus.cc:2468] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:50.583520 25823 raft_consensus.cc:493] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.584018 25823 raft_consensus.cc:515] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.585852 25823 leader_election.cc:290] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.586481 25790 tablet_bootstrap.cc:492] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302: No bootstrap required, opened a new log
I20260709 13:10:50.586932 25790 ts_tablet_manager.cc:1403] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.015s
I20260709 13:10:50.587781 25505 raft_consensus.cc:2468] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:50.588934 25804 leader_election.cc:290] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.589615 25546 leader_election.cc:304] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.590032 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.590409 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.590690 25655 raft_consensus.cc:3060] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.590888 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:50.591208 25656 raft_consensus.cc:2393] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a73c63415df44d288d7637181fd9453 in current term 1: Already voted for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in this term.
I20260709 13:10:50.589563 25790 raft_consensus.cc:359] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.592406 25790 raft_consensus.cc:385] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.592835 25804 raft_consensus.cc:2804] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.592510 25473 leader_election.cc:304] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a73c63415df44d288d7637181fd9453; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:50.593384 25804 raft_consensus.cc:697] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:50.593920 25823 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.594180 25804 consensus_queue.cc:237] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.592675 25793 tablet_bootstrap.cc:654] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.592694 25790 raft_consensus.cc:740] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.597841 25655 raft_consensus.cc:2468] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 1.
I20260709 13:10:50.597806 25790 consensus_queue.cc:260] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.601159 25823 raft_consensus.cc:2749] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.603140 25790 ts_tablet_manager.cc:1434] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:10:50.608083 25793 tablet_bootstrap.cc:492] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453: No bootstrap required, opened a new log
I20260709 13:10:50.608543 25793 ts_tablet_manager.cc:1403] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:10:50.608783 25401 catalog_manager.cc:5697] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.610984 25793 raft_consensus.cc:359] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.611744 25793 raft_consensus.cc:385] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.612010 25793 raft_consensus.cc:740] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.612612 25793 consensus_queue.cc:260] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.614842 25793 ts_tablet_manager.cc:1434] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:50.616546 25402 catalog_manager.cc:5697] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.622265 25401 catalog_manager.cc:5697] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 1 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.705371 25779 raft_consensus.cc:493] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.705839 25779 raft_consensus.cc:515] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.707356 25779 leader_election.cc:290] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.708060 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea36ec13074727aa4a7b3890cb9c52" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:50.708237 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea36ec13074727aa4a7b3890cb9c52" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.708638 25580 raft_consensus.cc:2468] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:50.708787 25655 raft_consensus.cc:2468] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:50.709506 25472 leader_election.cc:304] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.710172 25779 raft_consensus.cc:2804] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.710433 25779 raft_consensus.cc:493] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.710726 25779 raft_consensus.cc:3060] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.715297 25779 raft_consensus.cc:515] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.716761 25779 leader_election.cc:290] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.717417 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea36ec13074727aa4a7b3890cb9c52" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:50.717579 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea36ec13074727aa4a7b3890cb9c52" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.717898 25580 raft_consensus.cc:3060] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.718057 25655 raft_consensus.cc:3060] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.722107 25655 raft_consensus.cc:2468] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:50.722481 25580 raft_consensus.cc:2468] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:50.722942 25473 leader_election.cc:304] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.723644 25779 raft_consensus.cc:2804] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.724071 25779 raft_consensus.cc:697] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:50.724689 25779 consensus_queue.cc:237] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.731488 25402 catalog_manager.cc:5697] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.743655 25779 raft_consensus.cc:493] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.744092 25779 raft_consensus.cc:515] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.745566 25779 leader_election.cc:290] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.746201 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe9de326bde4f54b3330e2debb90605" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:50.746403 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe9de326bde4f54b3330e2debb90605" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.746758 25580 raft_consensus.cc:2468] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:50.746924 25655 raft_consensus.cc:2468] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 0.
I20260709 13:10:50.747632 25472 leader_election.cc:304] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.748317 25779 raft_consensus.cc:2804] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:50.748641 25779 raft_consensus.cc:493] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.748891 25779 raft_consensus.cc:3060] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.753505 25779 raft_consensus.cc:515] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.754861 25779 leader_election.cc:290] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.755620 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe9de326bde4f54b3330e2debb90605" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:50.755893 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abe9de326bde4f54b3330e2debb90605" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.756153 25580 raft_consensus.cc:3060] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.756454 25655 raft_consensus.cc:3060] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.760872 25580 raft_consensus.cc:2468] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:50.761178 25655 raft_consensus.cc:2468] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:50.761720 25472 leader_election.cc:304] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.762439 25779 raft_consensus.cc:2804] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.762799 25779 raft_consensus.cc:697] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:50.763463 25779 consensus_queue.cc:237] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.770351 25402 catalog_manager.cc:5697] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.797819 25655 raft_consensus.cc:3060] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.802976 25804 consensus_queue.cc:1048] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.815152 25799 consensus_queue.cc:1048] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.817271 25580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
mode: GRACEFUL
new_leader_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:54150
I20260709 13:10:50.817823 25580 raft_consensus.cc:606] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Received request to transfer leadership to TS 5a73c63415df44d288d7637181fd9453
I20260709 13:10:50.822445 25799 consensus_queue.cc:1048] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.835304 25582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
mode: GRACEFUL
new_leader_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:54150
I20260709 13:10:50.835492 25804 raft_consensus.cc:993] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: : Instructing follower 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:50.835942 25582 raft_consensus.cc:606] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Received request to transfer leadership to TS 5a73c63415df44d288d7637181fd9453
I20260709 13:10:50.836024 25804 raft_consensus.cc:1081] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Signalling peer 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:50.843245 25504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cc1883577e848dbb8769a897328350d"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
mode: GRACEFUL
new_leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:55288
I20260709 13:10:50.848778 25507 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.859359 25779 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.848265 25505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:55286
I20260709 13:10:50.859874 25779 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.850957 25799 consensus_queue.cc:1048] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.860076 25505 raft_consensus.cc:493] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.864336 25816 consensus_queue.cc:1048] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:50.868090 25504 raft_consensus.cc:606] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Received request to transfer leadership to TS 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:50.870312 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:50.870944 25582 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 1.
I20260709 13:10:50.864723 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:50.872180 25472 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 5a73c63415df44d288d7637181fd9453; no voters: 
I20260709 13:10:50.863385 25779 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.874044 25505 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.876529 25779 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:50.877483 25655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
mode: GRACEFUL
new_leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:10:50.878095 25655 raft_consensus.cc:606] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Received request to transfer leadership to TS 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:50.878306 25779 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 780fb48ea3e1431d9e16af33af84f302)
I20260709 13:10:50.883821 25505 raft_consensus.cc:515] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.880709 25779 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.886749 25768 consensus_queue.cc:1048] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.886899 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.887490 25655 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.891964 25779 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.892912 25505 leader_election.cc:290] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.893973 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:50.894156 25779 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.895526 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.897651 25504 raft_consensus.cc:1240] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Rejecting Update request from peer 780fb48ea3e1431d9e16af33af84f302 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:50.898881 25655 raft_consensus.cc:2468] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:50.894555 25580 raft_consensus.cc:3055] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.899711 25579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:50.900718 25580 raft_consensus.cc:740] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:50.901504 25580 consensus_queue.cc:260] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.901893 25579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
mode: GRACEFUL
new_leader_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:54150
I20260709 13:10:50.902465 25579 raft_consensus.cc:606] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Received request to transfer leadership to TS 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:50.902899 25580 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.904445 25473 leader_election.cc:304] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.905308 25779 raft_consensus.cc:2804] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.905773 25779 raft_consensus.cc:697] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:50.899950 25706 consensus_queue.cc:1048] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:10:50.906599 25779 consensus_queue.cc:237] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.899230 25768 consensus_queue.cc:1059] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:50.907927 25472 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a73c63415df44d288d7637181fd9453; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:50.909390 25779 raft_consensus.cc:2749] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.916096 25580 raft_consensus.cc:2468] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:50.912782 25768 raft_consensus.cc:3055] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.918941 25768 raft_consensus.cc:740] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:50.920284 25768 consensus_queue.cc:260] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.921509 25768 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.935992 25799 consensus_queue.cc:1048] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.936239 25403 catalog_manager.cc:5697] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 1 to 2, leader changed from 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2) to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.965873 25823 consensus_queue.cc:1048] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.975131 25779 consensus_queue.cc:1048] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.981315 25823 raft_consensus.cc:993] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: : Instructing follower 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:50.981715 25779 raft_consensus.cc:1081] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Signalling peer 2729cc2a19a74e9dbd7ee5339d3cc27c to start an election
I20260709 13:10:50.983023 25582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cc1883577e848dbb8769a897328350d"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
 from {username='slave'} at 127.0.0.1:54138
I20260709 13:10:50.983466 25582 raft_consensus.cc:493] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.983739 25582 raft_consensus.cc:3060] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.988391 25582 raft_consensus.cc:515] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.989883 25582 leader_election.cc:290] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:50.990815 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc1883577e848dbb8769a897328350d" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:50.990717 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc1883577e848dbb8769a897328350d" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:50.991439 25655 raft_consensus.cc:3060] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.991679 25504 raft_consensus.cc:3055] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.992061 25504 raft_consensus.cc:740] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:50.992806 25504 consensus_queue.cc:260] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:50.994050 25504 raft_consensus.cc:3060] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.996419 25655 raft_consensus.cc:2468] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:50.997328 25548 leader_election.cc:304] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:50.998047 25799 raft_consensus.cc:2804] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.998418 25799 raft_consensus.cc:697] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:50.999142 25504 raft_consensus.cc:2468] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:50.999099 25799 consensus_queue.cc:237] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:51.005674 25402 catalog_manager.cc:5697] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 1 to 2, leader changed from 5a73c63415df44d288d7637181fd9453 (127.15.6.1) to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 2 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.048673 25799 consensus_queue.cc:1048] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.052970 25799 consensus_queue.cc:1048] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.063011 25840 consensus_queue.cc:1048] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.067198 25840 consensus_queue.cc:1048] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.079425 25841 raft_consensus.cc:993] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: : Instructing follower 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:51.079949 25842 raft_consensus.cc:1081] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Signalling peer 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:51.081256 25656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:36704
I20260709 13:10:51.081663 25656 raft_consensus.cc:493] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.081941 25656 raft_consensus.cc:3060] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.088855 25656 raft_consensus.cc:515] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:51.090341 25656 leader_election.cc:290] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 2 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:51.090960 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:51.091109 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123fd53c54ab4f0e91085dc28ff17971" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:51.091558 25504 raft_consensus.cc:3060] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.091634 25582 raft_consensus.cc:3055] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:51.092053 25582 raft_consensus.cc:740] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:51.092732 25582 consensus_queue.cc:260] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:51.093504 25582 raft_consensus.cc:3060] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.095628 25504 raft_consensus.cc:2468] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 2.
I20260709 13:10:51.096570 25620 leader_election.cc:304] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:51.097219 25768 raft_consensus.cc:2804] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:51.097579 25768 raft_consensus.cc:697] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 2 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:51.098070 25582 raft_consensus.cc:2468] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 2.
I20260709 13:10:51.098313 25768 consensus_queue.cc:237] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:51.104702 25403 catalog_manager.cc:5697] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 1 to 2, leader changed from 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2) to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.114389 25779 consensus_queue.cc:1048] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.123519 25846 consensus_queue.cc:1048] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.171715 25856 consensus_queue.cc:1048] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.180940 25856 consensus_queue.cc:1048] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:51.251744 25840 raft_consensus.cc:993] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: : Instructing follower 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:51.252187 25842 raft_consensus.cc:1081] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Signalling peer 5a73c63415df44d288d7637181fd9453 to start an election
I20260709 13:10:51.253520 25504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
 from {username='slave'} at 127.0.0.1:55286
I20260709 13:10:51.254021 25504 raft_consensus.cc:493] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.254360 25504 raft_consensus.cc:3060] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.258702 25504 raft_consensus.cc:515] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:51.259986 25504 leader_election.cc:290] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:51.260670 25582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:51.261001 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eee54ac6e9414b94f2d0d550338839" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:51.261303 25582 raft_consensus.cc:3055] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:51.261590 25656 raft_consensus.cc:3060] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.261601 25582 raft_consensus.cc:740] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:51.262467 25582 consensus_queue.cc:260] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:51.263566 25582 raft_consensus.cc:3060] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.268018 25656 raft_consensus.cc:2468] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:51.269140 25473 leader_election.cc:304] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:51.269397 25582 raft_consensus.cc:2468] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:51.269794 25856 raft_consensus.cc:2804] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:51.270198 25856 raft_consensus.cc:697] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:51.270887 25856 consensus_queue.cc:237] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:51.276450 25401 catalog_manager.cc:5697] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 1 to 2, leader changed from 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2) to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.360555 25582 raft_consensus.cc:1275] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.361768 25856 consensus_queue.cc:1048] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.370433 25655 raft_consensus.cc:1275] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.371950 25846 consensus_queue.cc:1048] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.480116 25655 raft_consensus.cc:1275] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.481276 25842 consensus_queue.cc:1048] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.494068 25504 raft_consensus.cc:1275] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Refusing update from remote peer 2729cc2a19a74e9dbd7ee5339d3cc27c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.495654 25841 consensus_queue.cc:1048] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.578109 25504 raft_consensus.cc:1275] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.579212 25768 consensus_queue.cc:1048] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.585994 25582 raft_consensus.cc:1275] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.587343 25860 consensus_queue.cc:1048] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.827756 25655 raft_consensus.cc:1275] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.829201 25856 consensus_queue.cc:1048] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.836906 25582 raft_consensus.cc:1275] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.838553 25846 consensus_queue.cc:1048] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.390488 25841 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 780fb48ea3e1431d9e16af33af84f302)
I20260709 13:10:52.390910 25841 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:52.392504 25841 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:52.393067 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453" is_pre_election: true
I20260709 13:10:52.393362 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:52.393674 25504 raft_consensus.cc:2393] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in current term 2: Already voted for candidate 5a73c63415df44d288d7637181fd9453 in this term.
I20260709 13:10:52.393983 25656 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:52.394973 25548 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 5a73c63415df44d288d7637181fd9453
I20260709 13:10:52.395543 25841 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:52.395838 25841 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 780fb48ea3e1431d9e16af33af84f302)
I20260709 13:10:52.396090 25841 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:52.400820 25841 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:52.402292 25841 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:52.402875 25504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:52.403266 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:52.403512 25504 raft_consensus.cc:2393] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in current term 2: Already voted for candidate 5a73c63415df44d288d7637181fd9453 in this term.
I20260709 13:10:52.408253 25656 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2729cc2a19a74e9dbd7ee5339d3cc27c in term 2.
I20260709 13:10:52.409066 25548 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 5a73c63415df44d288d7637181fd9453
I20260709 13:10:52.409610 25841 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:52.409979 25841 raft_consensus.cc:697] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Becoming Leader. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:52.410535 25841 consensus_queue.cc:237] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:52.418298 25403 catalog_manager.cc:5697] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c reported cstate change: term changed from 1 to 2, leader changed from 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3) to 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2). New cstate: current_term: 2 leader_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.648378 25823 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.648803 25823 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:52.650904 25823 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:52.651234 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" is_pre_election: true
I20260709 13:10:52.651645 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302" is_pre_election: true
I20260709 13:10:52.652307 25656 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 2.
I20260709 13:10:52.653280 25473 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:52.653996 25823 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:52.654292 25823 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.654536 25823 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.659117 25823 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:52.660586 25823 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 3 election: Requested vote from peers 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661), 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3:34193)
I20260709 13:10:52.661288 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:52.661435 25656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "5a73c63415df44d288d7637181fd9453" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
I20260709 13:10:52.661976 25656 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.666448 25656 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a73c63415df44d288d7637181fd9453 in term 3.
I20260709 13:10:52.667253 25473 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 2729cc2a19a74e9dbd7ee5339d3cc27c
I20260709 13:10:52.667832 25823 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:52.668177 25823 raft_consensus.cc:697] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 LEADER]: Becoming Leader. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:52.668774 25823 consensus_queue.cc:237] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:52.675839 25403 catalog_manager.cc:5697] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 reported cstate change: term changed from 2 to 3, leader changed from 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2) to 5a73c63415df44d288d7637181fd9453 (127.15.6.1). New cstate: current_term: 3 leader_uuid: "5a73c63415df44d288d7637181fd9453" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.915192 25504 raft_consensus.cc:1240] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 LEADER]: Rejecting Update request from peer 2729cc2a19a74e9dbd7ee5339d3cc27c for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:52.916361 25841 consensus_queue.cc:1059] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.916940 25841 consensus_queue.cc:1243] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [LEADER]: Peer 5a73c63415df44d288d7637181fd9453 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:10:52.917270 25840 raft_consensus.cc:3055] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:52.917548 25840 raft_consensus.cc:740] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:52.918154 25840 consensus_queue.cc:260] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:52.918983 25840 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.216677 25656 raft_consensus.cc:1275] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:53.217795 25823 consensus_queue.cc:1048] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.229876 25580 raft_consensus.cc:1275] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Refusing update from remote peer 5a73c63415df44d288d7637181fd9453: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:53.230396 25580 pending_rounds.cc:85] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Aborting all ops after (but not including) 1
I20260709 13:10:53.230691 25580 pending_rounds.cc:107] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:53.231019 25580 raft_consensus.cc:2889] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.232565 25870 consensus_queue.cc:1048] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:53.905913 25401 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48112:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:53.922945 25401 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48112:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:53.967657 15384 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:54.101281 25903 tablet.cc:1724] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.104420 25905 tablet.cc:1724] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.183079 25912 tablet.cc:1724] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:54.251295 25472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:38661, user_credentials={real_user=slave}} blocked reactor thread for 109397us
W20260709 13:10:54.258073 25548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:34193, user_credentials={real_user=slave}} blocked reactor thread for 107916us
W20260709 13:10:54.258517 25533 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:f519a5da93d044ec8b20935e9ec8fe79)
W20260709 13:10:54.272001 25533 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:f519a5da93d044ec8b20935e9ec8fe79)
W20260709 13:10:54.273181 25533 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:f519a5da93d044ec8b20935e9ec8fe79)
W20260709 13:10:54.267936 25893 log.cc:927] Time spent T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:10:54.268471 25894 log.cc:927] Time spent T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:10:54.277001 25914 log.cc:927] Time spent T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:10:54.147730 25911 tablet.cc:1724] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.312224 25503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
mode: GRACEFUL
new_leader_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:10:54.312852 25503 raft_consensus.cc:606] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Received request to transfer leadership to TS 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:54.336182 25903 tablet.cc:1724] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.336118 25928 tablet.cc:1724] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.330582 25930 tablet.cc:1724] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.388856 25503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
mode: GRACEFUL
new_leader_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:10:54.398667 25939 tablet.cc:1724] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.384900 25920 tablet.cc:1724] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.408735 25503 raft_consensus.cc:606] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 LEADER]: Received request to transfer leadership to TS 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:54.429263 25912 tablet.cc:1724] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.434059 25940 tablet.cc:1724] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.458504 25905 tablet.cc:1724] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.466739 15384 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:54.459363 25939 tablet.cc:1724] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:54.467022 25932 log.cc:927] Time spent T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:54.467443 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.471182 25928 tablet.cc:1724] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.480340 25943 tablet.cc:1724] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.483777 25870 raft_consensus.cc:993] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: : Instructing follower 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.484256 25870 raft_consensus.cc:1081] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Signalling peer 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.491453 25654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:36702
I20260709 13:10:54.493412 25911 tablet.cc:1724] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.496538 25654 raft_consensus.cc:493] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.496976 25654 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.496433 25903 tablet.cc:1724] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.504058 25920 tablet.cc:1724] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.511914 25937 tablet.cc:1724] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.512735 25912 tablet.cc:1724] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.511271 25930 tablet.cc:1724] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.545354 25654 raft_consensus.cc:515] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.545483 25940 tablet.cc:1724] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.553397 25946 tablet.cc:1724] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.560904 25937 tablet.cc:1724] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.565384 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:54.566004 25505 raft_consensus.cc:3055] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.566289 25505 raft_consensus.cc:740] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:54.567039 25505 consensus_queue.cc:260] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.568248 25505 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.568764 25654 leader_election.cc:290] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 3 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:54.570247 25943 tablet.cc:1724] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.572958 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead639d421314b5f9108d5daa78e30a0" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:54.573523 25580 raft_consensus.cc:3060] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.581862 25580 raft_consensus.cc:2468] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 3.
I20260709 13:10:54.583707 25621 leader_election.cc:304] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:54.566401 25928 tablet.cc:1724] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.586544 25860 raft_consensus.cc:2804] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:54.587023 25860 raft_consensus.cc:697] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 3 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:54.587818 25860 consensus_queue.cc:237] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.591570 25946 tablet.cc:1724] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:54.599224 25505 raft_consensus.cc:2468] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 3.
I20260709 13:10:54.608775 25402 catalog_manager.cc:5697] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 2 to 3, leader changed from 5a73c63415df44d288d7637181fd9453 (127.15.6.1) to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.614817 25580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2976a399b1541ebaf14c16305465752"
dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
mode: GRACEFUL
new_leader_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:57828
I20260709 13:10:54.615447 25580 raft_consensus.cc:606] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Received request to transfer leadership to TS 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:54.618188 25505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09"
dest_uuid: "5a73c63415df44d288d7637181fd9453"
mode: GRACEFUL
new_leader_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:55424
I20260709 13:10:54.618752 25505 raft_consensus.cc:606] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Received request to transfer leadership to TS 780fb48ea3e1431d9e16af33af84f302
I20260709 13:10:54.619982 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:54.620568 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:54.623396 25401 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708: soft_deleted_table [id=f70e9794004e4348be3e6e824337a76f] alter complete (version 1)
I20260709 13:10:54.662829 25873 raft_consensus.cc:993] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: : Instructing follower 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.663336 25931 raft_consensus.cc:1081] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 LEADER]: Signalling peer 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.664654 25654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:36702
I20260709 13:10:54.665089 25654 raft_consensus.cc:493] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.665382 25654 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.669970 25654 raft_consensus.cc:515] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.671437 25654 leader_election.cc:290] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 4 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:54.672073 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:54.672412 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f519a5da93d044ec8b20935e9ec8fe79" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:54.672648 25505 raft_consensus.cc:3055] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:54.672930 25580 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.672986 25505 raft_consensus.cc:740] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:54.673738 25505 consensus_queue.cc:260] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.674659 25505 raft_consensus.cc:3060] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.677386 25580 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 4.
I20260709 13:10:54.678313 25621 leader_election.cc:304] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:54.679021 25860 raft_consensus.cc:2804] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:54.679382 25860 raft_consensus.cc:697] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 4 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:54.679493 25505 raft_consensus.cc:2468] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 4.
I20260709 13:10:54.680135 25860 consensus_queue.cc:237] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.685983 25401 catalog_manager.cc:5697] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 3 to 4, leader changed from 5a73c63415df44d288d7637181fd9453 (127.15.6.1) to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 4 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.750298 25915 raft_consensus.cc:993] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c: : Instructing follower 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.750799 25926 raft_consensus.cc:1081] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Signalling peer 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.752096 25654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2976a399b1541ebaf14c16305465752"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:36704
I20260709 13:10:54.752526 25654 raft_consensus.cc:493] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.752801 25654 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.757658 25654 raft_consensus.cc:515] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.759101 25654 leader_election.cc:290] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 3 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:54.759821 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:54.760114 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2976a399b1541ebaf14c16305465752" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:54.760461 25505 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.760715 25580 raft_consensus.cc:3055] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.761046 25580 raft_consensus.cc:740] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2729cc2a19a74e9dbd7ee5339d3cc27c, State: Running, Role: LEADER
I20260709 13:10:54.761799 25580 consensus_queue.cc:260] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.762991 25580 raft_consensus.cc:3060] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.766846 25505 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 3.
I20260709 13:10:54.767867 25620 leader_election.cc:304] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a73c63415df44d288d7637181fd9453, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:54.768476 25860 raft_consensus.cc:2804] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:54.768926 25860 raft_consensus.cc:697] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 3 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:54.768939 25580 raft_consensus.cc:2468] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 3.
I20260709 13:10:54.769749 25860 consensus_queue.cc:237] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.776300 25401 catalog_manager.cc:5697] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 2 to 3, leader changed from 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2) to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.955271 25873 raft_consensus.cc:993] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453: : Instructing follower 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.955849 25873 raft_consensus.cc:1081] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Signalling peer 780fb48ea3e1431d9e16af33af84f302 to start an election
I20260709 13:10:54.957423 25655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09"
dest_uuid: "780fb48ea3e1431d9e16af33af84f302"
 from {username='slave'} at 127.0.0.1:36702
I20260709 13:10:54.957912 25655 raft_consensus.cc:493] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.958279 25655 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.962512 25655 raft_consensus.cc:515] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.964231 25655 leader_election.cc:290] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 3 election: Requested vote from peers 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445), 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661)
I20260709 13:10:54.964857 25505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a73c63415df44d288d7637181fd9453"
I20260709 13:10:54.965525 25505 raft_consensus.cc:3055] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.965854 25505 raft_consensus.cc:740] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a73c63415df44d288d7637181fd9453, State: Running, Role: LEADER
I20260709 13:10:54.965538 25580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3d747c93c74d11afd520b5cbb00f09" candidate_uuid: "780fb48ea3e1431d9e16af33af84f302" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c"
I20260709 13:10:54.966563 25505 consensus_queue.cc:260] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.967049 25580 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.967629 25505 raft_consensus.cc:3060] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.971102 25580 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 3.
I20260709 13:10:54.971954 25621 leader_election.cc:304] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2729cc2a19a74e9dbd7ee5339d3cc27c, 780fb48ea3e1431d9e16af33af84f302; no voters: 
I20260709 13:10:54.972003 25505 raft_consensus.cc:2468] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780fb48ea3e1431d9e16af33af84f302 in term 3.
I20260709 13:10:54.972575 25860 raft_consensus.cc:2804] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:54.973047 25860 raft_consensus.cc:697] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 3 LEADER]: Becoming Leader. State: Replica: 780fb48ea3e1431d9e16af33af84f302, State: Running, Role: LEADER
I20260709 13:10:54.973701 25860 consensus_queue.cc:237] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } }
I20260709 13:10:54.979701 25580 raft_consensus.cc:1275] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:54.980834 25860 consensus_queue.cc:1048] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:54.980842 25401 catalog_manager.cc:5697] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 reported cstate change: term changed from 2 to 3, leader changed from 5a73c63415df44d288d7637181fd9453 (127.15.6.1) to 780fb48ea3e1431d9e16af33af84f302 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "780fb48ea3e1431d9e16af33af84f302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780fb48ea3e1431d9e16af33af84f302" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.989846 25505 raft_consensus.cc:1275] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:54.991266 25860 consensus_queue.cc:1048] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:55.079406 25580 raft_consensus.cc:1275] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 4 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:55.080433 25860 consensus_queue.cc:1048] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:55.086977 25505 raft_consensus.cc:1275] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 4 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:55.088791 25860 consensus_queue.cc:1048] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:55.161458 25505 raft_consensus.cc:1275] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.162566 25860 consensus_queue.cc:1048] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:55.170642 25580 raft_consensus.cc:1275] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.172835 25957 consensus_queue.cc:1048] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:55.464998 25505 raft_consensus.cc:1275] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.466748 25957 consensus_queue.cc:1048] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a73c63415df44d288d7637181fd9453" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.477478 25580 raft_consensus.cc:1275] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Refusing update from remote peer 780fb48ea3e1431d9e16af33af84f302: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.479525 25860 consensus_queue.cc:1048] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2729cc2a19a74e9dbd7ee5339d3cc27c" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:55.673621 15384 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:55.678418 15384 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:55.678768 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:55.683238 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:55.683552 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:56.709340 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
I20260709 13:10:56.738744 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:56.739495 15384 tablet_replica.cc:333] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.740640 15384 raft_consensus.cc:2243] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.741778 15384 raft_consensus.cc:2272] T abe9de326bde4f54b3330e2debb90605 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:56.742120 25546 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:10:56.745136 15384 tablet_replica.cc:333] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
W20260709 13:10:56.745285 25546 consensus_peers.cc:597] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.746189 15384 raft_consensus.cc:2243] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.746687 15384 raft_consensus.cc:2272] T f519a5da93d044ec8b20935e9ec8fe79 P 5a73c63415df44d288d7637181fd9453 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.748962 15384 tablet_replica.cc:333] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.749790 15384 raft_consensus.cc:2243] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.750265 15384 raft_consensus.cc:2272] T ead639d421314b5f9108d5daa78e30a0 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.752561 15384 tablet_replica.cc:333] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.753325 15384 raft_consensus.cc:2243] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.754328 15384 raft_consensus.cc:2272] T 34eee54ac6e9414b94f2d0d550338839 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:56.756283 25546 consensus_peers.cc:597] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.757612 15384 tablet_replica.cc:333] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.758517 15384 raft_consensus.cc:2243] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.759127 15384 raft_consensus.cc:2272] T 4f32422564274edbbb9fc28693166301 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.761561 15384 tablet_replica.cc:333] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.762213 15384 raft_consensus.cc:2243] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.762692 15384 raft_consensus.cc:2272] T d4f6225a0f474e6e9472c1e3c4536797 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.765123 15384 tablet_replica.cc:333] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.765648 15384 raft_consensus.cc:2243] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.766577 15384 raft_consensus.cc:2272] T 94dba1d9c0384998b9239239f9cda908 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.771454 15384 tablet_replica.cc:333] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.772161 15384 raft_consensus.cc:2243] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.772657 15384 raft_consensus.cc:2272] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.775206 15384 tablet_replica.cc:333] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.775731 15384 raft_consensus.cc:2243] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.776255 15384 raft_consensus.cc:2272] T 123fd53c54ab4f0e91085dc28ff17971 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.778692 15384 tablet_replica.cc:333] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.779299 15384 raft_consensus.cc:2243] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.779865 15384 raft_consensus.cc:2272] T c2976a399b1541ebaf14c16305465752 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.782068 15384 tablet_replica.cc:333] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.782658 15384 raft_consensus.cc:2243] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.783775 15384 raft_consensus.cc:2272] T d4ea36ec13074727aa4a7b3890cb9c52 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.786906 15384 tablet_replica.cc:333] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
W20260709 13:10:56.787410 25620 consensus_peers.cc:597] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.787567 15384 raft_consensus.cc:2243] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.788143 15384 raft_consensus.cc:2272] T da3d747c93c74d11afd520b5cbb00f09 P 5a73c63415df44d288d7637181fd9453 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.790455 15384 tablet_replica.cc:333] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.790962 15384 raft_consensus.cc:2243] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.791857 15384 raft_consensus.cc:2272] T 60cd0401c21747449dd137981ede25bd P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.794297 15384 tablet_replica.cc:333] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.794790 15384 raft_consensus.cc:2243] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.795320 15384 raft_consensus.cc:2272] T 20f5d95edbaf47d89bca383608303eb0 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.797644 15384 tablet_replica.cc:333] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.798156 15384 raft_consensus.cc:2243] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.798684 15384 raft_consensus.cc:2272] T 3cc1883577e848dbb8769a897328350d P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.800792 15384 tablet_replica.cc:333] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.801285 15384 raft_consensus.cc:2243] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.802142 15384 raft_consensus.cc:2272] T b409484eb99141c18c2cf53452f51367 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.805408 15384 tablet_replica.cc:333] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
W20260709 13:10:56.805732 25546 consensus_peers.cc:597] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.805931 15384 raft_consensus.cc:2243] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.806499 15384 raft_consensus.cc:2272] T 66dd4c1aca514e0fabd5e62af1a77f09 P 5a73c63415df44d288d7637181fd9453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.808790 15384 tablet_replica.cc:333] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453: stopping tablet replica
I20260709 13:10:56.809244 15384 raft_consensus.cc:2243] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.809684 15384 raft_consensus.cc:2272] T cf143ba7d8ba4b9980f471980b1901b1 P 5a73c63415df44d288d7637181fd9453 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.854035 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
W20260709 13:10:56.865643 25620 consensus_peers.cc:597] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.900074 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
W20260709 13:10:56.905406 25620 consensus_peers.cc:597] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.929193 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:56.929857 15384 tablet_replica.cc:333] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.930730 15384 raft_consensus.cc:2243] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.931254 15384 raft_consensus.cc:2272] T abe9de326bde4f54b3330e2debb90605 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.933475 15384 tablet_replica.cc:333] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.934085 15384 raft_consensus.cc:2243] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.934859 15384 raft_consensus.cc:2272] T d4f6225a0f474e6e9472c1e3c4536797 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.936830 15384 tablet_replica.cc:333] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.937368 15384 raft_consensus.cc:2243] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.937873 15384 raft_consensus.cc:2272] T f519a5da93d044ec8b20935e9ec8fe79 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.940703 15384 tablet_replica.cc:333] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.941414 15384 raft_consensus.cc:2243] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:56.941992 25621 consensus_peers.cc:597] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Couldn't send request to peer 2729cc2a19a74e9dbd7ee5339d3cc27c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.942184 15384 raft_consensus.cc:2272] T ead639d421314b5f9108d5daa78e30a0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.944432 15384 tablet_replica.cc:333] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.944959 15384 raft_consensus.cc:2243] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.945688 15384 raft_consensus.cc:2272] T cf143ba7d8ba4b9980f471980b1901b1 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.947726 15384 tablet_replica.cc:333] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.948268 15384 raft_consensus.cc:2243] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.948658 15384 raft_consensus.cc:2272] T 66dd4c1aca514e0fabd5e62af1a77f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.950680 15384 tablet_replica.cc:333] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.951174 15384 raft_consensus.cc:2243] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.951623 15384 raft_consensus.cc:2272] T 123fd53c54ab4f0e91085dc28ff17971 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.953642 15384 tablet_replica.cc:333] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.954133 15384 raft_consensus.cc:2243] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.954524 15384 raft_consensus.cc:2272] T c2976a399b1541ebaf14c16305465752 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.956941 15384 tablet_replica.cc:333] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.957624 15384 raft_consensus.cc:2243] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.958089 15384 raft_consensus.cc:2272] T 60cd0401c21747449dd137981ede25bd P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.960224 15384 tablet_replica.cc:333] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.960791 15384 raft_consensus.cc:2243] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.961417 15384 raft_consensus.cc:2272] T d4ea36ec13074727aa4a7b3890cb9c52 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.964229 15384 tablet_replica.cc:333] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.964761 15384 raft_consensus.cc:2243] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.965168 15384 raft_consensus.cc:2272] T da3d747c93c74d11afd520b5cbb00f09 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.967097 15384 tablet_replica.cc:333] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.967599 15384 raft_consensus.cc:2243] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.968333 15384 raft_consensus.cc:2272] T 4f32422564274edbbb9fc28693166301 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.970217 15384 tablet_replica.cc:333] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.970683 15384 raft_consensus.cc:2243] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.971143 15384 raft_consensus.cc:2272] T 34eee54ac6e9414b94f2d0d550338839 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.973011 15384 tablet_replica.cc:333] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.973464 15384 raft_consensus.cc:2243] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.974180 15384 raft_consensus.cc:2272] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.976117 15384 tablet_replica.cc:333] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.976560 15384 raft_consensus.cc:2243] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.976949 15384 raft_consensus.cc:2272] T 94dba1d9c0384998b9239239f9cda908 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.978929 15384 tablet_replica.cc:333] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.979337 15384 raft_consensus.cc:2243] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.980084 15384 raft_consensus.cc:2272] T 20f5d95edbaf47d89bca383608303eb0 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.982062 15384 tablet_replica.cc:333] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.982517 15384 raft_consensus.cc:2243] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:56.983378 15384 raft_consensus.cc:2272] T 3cc1883577e848dbb8769a897328350d P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.985304 15384 tablet_replica.cc:333] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c: stopping tablet replica
I20260709 13:10:56.985698 15384 raft_consensus.cc:2243] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.986076 15384 raft_consensus.cc:2272] T b409484eb99141c18c2cf53452f51367 P 2729cc2a19a74e9dbd7ee5339d3cc27c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:57.000957 25620 consensus_peers.cc:597] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.027995 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
W20260709 13:10:57.057219 25621 consensus_peers.cc:597] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 2729cc2a19a74e9dbd7ee5339d3cc27c (127.15.6.2:38661): Couldn't send request to peer 2729cc2a19a74e9dbd7ee5339d3cc27c. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.2:38661: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.064754 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
I20260709 13:10:57.090200 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:57.090844 15384 tablet_replica.cc:333] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.091491 15384 raft_consensus.cc:2243] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.092041 15384 raft_consensus.cc:2272] T abe9de326bde4f54b3330e2debb90605 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.094484 15384 tablet_replica.cc:333] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.095067 15384 raft_consensus.cc:2243] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.095643 15384 raft_consensus.cc:2272] T d4f6225a0f474e6e9472c1e3c4536797 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.097934 15384 tablet_replica.cc:333] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
W20260709 13:10:57.097833 25620 consensus_peers.cc:597] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.098618 15384 raft_consensus.cc:2243] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.099400 15384 raft_consensus.cc:2272] T f519a5da93d044ec8b20935e9ec8fe79 P 780fb48ea3e1431d9e16af33af84f302 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.101492 15384 tablet_replica.cc:333] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.102006 15384 raft_consensus.cc:2243] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.102425 15384 raft_consensus.cc:2272] T 34eee54ac6e9414b94f2d0d550338839 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.104338 15384 tablet_replica.cc:333] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.104879 15384 raft_consensus.cc:2243] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.105310 15384 raft_consensus.cc:2272] T 4f32422564274edbbb9fc28693166301 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.107434 15384 tablet_replica.cc:333] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.108093 15384 raft_consensus.cc:2243] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.109191 15384 raft_consensus.cc:2272] T ead639d421314b5f9108d5daa78e30a0 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:57.111284 25620 consensus_peers.cc:597] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 -> Peer 5a73c63415df44d288d7637181fd9453 (127.15.6.1:34445): Couldn't send request to peer 5a73c63415df44d288d7637181fd9453. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.111436 15384 tablet_replica.cc:333] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.112113 15384 raft_consensus.cc:2243] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.112864 15384 raft_consensus.cc:2272] T 66dd4c1aca514e0fabd5e62af1a77f09 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.114851 15384 tablet_replica.cc:333] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.115351 15384 raft_consensus.cc:2243] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.115841 15384 raft_consensus.cc:2272] T cf143ba7d8ba4b9980f471980b1901b1 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.117938 15384 tablet_replica.cc:333] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.118450 15384 raft_consensus.cc:2243] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.118870 15384 raft_consensus.cc:2272] T d4ea36ec13074727aa4a7b3890cb9c52 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.120893 15384 tablet_replica.cc:333] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.121362 15384 raft_consensus.cc:2243] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.122051 15384 raft_consensus.cc:2272] T da3d747c93c74d11afd520b5cbb00f09 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.123993 15384 tablet_replica.cc:333] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.124526 15384 raft_consensus.cc:2243] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.124928 15384 raft_consensus.cc:2272] T 60cd0401c21747449dd137981ede25bd P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.126998 15384 tablet_replica.cc:333] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.127457 15384 raft_consensus.cc:2243] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.128224 15384 raft_consensus.cc:2272] T 123fd53c54ab4f0e91085dc28ff17971 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.130137 15384 tablet_replica.cc:333] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.130625 15384 raft_consensus.cc:2243] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.131335 15384 raft_consensus.cc:2272] T c2976a399b1541ebaf14c16305465752 P 780fb48ea3e1431d9e16af33af84f302 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.133247 15384 tablet_replica.cc:333] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.133734 15384 raft_consensus.cc:2243] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.134224 15384 raft_consensus.cc:2272] T 20f5d95edbaf47d89bca383608303eb0 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.136219 15384 tablet_replica.cc:333] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.136685 15384 raft_consensus.cc:2243] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.137131 15384 raft_consensus.cc:2272] T 3cc1883577e848dbb8769a897328350d P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.138897 15384 tablet_replica.cc:333] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.139418 15384 raft_consensus.cc:2243] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.139863 15384 raft_consensus.cc:2272] T b409484eb99141c18c2cf53452f51367 P 780fb48ea3e1431d9e16af33af84f302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.141795 15384 tablet_replica.cc:333] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.142285 15384 raft_consensus.cc:2243] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.142711 15384 raft_consensus.cc:2272] T 71ce9cbd4c7b495d8c571b0ac6c9a0bf P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.144629 15384 tablet_replica.cc:333] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302: stopping tablet replica
I20260709 13:10:57.145053 15384 raft_consensus.cc:2243] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.145466 15384 raft_consensus.cc:2272] T 94dba1d9c0384998b9239239f9cda908 P 780fb48ea3e1431d9e16af33af84f302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.182891 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
I20260709 13:10:57.217545 15384 master.cc:562] Master@127.15.6.62:40893 shutting down...
I20260709 13:10:57.236968 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.237538 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.237854 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P 033577ac72e64d96b07e88f08d512708: stopping tablet replica
I20260709 13:10:57.257423 15384 master.cc:584] Master@127.15.6.62:40893 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12002 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:57.305752 15384 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.6.62:42167
I20260709 13:10:57.306797 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:57.312852 25969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:57.313236 25970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:57.313642 25972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:57.313731 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:57.314770 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:57.314950 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:57.315099 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602657315081 us; error 0 us; skew 500 ppm
I20260709 13:10:57.315557 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:57.317840 15384 webserver.cc:533] Webserver started at http://127.15.6.62:36297/ using document root <none> and password file <none>
I20260709 13:10:57.318301 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:57.318470 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:57.318711 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:57.319759 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/master-0-root/instance:
uuid: "32bb2df2938b4afdbe65dd30e3cb9df9"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.323756 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:57.326871 25977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.327522 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:57.327765 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/master-0-root
uuid: "32bb2df2938b4afdbe65dd30e3cb9df9"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.328044 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:57.353001 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:57.354131 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:57.389566 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.62:42167
I20260709 13:10:57.389668 26028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.62:42167 every 8 connection(s)
I20260709 13:10:57.393208 26029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.403810 26029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9: Bootstrap starting.
I20260709 13:10:57.408419 26029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.412214 26029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9: No bootstrap required, opened a new log
I20260709 13:10:57.414165 26029 raft_consensus.cc:359] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" member_type: VOTER }
I20260709 13:10:57.414505 26029 raft_consensus.cc:385] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:57.414677 26029 raft_consensus.cc:740] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32bb2df2938b4afdbe65dd30e3cb9df9, State: Initialized, Role: FOLLOWER
I20260709 13:10:57.415163 26029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" member_type: VOTER }
I20260709 13:10:57.415551 26029 raft_consensus.cc:399] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:57.415732 26029 raft_consensus.cc:493] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:57.415983 26029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:57.420089 26029 raft_consensus.cc:515] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" member_type: VOTER }
I20260709 13:10:57.420539 26029 leader_election.cc:304] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32bb2df2938b4afdbe65dd30e3cb9df9; no voters: 
I20260709 13:10:57.421778 26029 leader_election.cc:290] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:57.422267 26032 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:57.423995 26032 raft_consensus.cc:697] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 1 LEADER]: Becoming Leader. State: Replica: 32bb2df2938b4afdbe65dd30e3cb9df9, State: Running, Role: LEADER
I20260709 13:10:57.424893 26029 sys_catalog.cc:565] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:57.424753 26032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" member_type: VOTER }
I20260709 13:10:57.431442 26033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" member_type: VOTER } }
I20260709 13:10:57.431993 26033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:57.432610 26034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32bb2df2938b4afdbe65dd30e3cb9df9. Latest consensus state: current_term: 1 leader_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bb2df2938b4afdbe65dd30e3cb9df9" member_type: VOTER } }
I20260709 13:10:57.433240 26034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:57.439867 15384 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260709 13:10:57.442590 26048 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260709 13:10:57.442811 26048 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260709 13:10:57.443130 26041 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:57.447273 26041 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:57.455070 26041 catalog_manager.cc:1383] Generated new cluster ID: 25f45c479e89482e981a4e1161cde60f
I20260709 13:10:57.455317 26041 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:57.476701 26041 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:57.478035 26041 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:57.489488 26041 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9: Generated new TSK 0
I20260709 13:10:57.490062 26041 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:57.505599 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:57.511193 26050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:57.511969 26051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:57.513129 26053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:57.513806 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:57.514604 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:57.514786 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:57.514937 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602657514918 us; error 0 us; skew 500 ppm
I20260709 13:10:57.515408 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:57.517385 15384 webserver.cc:533] Webserver started at http://127.15.6.1:37745/ using document root <none> and password file <none>
I20260709 13:10:57.517817 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:57.517984 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:57.518224 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:57.519181 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-0-root/instance:
uuid: "66542e9b217f43d7ae827345bc7a93b5"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.523257 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:57.526108 26058 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.526837 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:57.527108 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-0-root
uuid: "66542e9b217f43d7ae827345bc7a93b5"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.527359 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:57.537961 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:57.538990 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:57.540299 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:57.542320 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:57.542495 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.542701 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:57.542857 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.589099 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.1:32973
I20260709 13:10:57.589201 26120 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.1:32973 every 8 connection(s)
I20260709 13:10:57.593858 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:57.599968 26125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:57.600571 26126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:57.604292 26128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:57.605731 15384 server_base.cc:1061] running on GCE node
I20260709 13:10:57.605852 26121 heartbeater.cc:344] Connected to a master server at 127.15.6.62:42167
I20260709 13:10:57.606297 26121 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:57.606961 26121 heartbeater.cc:507] Master 127.15.6.62:42167 requested a full tablet report, sending...
I20260709 13:10:57.607043 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:57.607357 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:57.607551 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602657607528 us; error 0 us; skew 500 ppm
I20260709 13:10:57.608314 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:57.608953 25994 ts_manager.cc:194] Registered new tserver with Master: 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973)
I20260709 13:10:57.610617 15384 webserver.cc:533] Webserver started at http://127.15.6.2:36567/ using document root <none> and password file <none>
I20260709 13:10:57.610972 25994 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37496
I20260709 13:10:57.611123 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:57.611424 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:57.611676 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:57.612749 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-1-root/instance:
uuid: "8fdbd6ca12394ae4b0d73c5122292442"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.616817 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:57.619850 26133 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.620551 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:57.620811 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-1-root
uuid: "8fdbd6ca12394ae4b0d73c5122292442"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.621049 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:57.649441 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:57.650490 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:57.651876 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:57.653878 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:57.654057 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.654271 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:57.654414 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.690686 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.2:44095
I20260709 13:10:57.690790 26195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.2:44095 every 8 connection(s)
I20260709 13:10:57.695116 15384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:57.701660 26199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:57.702520 26200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:57.705016 15384 server_base.cc:1061] running on GCE node
W20260709 13:10:57.706319 26203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:57.706701 26196 heartbeater.cc:344] Connected to a master server at 127.15.6.62:42167
I20260709 13:10:57.707113 26196 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:57.707262 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:57.707545 15384 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:57.707705 15384 hybrid_clock.cc:648] HybridClock initialized: now 1783602657707688 us; error 0 us; skew 500 ppm
I20260709 13:10:57.707839 26196 heartbeater.cc:507] Master 127.15.6.62:42167 requested a full tablet report, sending...
I20260709 13:10:57.708294 15384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:57.709931 25994 ts_manager.cc:194] Registered new tserver with Master: 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:57.710839 15384 webserver.cc:533] Webserver started at http://127.15.6.3:44457/ using document root <none> and password file <none>
I20260709 13:10:57.711488 15384 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:57.711723 15384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:57.711779 25994 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37506
I20260709 13:10:57.712122 15384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:57.713454 15384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-2-root/instance:
uuid: "2e8492604e174aeabbc9c46ebb659dc3"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.717754 15384 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:57.720805 26207 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.721449 15384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:57.721745 15384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-2-root
uuid: "2e8492604e174aeabbc9c46ebb659dc3"
format_stamp: "Formatted at 2026-07-09 13:10:57 on dist-test-slave-pqzm"
I20260709 13:10:57.721987 15384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3VUGGS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602337753350-15384-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:57.738876 15384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:57.739939 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:57.741200 15384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:57.743165 15384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:57.743332 15384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.743547 15384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:57.743685 15384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:57.782524 15384 rpc_server.cc:307] RPC server started. Bound to: 127.15.6.3:40949
I20260709 13:10:57.782584 26269 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.6.3:40949 every 8 connection(s)
I20260709 13:10:57.797163 26270 heartbeater.cc:344] Connected to a master server at 127.15.6.62:42167
I20260709 13:10:57.797489 26270 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:57.798166 26270 heartbeater.cc:507] Master 127.15.6.62:42167 requested a full tablet report, sending...
I20260709 13:10:57.799938 25994 ts_manager.cc:194] Registered new tserver with Master: 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:57.800165 15384 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013470398s
I20260709 13:10:57.801175 25994 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37508
I20260709 13:10:57.821695 25994 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37516:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:57.824398 25994 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:57.886780 26161 tablet_service.cc:1511] Processing CreateTablet for tablet d276d7eb4be54876b82e6628b3cc00d5 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:57.888168 26161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d276d7eb4be54876b82e6628b3cc00d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.892887 26160 tablet_service.cc:1511] Processing CreateTablet for tablet f0d0781552dd4389b85e29ba52cc7c11 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:57.894959 26159 tablet_service.cc:1511] Processing CreateTablet for tablet 1af85ce17bc84524bfc590ed4f4613e8 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:57.897611 26160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d0781552dd4389b85e29ba52cc7c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.900424 26159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af85ce17bc84524bfc590ed4f4613e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.904500 26158 tablet_service.cc:1511] Processing CreateTablet for tablet 5464d8b9333e46ff8098edf4432b9ad6 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:57.905802 26158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5464d8b9333e46ff8098edf4432b9ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.908959 26157 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8fa2c3f6d44e0cba4b5ea953315733 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:57.910290 26157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8fa2c3f6d44e0cba4b5ea953315733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.910334 26153 tablet_service.cc:1511] Processing CreateTablet for tablet 447cb2116c704a5da2728849027a76a8 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:57.911671 26153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447cb2116c704a5da2728849027a76a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.912900 26156 tablet_service.cc:1511] Processing CreateTablet for tablet 5406c83ce5a34f9c91467a72b4a1ed2a (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:57.914119 26156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5406c83ce5a34f9c91467a72b4a1ed2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.916911 26155 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5adcc83b6c43a2bdc027b5255268fc (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:57.918123 26155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5adcc83b6c43a2bdc027b5255268fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.920921 26154 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9f756d29bb4b739a6de91536e30234 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:57.922209 26154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9f756d29bb4b739a6de91536e30234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.945065 26285 tablet_bootstrap.cc:492] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:57.972769 26285 tablet_bootstrap.cc:654] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:57.972529 26086 tablet_service.cc:1511] Processing CreateTablet for tablet d276d7eb4be54876b82e6628b3cc00d5 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:57.973908 26086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d276d7eb4be54876b82e6628b3cc00d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.976162 26080 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5adcc83b6c43a2bdc027b5255268fc (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:57.977496 26080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5adcc83b6c43a2bdc027b5255268fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.980899 26235 tablet_service.cc:1511] Processing CreateTablet for tablet d276d7eb4be54876b82e6628b3cc00d5 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:57.982268 26235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d276d7eb4be54876b82e6628b3cc00d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.981998 26082 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8fa2c3f6d44e0cba4b5ea953315733 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:57.983263 26082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8fa2c3f6d44e0cba4b5ea953315733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.984889 26083 tablet_service.cc:1511] Processing CreateTablet for tablet 5464d8b9333e46ff8098edf4432b9ad6 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:57.986119 26083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5464d8b9333e46ff8098edf4432b9ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.980899 26081 tablet_service.cc:1511] Processing CreateTablet for tablet 5406c83ce5a34f9c91467a72b4a1ed2a (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:57.989073 26081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5406c83ce5a34f9c91467a72b4a1ed2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.991228 26084 tablet_service.cc:1511] Processing CreateTablet for tablet 1af85ce17bc84524bfc590ed4f4613e8 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:57.991739 26079 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9f756d29bb4b739a6de91536e30234 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:57.992563 26084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af85ce17bc84524bfc590ed4f4613e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.993185 26079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9f756d29bb4b739a6de91536e30234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.001062 26234 tablet_service.cc:1511] Processing CreateTablet for tablet f0d0781552dd4389b85e29ba52cc7c11 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:58.002310 26234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d0781552dd4389b85e29ba52cc7c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.989066 26085 tablet_service.cc:1511] Processing CreateTablet for tablet f0d0781552dd4389b85e29ba52cc7c11 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:58.004848 26232 tablet_service.cc:1511] Processing CreateTablet for tablet 5464d8b9333e46ff8098edf4432b9ad6 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:58.006109 26232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5464d8b9333e46ff8098edf4432b9ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.009140 26085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d0781552dd4389b85e29ba52cc7c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.008904 26231 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8fa2c3f6d44e0cba4b5ea953315733 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:58.009418 26078 tablet_service.cc:1511] Processing CreateTablet for tablet 447cb2116c704a5da2728849027a76a8 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:58.010784 26078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447cb2116c704a5da2728849027a76a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.010543 26230 tablet_service.cc:1511] Processing CreateTablet for tablet 5406c83ce5a34f9c91467a72b4a1ed2a (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:58.012840 26230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5406c83ce5a34f9c91467a72b4a1ed2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.013784 26228 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9f756d29bb4b739a6de91536e30234 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:58.013918 26227 tablet_service.cc:1511] Processing CreateTablet for tablet 447cb2116c704a5da2728849027a76a8 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:58.015028 26228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9f756d29bb4b739a6de91536e30234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.016469 26231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8fa2c3f6d44e0cba4b5ea953315733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.016227 26229 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5adcc83b6c43a2bdc027b5255268fc (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:58.017565 26229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5adcc83b6c43a2bdc027b5255268fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.020663 26233 tablet_service.cc:1511] Processing CreateTablet for tablet 1af85ce17bc84524bfc590ed4f4613e8 (DEFAULT_TABLE table=test-workload [id=f00dbdf8d99a40778b68d5503d93f4fe]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:58.021997 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af85ce17bc84524bfc590ed4f4613e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.023913 26227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447cb2116c704a5da2728849027a76a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.029208 26285 tablet_bootstrap.cc:492] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.029744 26285 ts_tablet_manager.cc:1403] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.021s
I20260709 13:10:58.032714 26285 raft_consensus.cc:359] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.033416 26285 raft_consensus.cc:385] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.033720 26285 raft_consensus.cc:740] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.034479 26285 consensus_queue.cc:260] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.052532 26287 tablet_bootstrap.cc:492] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.058588 26287 tablet_bootstrap.cc:654] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.099735 26196 heartbeater.cc:499] Master 127.15.6.62:42167 was elected leader, sending a full tablet report...
I20260709 13:10:58.100006 26289 tablet_bootstrap.cc:492] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.100274 26285 ts_tablet_manager.cc:1434] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.070s	user 0.020s	sys 0.038s
I20260709 13:10:58.102252 26285 tablet_bootstrap.cc:492] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.124600 26287 tablet_bootstrap.cc:492] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.125171 26287 ts_tablet_manager.cc:1403] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.025s
I20260709 13:10:58.128545 26287 raft_consensus.cc:359] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.133154 26287 raft_consensus.cc:385] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.130452 26289 tablet_bootstrap.cc:654] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.134152 26287 raft_consensus.cc:740] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.138069 26287 consensus_queue.cc:260] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.146667 26285 tablet_bootstrap.cc:654] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.147502 26121 heartbeater.cc:499] Master 127.15.6.62:42167 was elected leader, sending a full tablet report...
I20260709 13:10:58.148531 26287 ts_tablet_manager.cc:1434] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.006s
I20260709 13:10:58.148656 26289 tablet_bootstrap.cc:492] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.149282 26289 ts_tablet_manager.cc:1403] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.008s
I20260709 13:10:58.149518 26287 tablet_bootstrap.cc:492] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.152307 26289 raft_consensus.cc:359] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.153046 26289 raft_consensus.cc:385] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.153383 26289 raft_consensus.cc:740] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.154227 26289 consensus_queue.cc:260] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.155776 26287 tablet_bootstrap.cc:654] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.174232 26270 heartbeater.cc:499] Master 127.15.6.62:42167 was elected leader, sending a full tablet report...
I20260709 13:10:58.175324 26287 tablet_bootstrap.cc:492] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.175602 26285 tablet_bootstrap.cc:492] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.175814 26287 ts_tablet_manager.cc:1403] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 13:10:58.176162 26285 ts_tablet_manager.cc:1403] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.014s
I20260709 13:10:58.176883 26289 ts_tablet_manager.cc:1434] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 13:10:58.177959 26289 tablet_bootstrap.cc:492] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.178882 26287 raft_consensus.cc:359] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.179198 26285 raft_consensus.cc:359] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.179616 26287 raft_consensus.cc:385] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.179968 26285 raft_consensus.cc:385] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.180022 26287 raft_consensus.cc:740] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.180390 26285 raft_consensus.cc:740] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.181033 26287 consensus_queue.cc:260] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.181203 26285 consensus_queue.cc:260] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.183779 26285 ts_tablet_manager.cc:1434] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:10:58.184739 26285 tablet_bootstrap.cc:492] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.186525 26287 ts_tablet_manager.cc:1434] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:58.186808 26289 tablet_bootstrap.cc:654] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.187484 26287 tablet_bootstrap.cc:492] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.190630 26285 tablet_bootstrap.cc:654] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.196389 26287 tablet_bootstrap.cc:654] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.198436 26289 tablet_bootstrap.cc:492] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.198997 26289 ts_tablet_manager.cc:1403] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.021s	user 0.000s	sys 0.018s
I20260709 13:10:58.202157 26289 raft_consensus.cc:359] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.202998 26289 raft_consensus.cc:385] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.203356 26289 raft_consensus.cc:740] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.204345 26289 consensus_queue.cc:260] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.207247 26289 ts_tablet_manager.cc:1434] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:58.208302 26289 tablet_bootstrap.cc:492] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.214339 26287 tablet_bootstrap.cc:492] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.214715 26285 tablet_bootstrap.cc:492] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.214843 26287 ts_tablet_manager.cc:1403] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.006s
I20260709 13:10:58.215274 26285 ts_tablet_manager.cc:1403] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.013s
I20260709 13:10:58.215628 26289 tablet_bootstrap.cc:654] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.217900 26287 raft_consensus.cc:359] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.218653 26287 raft_consensus.cc:385] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.218287 26285 raft_consensus.cc:359] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.218957 26287 raft_consensus.cc:740] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.219065 26285 raft_consensus.cc:385] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.219449 26285 raft_consensus.cc:740] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.219919 26287 consensus_queue.cc:260] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.220422 26285 consensus_queue.cc:260] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.222756 26285 ts_tablet_manager.cc:1434] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:58.224288 26287 ts_tablet_manager.cc:1434] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:58.224705 26285 tablet_bootstrap.cc:492] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.225314 26287 tablet_bootstrap.cc:492] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.229000 26289 tablet_bootstrap.cc:492] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.229651 26289 ts_tablet_manager.cc:1403] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.009s
I20260709 13:10:58.231688 26285 tablet_bootstrap.cc:654] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.232141 26287 tablet_bootstrap.cc:654] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.232666 26289 raft_consensus.cc:359] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.233438 26289 raft_consensus.cc:385] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.233763 26289 raft_consensus.cc:740] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.234786 26289 consensus_queue.cc:260] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.239751 26289 ts_tablet_manager.cc:1434] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:58.240854 26289 tablet_bootstrap.cc:492] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.242718 26285 tablet_bootstrap.cc:492] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.243232 26285 ts_tablet_manager.cc:1403] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:10:58.245795 26287 tablet_bootstrap.cc:492] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.246280 26287 ts_tablet_manager.cc:1403] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.006s
I20260709 13:10:58.246083 26285 raft_consensus.cc:359] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.246944 26285 raft_consensus.cc:385] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.247104 26289 tablet_bootstrap.cc:654] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.247270 26285 raft_consensus.cc:740] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.248205 26285 consensus_queue.cc:260] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.249214 26287 raft_consensus.cc:359] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.249969 26287 raft_consensus.cc:385] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.250253 26287 raft_consensus.cc:740] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.251109 26287 consensus_queue.cc:260] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.252662 26285 ts_tablet_manager.cc:1434] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:58.253401 26287 ts_tablet_manager.cc:1434] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:58.253744 26285 tablet_bootstrap.cc:492] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.254387 26287 tablet_bootstrap.cc:492] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.258898 26289 tablet_bootstrap.cc:492] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.259467 26289 ts_tablet_manager.cc:1403] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:10:58.260650 26285 tablet_bootstrap.cc:654] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.260960 26287 tablet_bootstrap.cc:654] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.262383 26289 raft_consensus.cc:359] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.263259 26289 raft_consensus.cc:385] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.263598 26289 raft_consensus.cc:740] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.264562 26289 consensus_queue.cc:260] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.269629 26289 ts_tablet_manager.cc:1434] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:58.270668 26289 tablet_bootstrap.cc:492] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.274758 26287 tablet_bootstrap.cc:492] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.275267 26287 ts_tablet_manager.cc:1403] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 13:10:58.277276 26289 tablet_bootstrap.cc:654] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.278017 26287 raft_consensus.cc:359] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.278815 26287 raft_consensus.cc:385] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.279111 26287 raft_consensus.cc:740] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.280278 26285 tablet_bootstrap.cc:492] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.280041 26287 consensus_queue.cc:260] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.281000 26285 ts_tablet_manager.cc:1403] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.017s
I20260709 13:10:58.282516 26287 ts_tablet_manager.cc:1434] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:10:58.283510 26287 tablet_bootstrap.cc:492] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.284456 26285 raft_consensus.cc:359] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.285338 26285 raft_consensus.cc:385] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.285692 26285 raft_consensus.cc:740] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.286530 26285 consensus_queue.cc:260] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.289136 26285 ts_tablet_manager.cc:1434] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:58.290351 26285 tablet_bootstrap.cc:492] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.291746 26287 tablet_bootstrap.cc:654] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.296591 26285 tablet_bootstrap.cc:654] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.296986 26289 tablet_bootstrap.cc:492] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.297482 26289 ts_tablet_manager.cc:1403] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 13:10:58.298952 26287 tablet_bootstrap.cc:492] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.299472 26287 ts_tablet_manager.cc:1403] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:10:58.301677 26289 raft_consensus.cc:359] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.302387 26289 raft_consensus.cc:385] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.302763 26289 raft_consensus.cc:740] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.302438 26287 raft_consensus.cc:359] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.303493 26287 raft_consensus.cc:385] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.303865 26287 raft_consensus.cc:740] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.303694 26289 consensus_queue.cc:260] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.304744 26287 consensus_queue.cc:260] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.307008 26294 raft_consensus.cc:493] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.307602 26294 raft_consensus.cc:515] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.308015 26289 ts_tablet_manager.cc:1434] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:58.309036 26289 tablet_bootstrap.cc:492] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.312139 26292 raft_consensus.cc:493] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.312664 26292 raft_consensus.cc:515] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.314909 26289 tablet_bootstrap.cc:654] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.320772 26292 leader_election.cc:290] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.321934 26294 leader_election.cc:290] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.307014 26287 ts_tablet_manager.cc:1434] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:58.328267 26289 tablet_bootstrap.cc:492] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.328940 26289 ts_tablet_manager.cc:1403] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:10:58.330461 26287 tablet_bootstrap.cc:492] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.331771 26289 raft_consensus.cc:359] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.332551 26289 raft_consensus.cc:385] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.332832 26289 raft_consensus.cc:740] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.333719 26289 consensus_queue.cc:260] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.336084 26289 ts_tablet_manager.cc:1434] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:10:58.337035 26289 tablet_bootstrap.cc:492] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.342846 26289 tablet_bootstrap.cc:654] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.344113 26292 raft_consensus.cc:493] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.344581 26292 raft_consensus.cc:515] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.345029 26285 tablet_bootstrap.cc:492] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.345687 26285 ts_tablet_manager.cc:1403] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.028s
I20260709 13:10:58.346446 26292 leader_election.cc:290] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.348923 26285 raft_consensus.cc:359] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.349681 26285 raft_consensus.cc:385] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.350023 26285 raft_consensus.cc:740] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.350914 26285 consensus_queue.cc:260] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.354529 26287 tablet_bootstrap.cc:654] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.355939 26285 ts_tablet_manager.cc:1434] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:58.357004 26285 tablet_bootstrap.cc:492] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.362884 26285 tablet_bootstrap.cc:654] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.363189 26292 raft_consensus.cc:493] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.363669 26292 raft_consensus.cc:515] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.365633 26292 leader_election.cc:290] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.375609 26294 raft_consensus.cc:493] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.376199 26294 raft_consensus.cc:515] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.377406 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.378192 26171 raft_consensus.cc:2468] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:10:58.378355 26294 leader_election.cc:290] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.380185 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.380838 26171 raft_consensus.cc:2468] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:10:58.382308 26061 leader_election.cc:304] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.383546 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.384191 26171 raft_consensus.cc:2468] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:10:58.385198 26292 raft_consensus.cc:2804] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.385602 26292 raft_consensus.cc:493] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.385914 26292 raft_consensus.cc:3060] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.389144 26096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.389796 26096 raft_consensus.cc:2468] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:10:58.391463 26096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.392096 26096 raft_consensus.cc:2468] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:10:58.393266 26209 leader_election.cc:304] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.392153 26061 leader_election.cc:304] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.394209 26294 raft_consensus.cc:2804] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.394604 26294 raft_consensus.cc:493] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.393604 26292 raft_consensus.cc:515] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.395133 26294 raft_consensus.cc:3060] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.396786 26292 leader_election.cc:290] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.397342 26292 raft_consensus.cc:2804] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.397684 26292 raft_consensus.cc:493] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.398010 26292 raft_consensus.cc:3060] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.402360 26294 raft_consensus.cc:515] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.403693 26209 leader_election.cc:304] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.405613 26287 tablet_bootstrap.cc:492] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.406180 26287 ts_tablet_manager.cc:1403] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 13:10:58.410183 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.410966 26170 raft_consensus.cc:2468] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:10:58.411015 26294 leader_election.cc:290] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.411706 26294 raft_consensus.cc:2804] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.412088 26294 raft_consensus.cc:493] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.412403 26294 raft_consensus.cc:3060] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.413053 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.414286 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
W20260709 13:10:58.415627 26210 leader_election.cc:343] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:58.416887 26210 leader_election.cc:343] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:58.427497 26061 leader_election.cc:304] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.428831 26317 raft_consensus.cc:2804] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.429273 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:58.430366 26096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:58.431104 26285 tablet_bootstrap.cc:492] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.430179 26289 tablet_bootstrap.cc:492] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.431067 26170 raft_consensus.cc:3060] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.431743 26285 ts_tablet_manager.cc:1403] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.075s	user 0.031s	sys 0.030s
I20260709 13:10:58.432183 26289 ts_tablet_manager.cc:1403] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.095s	user 0.040s	sys 0.037s
I20260709 13:10:58.431511 26096 raft_consensus.cc:3060] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.434954 26292 raft_consensus.cc:515] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
W20260709 13:10:58.435364 26042 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:58.436645 26285 raft_consensus.cc:359] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.437368 26285 raft_consensus.cc:385] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.437182 26292 leader_election.cc:290] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.430806 26294 raft_consensus.cc:515] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.437712 26285 raft_consensus.cc:740] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.438753 26289 raft_consensus.cc:359] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.439487 26289 raft_consensus.cc:385] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.439836 26289 raft_consensus.cc:740] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.430927 26317 raft_consensus.cc:493] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.440354 26317 raft_consensus.cc:3060] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.440507 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:58.440526 26289 consensus_queue.cc:260] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.441583 26095 raft_consensus.cc:2393] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e8492604e174aeabbc9c46ebb659dc3 in current term 1: Already voted for candidate 66542e9b217f43d7ae827345bc7a93b5 in this term.
I20260709 13:10:58.442981 26289 ts_tablet_manager.cc:1434] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:58.443977 26289 tablet_bootstrap.cc:492] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.444247 26244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.444993 26244 raft_consensus.cc:2393] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66542e9b217f43d7ae827345bc7a93b5 in current term 1: Already voted for candidate 2e8492604e174aeabbc9c46ebb659dc3 in this term.
I20260709 13:10:58.446039 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.446688 26243 raft_consensus.cc:2468] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:10:58.446789 26294 leader_election.cc:290] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.439239 26285 consensus_queue.cc:260] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.448518 26241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:58.449105 26285 ts_tablet_manager.cc:1434] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:58.449770 26289 tablet_bootstrap.cc:654] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.450085 26285 tablet_bootstrap.cc:492] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.452241 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.452857 26317 raft_consensus.cc:515] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.454869 26317 leader_election.cc:290] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.447494 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:58.449275 26241 raft_consensus.cc:2393] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66542e9b217f43d7ae827345bc7a93b5 in current term 1: Already voted for candidate 2e8492604e174aeabbc9c46ebb659dc3 in this term.
I20260709 13:10:58.459281 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:58.459776 26285 tablet_bootstrap.cc:654] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.459880 26171 raft_consensus.cc:3060] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.461990 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:58.462596 26243 raft_consensus.cc:3060] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.452948 26245 raft_consensus.cc:2468] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:10:58.473994 26285 tablet_bootstrap.cc:492] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.474519 26285 ts_tablet_manager.cc:1403] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:10:58.475572 26170 raft_consensus.cc:2468] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:10:58.477175 26285 raft_consensus.cc:359] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.477535 26243 raft_consensus.cc:2468] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:10:58.477869 26285 raft_consensus.cc:385] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.478330 26285 raft_consensus.cc:740] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.478669 26096 raft_consensus.cc:2468] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:10:58.478973 26059 leader_election.cc:304] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.479084 26285 consensus_queue.cc:260] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.480048 26317 raft_consensus.cc:2804] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.480531 26317 raft_consensus.cc:697] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:58.480930 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:58.481503 26169 raft_consensus.cc:3060] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.481344 26317 consensus_queue.cc:237] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.484114 26061 leader_election.cc:304] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 2e8492604e174aeabbc9c46ebb659dc3
I20260709 13:10:58.487928 26285 ts_tablet_manager.cc:1434] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:58.487950 26292 raft_consensus.cc:2804] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.489504 26292 raft_consensus.cc:697] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:58.490484 26169 raft_consensus.cc:2468] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:10:58.490360 26292 consensus_queue.cc:237] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.493311 26171 raft_consensus.cc:2468] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:10:58.494592 26210 leader_election.cc:304] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:10:58.494809 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:58.495404 26170 raft_consensus.cc:2393] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66542e9b217f43d7ae827345bc7a93b5 in current term 1: Already voted for candidate 2e8492604e174aeabbc9c46ebb659dc3 in this term.
I20260709 13:10:58.496376 26061 leader_election.cc:304] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5; no voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:10:58.430130 26287 raft_consensus.cc:359] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.496716 26209 leader_election.cc:304] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:10:58.497010 26287 raft_consensus.cc:385] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.497395 26287 raft_consensus.cc:740] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.497622 26294 raft_consensus.cc:2804] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.495978 26318 raft_consensus.cc:2804] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.496768 26285 tablet_bootstrap.cc:492] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:10:58.498114 26287 consensus_queue.cc:260] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.501719 26287 ts_tablet_manager.cc:1434] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.003s
I20260709 13:10:58.502702 26287 tablet_bootstrap.cc:492] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.504956 26322 raft_consensus.cc:2749] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:58.507237 26289 tablet_bootstrap.cc:492] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.507709 26289 ts_tablet_manager.cc:1403] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.021s
I20260709 13:10:58.508324 25992 catalog_manager.cc:5697] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.510229 26289 raft_consensus.cc:359] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.510886 26289 raft_consensus.cc:385] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.511135 26289 raft_consensus.cc:740] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.508723 26288 raft_consensus.cc:493] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.511886 26289 consensus_queue.cc:260] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.512571 26285 tablet_bootstrap.cc:654] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.513895 26294 raft_consensus.cc:697] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:58.512151 26288 raft_consensus.cc:515] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.517067 26288 leader_election.cc:290] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.514819 26294 consensus_queue.cc:237] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.519234 26318 raft_consensus.cc:697] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:58.524448 26287 tablet_bootstrap.cc:654] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.524902 26318 consensus_queue.cc:237] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.539335 26287 tablet_bootstrap.cc:492] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.539868 26287 ts_tablet_manager.cc:1403] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 13:10:58.540589 26285 tablet_bootstrap.cc:492] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:10:58.541117 26285 ts_tablet_manager.cc:1403] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:10:58.544310 26289 ts_tablet_manager.cc:1434] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 13:10:58.545090 26289 tablet_bootstrap.cc:492] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:10:58.550904 26287 raft_consensus.cc:359] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.552152 26287 raft_consensus.cc:385] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.552347 26287 raft_consensus.cc:740] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.555991 25994 catalog_manager.cc:5697] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.557523 26289 tablet_bootstrap.cc:654] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.557862 25993 catalog_manager.cc:5697] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.560196 26287 consensus_queue.cc:260] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.562410 26285 raft_consensus.cc:359] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.563041 26285 raft_consensus.cc:385] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.563350 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.564133 26287 ts_tablet_manager.cc:1434] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:10:58.565074 26287 tablet_bootstrap.cc:492] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:10:58.567631 26096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.563303 26285 raft_consensus.cc:740] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.568292 26096 raft_consensus.cc:2468] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:10:58.568681 26285 consensus_queue.cc:260] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
W20260709 13:10:58.569175 26134 leader_election.cc:343] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:58.570106 26287 tablet_bootstrap.cc:654] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.570741 26285 ts_tablet_manager.cc:1434] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:10:58.572455 26135 leader_election.cc:304] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 2e8492604e174aeabbc9c46ebb659dc3
I20260709 13:10:58.573597 26288 raft_consensus.cc:2804] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.573925 26288 raft_consensus.cc:493] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.574229 26288 raft_consensus.cc:3060] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.578531 26289 tablet_bootstrap.cc:492] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:10:58.579036 26289 ts_tablet_manager.cc:1403] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:10:58.580123 26292 raft_consensus.cc:493] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.580636 26292 raft_consensus.cc:515] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.582746 26292 leader_election.cc:290] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.584498 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.585122 26243 raft_consensus.cc:2468] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:10:58.586202 26059 leader_election.cc:304] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.586125 26289 raft_consensus.cc:359] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.587163 26292 raft_consensus.cc:2804] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.587316 26289 raft_consensus.cc:385] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.587685 26292 raft_consensus.cc:493] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.587941 26289 raft_consensus.cc:740] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.588147 26292 raft_consensus.cc:3060] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.587380 26288 raft_consensus.cc:515] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.589007 26289 consensus_queue.cc:260] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.590934 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.591199 26289 ts_tablet_manager.cc:1434] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:10:58.591565 26170 raft_consensus.cc:2468] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:10:58.593976 26288 leader_election.cc:290] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.594584 26096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:58.595024 26096 raft_consensus.cc:3060] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.595328 26292 raft_consensus.cc:515] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.598078 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:58.598649 26170 raft_consensus.cc:3060] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.598973 26331 raft_consensus.cc:493] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.599366 26331 raft_consensus.cc:515] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.601789 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.602066 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.602481 26095 raft_consensus.cc:2468] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:10:58.602689 26171 raft_consensus.cc:2468] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:10:58.601837 26331 leader_election.cc:290] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.603834 26209 leader_election.cc:304] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.604738 26331 raft_consensus.cc:2804] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.606244 26288 raft_consensus.cc:493] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.605119 26331 raft_consensus.cc:493] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.608327 26292 leader_election.cc:290] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.608014 26096 raft_consensus.cc:2468] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:10:58.611128 26135 leader_election.cc:304] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.612879 26287 tablet_bootstrap.cc:492] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:10:58.613358 26287 ts_tablet_manager.cc:1403] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.031s
I20260709 13:10:58.614346 26170 raft_consensus.cc:2468] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:10:58.614967 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:58.614645 25992 catalog_manager.cc:5697] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.609807 26331 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.615964 26287 raft_consensus.cc:359] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.616634 26287 raft_consensus.cc:385] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.616873 26287 raft_consensus.cc:740] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.617609 26287 consensus_queue.cc:260] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.619692 26287 ts_tablet_manager.cc:1434] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:58.615597 26243 raft_consensus.cc:3060] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.628216 26061 leader_election.cc:304] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.622695 26288 raft_consensus.cc:515] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.630625 26288 leader_election.cc:290] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.630558 26243 raft_consensus.cc:2468] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:10:58.632069 26288 raft_consensus.cc:2804] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.632491 26288 raft_consensus.cc:697] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:58.632593 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:58.633193 26245 raft_consensus.cc:3060] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.633303 26288 consensus_queue.cc:237] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.633857 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.631111 26292 raft_consensus.cc:2804] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.636171 26292 raft_consensus.cc:697] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:58.636984 26292 consensus_queue.cc:237] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.638198 26318 raft_consensus.cc:493] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.638686 26318 raft_consensus.cc:515] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.640302 26096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.640746 26318 leader_election.cc:290] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.640913 26096 raft_consensus.cc:2468] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:10:58.642022 26135 leader_election.cc:304] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.642099 26331 raft_consensus.cc:515] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.642905 26245 raft_consensus.cc:2468] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:10:58.644140 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:10:58.645366 26331 leader_election.cc:290] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.643359 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.648634 26095 raft_consensus.cc:2468] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:10:58.649871 26209 leader_election.cc:304] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.651183 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:58.651494 26331 raft_consensus.cc:2804] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.651945 26331 raft_consensus.cc:493] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.652262 26331 raft_consensus.cc:3060] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.650519 26170 raft_consensus.cc:2468] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:10:58.653434 26096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:58.654253 26096 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.656124 26339 raft_consensus.cc:2804] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.656695 26171 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.660259 26331 raft_consensus.cc:515] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.661561 26171 raft_consensus.cc:2468] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:10:58.645419 26340 raft_consensus.cc:493] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.662349 26243 raft_consensus.cc:2393] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fdbd6ca12394ae4b0d73c5122292442 in current term 1: Already voted for candidate 2e8492604e174aeabbc9c46ebb659dc3 in this term.
I20260709 13:10:58.662858 26340 raft_consensus.cc:515] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.663582 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:58.664180 26095 raft_consensus.cc:3060] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.665206 26340 leader_election.cc:290] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.661634 26096 raft_consensus.cc:2468] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:10:58.665985 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.666606 26209 leader_election.cc:304] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.666851 26094 raft_consensus.cc:2393] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fdbd6ca12394ae4b0d73c5122292442 in current term 1: Already voted for candidate 2e8492604e174aeabbc9c46ebb659dc3 in this term.
I20260709 13:10:58.668356 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.671375 26095 raft_consensus.cc:2468] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:10:58.672613 26318 raft_consensus.cc:2804] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.673162 26318 raft_consensus.cc:697] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:58.662006 26339 raft_consensus.cc:493] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.674142 26318 consensus_queue.cc:237] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.677385 26209 leader_election.cc:304] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:10:58.676762 26339 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.678212 26294 raft_consensus.cc:2804] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.678687 26294 raft_consensus.cc:697] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:58.679512 26294 consensus_queue.cc:237] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.680079 26331 leader_election.cc:290] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:58.680928 26135 leader_election.cc:304] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdbd6ca12394ae4b0d73c5122292442; no voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:10:58.682885 26340 raft_consensus.cc:3060] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.684850 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:58.685443 26171 raft_consensus.cc:3060] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.690374 26340 raft_consensus.cc:2749] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:58.691838 26171 raft_consensus.cc:2468] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:10:58.695200 25992 catalog_manager.cc:5697] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.696514 26339 raft_consensus.cc:515] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.706899 25993 catalog_manager.cc:5697] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.710580 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:58.711225 26095 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.711045 25994 catalog_manager.cc:5697] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.712776 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:58.711743 26339 leader_election.cc:290] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.718012 26095 raft_consensus.cc:2468] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:10:58.719038 26135 leader_election.cc:304] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 2e8492604e174aeabbc9c46ebb659dc3
I20260709 13:10:58.719664 26339 raft_consensus.cc:2804] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:58.720618 26339 raft_consensus.cc:697] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:58.721378 26339 consensus_queue.cc:237] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.726919 25994 catalog_manager.cc:5697] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.728351 25993 catalog_manager.cc:5697] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 1 to 2, leader changed from 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3) to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.847867 26339 raft_consensus.cc:493] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.848337 26339 raft_consensus.cc:515] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.850306 26339 leader_election.cc:290] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.850951 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:10:58.851236 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:10:58.851699 26095 raft_consensus.cc:2468] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:10:58.851986 26243 raft_consensus.cc:2468] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:10:58.852778 26135 leader_election.cc:304] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.853443 26339 raft_consensus.cc:2804] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:58.853717 26339 raft_consensus.cc:493] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.853955 26339 raft_consensus.cc:3060] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.858579 26339 raft_consensus.cc:515] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.860020 26339 leader_election.cc:290] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:58.860658 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:58.860839 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:58.861195 26095 raft_consensus.cc:3060] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.861377 26243 raft_consensus.cc:3060] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.865993 26243 raft_consensus.cc:2468] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:10:58.865988 26095 raft_consensus.cc:2468] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:10:58.866899 26134 leader_election.cc:304] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:58.867501 26339 raft_consensus.cc:2804] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.867864 26339 raft_consensus.cc:697] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:58.868570 26339 consensus_queue.cc:237] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:58.874961 25993 catalog_manager.cc:5697] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.935773 26292 consensus_queue.cc:1048] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:58.946007 26322 consensus_queue.cc:1048] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:58.954509 26294 consensus_queue.cc:1048] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:58.964915 26331 consensus_queue.cc:1048] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:58.971952 26243 raft_consensus.cc:3060] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.978569 26322 consensus_queue.cc:1048] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:58.988325 26317 consensus_queue.cc:1048] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.014279 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
mode: GRACEFUL
new_leader_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:10:59.014818 26243 raft_consensus.cc:606] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Received request to transfer leadership to TS 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:10:59.019295 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
mode: GRACEFUL
new_leader_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:10:59.019724 26243 raft_consensus.cc:606] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Received request to transfer leadership to TS 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:10:59.023102 26331 consensus_queue.cc:1048] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.031282 26294 raft_consensus.cc:993] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3: : Instructing follower 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:10:59.031668 26294 raft_consensus.cc:1081] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Signalling peer 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:10:59.034133 26094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:35568
I20260709 13:10:59.034421 26170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
mode: GRACEFUL
new_leader_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:55722
I20260709 13:10:59.035044 26170 raft_consensus.cc:606] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Received request to transfer leadership to TS 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:10:59.045091 26294 consensus_queue.cc:1048] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.045948 26094 raft_consensus.cc:493] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.046342 26094 raft_consensus.cc:3060] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.050945 26317 consensus_queue.cc:1048] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.051887 26096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
mode: GRACEFUL
new_leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:59.052475 26096 raft_consensus.cc:606] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Received request to transfer leadership to TS 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:10:59.053938 26094 raft_consensus.cc:515] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.060336 26094 leader_election.cc:290] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:59.060776 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:59.060990 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d0781552dd4389b85e29ba52cc7c11" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:59.061583 26243 raft_consensus.cc:3055] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.061904 26243 raft_consensus.cc:740] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:59.062770 26169 raft_consensus.cc:3060] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.063717 26243 consensus_queue.cc:260] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.065055 26243 raft_consensus.cc:3060] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.070396 26094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
mode: GRACEFUL
new_leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:59.070992 26094 raft_consensus.cc:606] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Received request to transfer leadership to TS 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:10:59.072230 26169 raft_consensus.cc:2468] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:10:59.072630 26243 raft_consensus.cc:2468] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:10:59.073210 26061 leader_election.cc:304] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:59.074262 26317 raft_consensus.cc:2804] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.074715 26317 raft_consensus.cc:697] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:59.075587 26317 consensus_queue.cc:237] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.078830 26322 consensus_queue.cc:1048] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.079932 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
mode: GRACEFUL
new_leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:10:59.080583 26243 raft_consensus.cc:606] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Received request to transfer leadership to TS 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:10:59.085248 25992 catalog_manager.cc:5697] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 1 to 2, leader changed from 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3) to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.089818 26169 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "447cb2116c704a5da2728849027a76a8"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
mode: GRACEFUL
new_leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:55722
I20260709 13:10:59.094671 26169 raft_consensus.cc:606] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Received request to transfer leadership to TS 2e8492604e174aeabbc9c46ebb659dc3
I20260709 13:10:59.095140 26294 consensus_queue.cc:1048] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.109298 26294 consensus_queue.cc:1048] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.116532 26318 raft_consensus.cc:993] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3: : Instructing follower 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:10:59.116909 26294 raft_consensus.cc:1081] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Signalling peer 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:10:59.118162 26169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:10:59.118589 26169 raft_consensus.cc:493] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.118865 26169 raft_consensus.cc:3060] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.123581 26169 raft_consensus.cc:515] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.125162 26169 leader_election.cc:290] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:59.125859 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:59.126304 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9f756d29bb4b739a6de91536e30234" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:59.126477 26094 raft_consensus.cc:3060] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.126924 26245 raft_consensus.cc:3055] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.127264 26245 raft_consensus.cc:740] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:59.127590 26095 raft_consensus.cc:1240] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Rejecting Update request from peer 2e8492604e174aeabbc9c46ebb659dc3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:59.128180 26245 consensus_queue.cc:260] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.129295 26245 raft_consensus.cc:3060] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.129171 26294 consensus_queue.cc:1059] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.129956 26294 raft_consensus.cc:3055] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.130270 26294 raft_consensus.cc:740] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:59.131040 26294 consensus_queue.cc:260] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.132143 26294 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.132958 26094 raft_consensus.cc:2468] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:10:59.133826 26135 leader_election.cc:304] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:59.134428 26339 raft_consensus.cc:2804] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.134809 26339 raft_consensus.cc:697] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:59.135555 26339 consensus_queue.cc:237] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.135983 26245 raft_consensus.cc:2468] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:10:59.141207 25994 catalog_manager.cc:5697] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 1 to 2, leader changed from 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3) to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.158145 26339 consensus_queue.cc:1048] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.164027 26339 raft_consensus.cc:993] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442: : Instructing follower 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:10:59.164443 26288 raft_consensus.cc:1081] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Signalling peer 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:10:59.166026 26095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:35582
I20260709 13:10:59.166575 26095 raft_consensus.cc:493] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.166918 26095 raft_consensus.cc:3060] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.170344 26340 consensus_queue.cc:1048] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.173451 26095 raft_consensus.cc:515] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.176110 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:59.176630 26169 raft_consensus.cc:3055] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.176915 26169 raft_consensus.cc:740] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:59.178146 26095 leader_election.cc:290] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:59.178187 26169 consensus_queue.cc:260] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.179236 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5464d8b9333e46ff8098edf4432b9ad6" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:59.179876 26245 raft_consensus.cc:3060] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.179881 26169 raft_consensus.cc:3060] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.185359 26169 raft_consensus.cc:2468] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:10:59.185690 26245 raft_consensus.cc:2468] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:10:59.186209 26061 leader_election.cc:304] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:59.186873 26292 raft_consensus.cc:2804] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.187350 26292 raft_consensus.cc:697] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:59.188153 26292 consensus_queue.cc:237] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.193785 25992 catalog_manager.cc:5697] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 1 to 2, leader changed from 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2) to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.212965 26245 raft_consensus.cc:1275] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:10:59.213227 26245 pending_rounds.cc:85] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: Aborting all ops after (but not including) 0
I20260709 13:10:59.213409 26245 pending_rounds.cc:107] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:59.213601 26245 raft_consensus.cc:2889] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.214684 26340 consensus_queue.cc:1048] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.218748 26339 raft_consensus.cc:993] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442: : Instructing follower 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:10:59.219187 26339 raft_consensus.cc:1081] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Signalling peer 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:10:59.220748 26243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "447cb2116c704a5da2728849027a76a8"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:36438
I20260709 13:10:59.221719 26243 raft_consensus.cc:493] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.222029 26243 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.226715 26095 raft_consensus.cc:1275] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:59.228029 26339 consensus_queue.cc:1048] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.228585 26243 raft_consensus.cc:515] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.231501 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:59.231894 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447cb2116c704a5da2728849027a76a8" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:59.232640 26169 raft_consensus.cc:3055] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:59.232971 26169 raft_consensus.cc:740] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:59.233075 26243 leader_election.cc:290] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 3 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:10:59.233830 26169 consensus_queue.cc:260] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.234954 26169 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.240235 26169 raft_consensus.cc:2468] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 3.
I20260709 13:10:59.241091 26210 leader_election.cc:304] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:10:59.241693 26294 raft_consensus.cc:2804] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:59.242151 26294 raft_consensus.cc:697] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 3 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:59.242871 26294 consensus_queue.cc:237] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.248348 25992 catalog_manager.cc:5697] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 2 to 3, leader changed from 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2) to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 3 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:59.268953 26339 consensus_queue.cc:1048] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.278371 26341 consensus_queue.cc:1048] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:59.341279 26362 raft_consensus.cc:993] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5: : Instructing follower 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:10:59.341692 26292 raft_consensus.cc:1081] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Signalling peer 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:10:59.343096 26169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:55692
I20260709 13:10:59.343545 26169 raft_consensus.cc:493] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.343856 26169 raft_consensus.cc:3060] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.348645 26169 raft_consensus.cc:515] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.350011 26169 leader_election.cc:290] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:59.350762 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:59.350986 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8fa2c3f6d44e0cba4b5ea953315733" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:59.351409 26095 raft_consensus.cc:3055] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.351528 26243 raft_consensus.cc:3060] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.351817 26095 raft_consensus.cc:740] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:59.352644 26095 consensus_queue.cc:260] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.353854 26095 raft_consensus.cc:3060] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.358175 26243 raft_consensus.cc:2468] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:10:59.359320 26134 leader_election.cc:304] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:59.360095 26341 raft_consensus.cc:2804] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.360438 26095 raft_consensus.cc:2468] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:10:59.360472 26341 raft_consensus.cc:697] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:59.361464 26341 consensus_queue.cc:237] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.367064 25994 catalog_manager.cc:5697] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 1 to 2, leader changed from 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1) to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.483081 26362 raft_consensus.cc:993] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5: : Instructing follower 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:10:59.483493 26292 raft_consensus.cc:1081] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Signalling peer 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:10:59.484862 26169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:55692
I20260709 13:10:59.485334 26169 raft_consensus.cc:493] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.485653 26169 raft_consensus.cc:3060] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.490244 26169 raft_consensus.cc:515] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.491645 26169 leader_election.cc:290] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:59.492399 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:10:59.492620 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5adcc83b6c43a2bdc027b5255268fc" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:59.493081 26095 raft_consensus.cc:3055] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.493168 26243 raft_consensus.cc:3060] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.493456 26095 raft_consensus.cc:740] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:59.494279 26095 consensus_queue.cc:260] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.495467 26095 raft_consensus.cc:3060] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.499706 26243 raft_consensus.cc:2468] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:10:59.500905 26134 leader_election.cc:304] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:59.501492 26341 raft_consensus.cc:2804] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.501698 26095 raft_consensus.cc:2468] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:10:59.501847 26341 raft_consensus.cc:697] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:10:59.502655 26341 consensus_queue.cc:237] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.507858 25994 catalog_manager.cc:5697] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 1 to 2, leader changed from 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1) to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.584358 26331 raft_consensus.cc:993] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3: : Instructing follower 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:10:59.584830 26294 raft_consensus.cc:1081] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Signalling peer 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:10:59.586588 26095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:35568
I20260709 13:10:59.587136 26095 raft_consensus.cc:493] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.587508 26095 raft_consensus.cc:3060] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.587702 26243 raft_consensus.cc:1275] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.587880 26169 raft_consensus.cc:1275] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.589170 26362 consensus_queue.cc:1048] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.589707 26292 consensus_queue.cc:1048] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.593642 26095 raft_consensus.cc:515] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.597003 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:10:59.597295 26170 raft_consensus.cc:1275] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.597970 26245 raft_consensus.cc:3055] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.598310 26245 raft_consensus.cc:740] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:10:59.599061 26245 consensus_queue.cc:260] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.599709 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af85ce17bc84524bfc590ed4f4613e8" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:10:59.600106 26245 raft_consensus.cc:3060] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.600499 26362 consensus_queue.cc:1048] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.600294 26170 raft_consensus.cc:3060] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.607821 26170 raft_consensus.cc:2468] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:10:59.608946 26061 leader_election.cc:304] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:10:59.609735 26362 raft_consensus.cc:2804] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.610253 26362 raft_consensus.cc:697] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:10:59.611155 26362 consensus_queue.cc:237] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:10:59.613760 26245 raft_consensus.cc:2468] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:10:59.619578 26095 leader_election.cc:290] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:10:59.621487 25994 catalog_manager.cc:5697] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 1 to 2, leader changed from 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3) to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.625734 26245 raft_consensus.cc:1275] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.627192 26371 consensus_queue.cc:1048] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.725646 26095 raft_consensus.cc:3060] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.730782 26095 raft_consensus.cc:1275] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 3 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.731871 26294 consensus_queue.cc:1048] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.739173 26094 raft_consensus.cc:1275] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.740593 26169 raft_consensus.cc:1275] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 3 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.740593 26341 consensus_queue.cc:1048] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:59.742767 26294 consensus_queue.cc:1048] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.748178 26245 raft_consensus.cc:1275] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.749460 26288 consensus_queue.cc:1048] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.798207 26245 raft_consensus.cc:1275] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.799266 26288 consensus_queue.cc:1048] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.805994 26095 raft_consensus.cc:1275] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.807384 26341 consensus_queue.cc:1048] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.054738 26169 raft_consensus.cc:1275] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.056003 26362 consensus_queue.cc:1048] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.056059 26245 raft_consensus.cc:1275] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.057507 26362 consensus_queue.cc:1048] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.065004 26243 raft_consensus.cc:1275] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.071188 26341 consensus_queue.cc:1048] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.080538 26095 raft_consensus.cc:1275] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.082145 26339 consensus_queue.cc:1048] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.122131 25993 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37524:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:02.124434 25993 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:02.170037 26079 tablet_service.cc:1511] Processing CreateTablet for tablet c9df3303627a470bb9a209ec24043c44 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:02.171146 26154 tablet_service.cc:1511] Processing CreateTablet for tablet c9df3303627a470bb9a209ec24043c44 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:02.172431 26154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9df3303627a470bb9a209ec24043c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.171234 26079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9df3303627a470bb9a209ec24043c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.173020 26232 tablet_service.cc:1511] Processing CreateTablet for tablet c9df3303627a470bb9a209ec24043c44 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:02.174183 26232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9df3303627a470bb9a209ec24043c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.175779 26160 tablet_service.cc:1511] Processing CreateTablet for tablet 9733416f28ac4c7b8e9a9be19928b6c9 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:02.177026 26160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9733416f28ac4c7b8e9a9be19928b6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.178275 26085 tablet_service.cc:1511] Processing CreateTablet for tablet abd8a0f0412f4d009321e8e96dcd9239 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:02.179445 26085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd8a0f0412f4d009321e8e96dcd9239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.180693 26081 tablet_service.cc:1511] Processing CreateTablet for tablet 9733416f28ac4c7b8e9a9be19928b6c9 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:02.181840 26081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9733416f28ac4c7b8e9a9be19928b6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.186921 26230 tablet_service.cc:1511] Processing CreateTablet for tablet abd8a0f0412f4d009321e8e96dcd9239 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:02.188149 26230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd8a0f0412f4d009321e8e96dcd9239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.189215 26082 tablet_service.cc:1511] Processing CreateTablet for tablet 4accf7ab19fa4952844a344af29d758b (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:02.190356 26082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4accf7ab19fa4952844a344af29d758b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.191282 26233 tablet_service.cc:1511] Processing CreateTablet for tablet 4accf7ab19fa4952844a344af29d758b (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:02.192020 26078 tablet_service.cc:1511] Processing CreateTablet for tablet 1575a79dd06648cab40ee498335bcaf7 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:02.192503 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4accf7ab19fa4952844a344af29d758b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.193202 26078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575a79dd06648cab40ee498335bcaf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.193041 26227 tablet_service.cc:1511] Processing CreateTablet for tablet 1575a79dd06648cab40ee498335bcaf7 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:02.194217 26227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575a79dd06648cab40ee498335bcaf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.188304 26083 tablet_service.cc:1511] Processing CreateTablet for tablet fc201e072c414937916e27508a78e6d0 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:02.195781 26083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc201e072c414937916e27508a78e6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.186455 26229 tablet_service.cc:1511] Processing CreateTablet for tablet 9733416f28ac4c7b8e9a9be19928b6c9 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:02.197688 26229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9733416f28ac4c7b8e9a9be19928b6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.201742 26159 tablet_service.cc:1511] Processing CreateTablet for tablet 4accf7ab19fa4952844a344af29d758b (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:02.201951 26155 tablet_service.cc:1511] Processing CreateTablet for tablet 1575a79dd06648cab40ee498335bcaf7 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:02.203015 26159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4accf7ab19fa4952844a344af29d758b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.202692 26161 tablet_service.cc:1511] Processing CreateTablet for tablet fc201e072c414937916e27508a78e6d0 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:02.204665 26161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc201e072c414937916e27508a78e6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.207585 26388 tablet_bootstrap.cc:492] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.208079 26155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575a79dd06648cab40ee498335bcaf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.201788 26156 tablet_service.cc:1511] Processing CreateTablet for tablet abd8a0f0412f4d009321e8e96dcd9239 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:02.210069 26156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd8a0f0412f4d009321e8e96dcd9239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.188189 26231 tablet_service.cc:1511] Processing CreateTablet for tablet fc201e072c414937916e27508a78e6d0 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:02.212953 26231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc201e072c414937916e27508a78e6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.220810 26389 tablet_bootstrap.cc:492] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.231925 26389 tablet_bootstrap.cc:654] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.233178 26388 tablet_bootstrap.cc:654] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.256683 26389 tablet_bootstrap.cc:492] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.259546 26389 ts_tablet_manager.cc:1403] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.004s
I20260709 13:11:02.262962 26157 tablet_service.cc:1511] Processing CreateTablet for tablet 16d82749b4804f96a4d43ce4c080d9c2 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:02.264277 26157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d82749b4804f96a4d43ce4c080d9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.270845 26230 tablet_service.cc:1511] Processing CreateTablet for tablet 16d82749b4804f96a4d43ce4c080d9c2 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:02.272148 26230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d82749b4804f96a4d43ce4c080d9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.272866 26079 tablet_service.cc:1511] Processing CreateTablet for tablet 16d82749b4804f96a4d43ce4c080d9c2 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:02.274066 26079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d82749b4804f96a4d43ce4c080d9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.274261 26160 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcb0ed33c6240ff929ff0f070204f64 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:02.275441 26160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcb0ed33c6240ff929ff0f070204f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.283092 26084 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcb0ed33c6240ff929ff0f070204f64 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:02.284314 26084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcb0ed33c6240ff929ff0f070204f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.258949 26388 tablet_bootstrap.cc:492] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.288228 26388 ts_tablet_manager.cc:1403] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.006s
I20260709 13:11:02.301395 26389 raft_consensus.cc:359] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.291227 26388 raft_consensus.cc:359] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.304010 26388 raft_consensus.cc:385] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.304296 26388 raft_consensus.cc:740] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.305107 26388 consensus_queue.cc:260] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.305163 26233 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcb0ed33c6240ff929ff0f070204f64 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:02.306471 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcb0ed33c6240ff929ff0f070204f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.309805 26388 ts_tablet_manager.cc:1434] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.003s
I20260709 13:11:02.311455 26388 tablet_bootstrap.cc:492] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.310173 26389 raft_consensus.cc:385] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.314919 26389 raft_consensus.cc:740] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.315712 26389 consensus_queue.cc:260] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.318022 26389 ts_tablet_manager.cc:1434] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:11:02.318977 26389 tablet_bootstrap.cc:492] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.326115 26389 tablet_bootstrap.cc:654] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.311924 26391 tablet_bootstrap.cc:492] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.335784 26230 tablet_service.cc:1511] Processing CreateTablet for tablet db637d3500f340ef9ec580ee2c7d7ed4 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:02.337044 26230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db637d3500f340ef9ec580ee2c7d7ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.338474 26388 tablet_bootstrap.cc:654] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:02.341648 26271 tablet.cc:2406] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:02.346987 26391 tablet_bootstrap.cc:654] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.352298 26389 tablet_bootstrap.cc:492] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.352862 26389 ts_tablet_manager.cc:1403] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.024s
I20260709 13:11:02.353830 26079 tablet_service.cc:1511] Processing CreateTablet for tablet db637d3500f340ef9ec580ee2c7d7ed4 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:02.356292 26079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db637d3500f340ef9ec580ee2c7d7ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.356199 26389 raft_consensus.cc:359] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.360133 26389 raft_consensus.cc:385] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.360843 26389 raft_consensus.cc:740] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.362491 26389 consensus_queue.cc:260] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
W20260709 13:11:02.363278 26134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.3:40949, user_credentials={real_user=slave}} blocked reactor thread for 50797.2us
I20260709 13:11:02.364821 26388 tablet_bootstrap.cc:492] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.365357 26388 ts_tablet_manager.cc:1403] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.005s
I20260709 13:11:02.367288 26159 tablet_service.cc:1511] Processing CreateTablet for tablet db637d3500f340ef9ec580ee2c7d7ed4 (DEFAULT_TABLE table=soft_deleted_table [id=663990db034740afaf9568a155ba6f62]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:02.367713 26389 ts_tablet_manager.cc:1434] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:02.368312 26388 raft_consensus.cc:359] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.370435 26388 raft_consensus.cc:385] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.370779 26389 tablet_bootstrap.cc:492] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.370442 26159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db637d3500f340ef9ec580ee2c7d7ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.371001 26388 raft_consensus.cc:740] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.371934 26388 consensus_queue.cc:260] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.377017 26388 ts_tablet_manager.cc:1434] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:11:02.378046 26388 tablet_bootstrap.cc:492] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.384115 26388 tablet_bootstrap.cc:654] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.369490 26391 tablet_bootstrap.cc:492] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.387128 26391 ts_tablet_manager.cc:1403] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.010s
I20260709 13:11:02.385490 26389 tablet_bootstrap.cc:654] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.390285 26391 raft_consensus.cc:359] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.390974 26391 raft_consensus.cc:385] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.391187 26391 raft_consensus.cc:740] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.391783 26391 consensus_queue.cc:260] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.393975 26391 ts_tablet_manager.cc:1434] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:11:02.394938 26391 tablet_bootstrap.cc:492] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.396842 26388 tablet_bootstrap.cc:492] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.398958 26388 ts_tablet_manager.cc:1403] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:11:02.400676 26391 tablet_bootstrap.cc:654] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.401675 26388 raft_consensus.cc:359] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.402366 26388 raft_consensus.cc:385] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.402601 26388 raft_consensus.cc:740] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.398468 26389 tablet_bootstrap.cc:492] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.403147 26388 consensus_queue.cc:260] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.403957 26389 ts_tablet_manager.cc:1403] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.008s
I20260709 13:11:02.405494 26391 tablet_bootstrap.cc:492] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.405997 26391 ts_tablet_manager.cc:1403] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 13:11:02.406808 26389 raft_consensus.cc:359] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.407508 26389 raft_consensus.cc:385] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.407605 26388 ts_tablet_manager.cc:1434] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:11:02.407883 26389 raft_consensus.cc:740] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.408753 26388 tablet_bootstrap.cc:492] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.408787 26389 consensus_queue.cc:260] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.409633 26391 raft_consensus.cc:359] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.410518 26391 raft_consensus.cc:385] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.410808 26391 raft_consensus.cc:740] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.410996 26389 ts_tablet_manager.cc:1434] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:11:02.411862 26389 tablet_bootstrap.cc:492] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.411479 26391 consensus_queue.cc:260] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.411958 26390 raft_consensus.cc:493] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.412611 26390 raft_consensus.cc:515] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.414593 26390 leader_election.cc:290] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.416057 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9733416f28ac4c7b8e9a9be19928b6c9" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:11:02.417508 26169 raft_consensus.cc:2468] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:11:02.417666 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9733416f28ac4c7b8e9a9be19928b6c9" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.417874 26389 tablet_bootstrap.cc:654] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.418265 26243 raft_consensus.cc:2468] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:11:02.418874 26061 leader_election.cc:304] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.419631 26390 raft_consensus.cc:2804] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.420284 26390 raft_consensus.cc:493] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.420682 26390 raft_consensus.cc:3060] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.420986 26391 ts_tablet_manager.cc:1434] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:11:02.423470 26391 tablet_bootstrap.cc:492] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.423491 26388 tablet_bootstrap.cc:654] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.426419 26389 tablet_bootstrap.cc:492] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.427011 26389 ts_tablet_manager.cc:1403] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:11:02.430379 26391 tablet_bootstrap.cc:654] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.430081 26389 raft_consensus.cc:359] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.431838 26389 raft_consensus.cc:385] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.432195 26389 raft_consensus.cc:740] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.432965 26389 consensus_queue.cc:260] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.434185 26388 tablet_bootstrap.cc:492] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.434875 26388 ts_tablet_manager.cc:1403] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.005s
I20260709 13:11:02.435218 26389 ts_tablet_manager.cc:1434] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:02.436270 26389 tablet_bootstrap.cc:492] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.437988 26388 raft_consensus.cc:359] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.438747 26388 raft_consensus.cc:385] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.439072 26388 raft_consensus.cc:740] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.439808 26388 consensus_queue.cc:260] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.442416 26389 tablet_bootstrap.cc:654] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.443356 26362 raft_consensus.cc:493] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.443831 26362 raft_consensus.cc:515] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.445741 26362 leader_election.cc:290] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.447194 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accf7ab19fa4952844a344af29d758b" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:11:02.449317 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accf7ab19fa4952844a344af29d758b" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.449596 26388 ts_tablet_manager.cc:1434] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 13:11:02.450615 26061 leader_election.cc:343] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.452870 26388 tablet_bootstrap.cc:492] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
W20260709 13:11:02.455503 26059 leader_election.cc:343] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.447639 26390 raft_consensus.cc:515] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.455976 26059 leader_election.cc:304] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5; no voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:11:02.457721 26362 raft_consensus.cc:2749] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.458426 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9733416f28ac4c7b8e9a9be19928b6c9" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:02.459770 26243 raft_consensus.cc:3060] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.460121 26388 tablet_bootstrap.cc:654] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.460336 26390 leader_election.cc:290] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.463986 26391 tablet_bootstrap.cc:492] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.464497 26391 ts_tablet_manager.cc:1403] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.018s
I20260709 13:11:02.465407 26388 tablet_bootstrap.cc:492] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.465958 26388 ts_tablet_manager.cc:1403] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.005s
I20260709 13:11:02.466508 26243 raft_consensus.cc:2468] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:11:02.467679 26059 leader_election.cc:304] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:11:02.467666 26391 raft_consensus.cc:359] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.468765 26391 raft_consensus.cc:385] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.469055 26391 raft_consensus.cc:740] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.469081 26388 raft_consensus.cc:359] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.469893 26388 raft_consensus.cc:385] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.469862 26391 consensus_queue.cc:260] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.470383 26388 raft_consensus.cc:740] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.470816 26362 raft_consensus.cc:2804] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:02.470311 26042 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:02.471704 26362 raft_consensus.cc:697] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:11:02.472424 26391 ts_tablet_manager.cc:1434] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:11:02.473982 26391 tablet_bootstrap.cc:492] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.473578 26388 consensus_queue.cc:260] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.472618 26362 consensus_queue.cc:237] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.477103 26388 ts_tablet_manager.cc:1434] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:11:02.478077 26388 tablet_bootstrap.cc:492] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.481943 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9733416f28ac4c7b8e9a9be19928b6c9" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:02.482537 26169 raft_consensus.cc:3060] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.483772 26391 tablet_bootstrap.cc:654] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.484292 26288 raft_consensus.cc:493] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.485505 26388 tablet_bootstrap.cc:654] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.485726 26288 raft_consensus.cc:515] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.489522 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575a79dd06648cab40ee498335bcaf7" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
W20260709 13:11:02.491297 26135 leader_election.cc:343] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.491750 26389 tablet_bootstrap.cc:492] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.489845 26169 raft_consensus.cc:2468] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:11:02.493167 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575a79dd06648cab40ee498335bcaf7" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.493898 26243 raft_consensus.cc:2468] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:11:02.494164 26389 ts_tablet_manager.cc:1403] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.004s
I20260709 13:11:02.495246 26134 leader_election.cc:304] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:11:02.496378 26394 raft_consensus.cc:2804] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.496798 26394 raft_consensus.cc:493] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.497140 26394 raft_consensus.cc:3060] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.498054 26389 raft_consensus.cc:359] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.500231 26288 leader_election.cc:290] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.504869 25992 catalog_manager.cc:5697] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.505963 26389 raft_consensus.cc:385] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.510210 26389 raft_consensus.cc:740] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.511164 26391 tablet_bootstrap.cc:492] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.511092 26389 consensus_queue.cc:260] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.511745 26391 ts_tablet_manager.cc:1403] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.005s
I20260709 13:11:02.513836 26389 ts_tablet_manager.cc:1434] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:02.509181 26394 raft_consensus.cc:515] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.514566 26377 raft_consensus.cc:493] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.514858 26389 tablet_bootstrap.cc:492] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.515030 26377 raft_consensus.cc:515] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.517321 26377 leader_election.cc:290] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:02.519595 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd8a0f0412f4d009321e8e96dcd9239" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:11:02.520125 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd8a0f0412f4d009321e8e96dcd9239" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
W20260709 13:11:02.521615 26209 leader_election.cc:343] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.522369 26391 raft_consensus.cc:359] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.521551 26394 leader_election.cc:290] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.523550 26391 raft_consensus.cc:385] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.524001 26391 raft_consensus.cc:740] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.524044 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575a79dd06648cab40ee498335bcaf7" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:02.525015 26391 consensus_queue.cc:260] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
W20260709 13:11:02.525713 26135 leader_election.cc:343] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.527268 26389 tablet_bootstrap.cc:654] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.527616 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1575a79dd06648cab40ee498335bcaf7" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:02.528445 26243 raft_consensus.cc:3060] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.530174 26391 ts_tablet_manager.cc:1434] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:02.531253 26391 tablet_bootstrap.cc:492] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
W20260709 13:11:02.522382 26210 leader_election.cc:343] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.531914 26210 leader_election.cc:304] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3; no voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:11:02.532897 26377 raft_consensus.cc:2749] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.539820 26389 tablet_bootstrap.cc:492] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.540383 26389 ts_tablet_manager.cc:1403] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.006s
I20260709 13:11:02.540385 26391 tablet_bootstrap.cc:654] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.543329 26389 raft_consensus.cc:359] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.544904 26389 raft_consensus.cc:385] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.545243 26389 raft_consensus.cc:740] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.546020 26389 consensus_queue.cc:260] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.548354 26389 ts_tablet_manager.cc:1434] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:11:02.549415 26389 tablet_bootstrap.cc:492] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.555666 26389 tablet_bootstrap.cc:654] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.567452 26389 tablet_bootstrap.cc:492] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.568034 26389 ts_tablet_manager.cc:1403] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:11:02.570920 26389 raft_consensus.cc:359] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.571755 26389 raft_consensus.cc:385] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.572129 26389 raft_consensus.cc:740] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.572994 26389 consensus_queue.cc:260] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.575207 26389 ts_tablet_manager.cc:1434] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:02.576248 26362 raft_consensus.cc:493] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.576777 26362 raft_consensus.cc:515] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.577787 26243 raft_consensus.cc:2468] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:11:02.578796 26362 leader_election.cc:290] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.579101 26134 leader_election.cc:304] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:11:02.580653 26394 raft_consensus.cc:2804] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.581130 26394 raft_consensus.cc:697] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:11:02.581779 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.581974 26394 consensus_queue.cc:237] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
W20260709 13:11:02.583244 26059 leader_election.cc:343] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.581234 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
W20260709 13:11:02.585052 26061 leader_election.cc:343] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.585481 26061 leader_election.cc:304] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5; no voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:11:02.586565 26362 raft_consensus.cc:2749] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.587337 26389 tablet_bootstrap.cc:492] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.593487 26389 tablet_bootstrap.cc:654] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.606166 25992 catalog_manager.cc:5697] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.610025 26389 tablet_bootstrap.cc:492] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.610589 26389 ts_tablet_manager.cc:1403] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.014s
I20260709 13:11:02.613262 26389 raft_consensus.cc:359] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.613910 26389 raft_consensus.cc:385] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.614174 26389 raft_consensus.cc:740] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.614892 26389 consensus_queue.cc:260] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.617131 26391 tablet_bootstrap.cc:492] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.617378 26389 ts_tablet_manager.cc:1434] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:02.617838 26391 ts_tablet_manager.cc:1403] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.087s	user 0.041s	sys 0.027s
I20260709 13:11:02.618641 26389 tablet_bootstrap.cc:492] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3: Bootstrap starting.
I20260709 13:11:02.620462 26388 tablet_bootstrap.cc:492] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.621023 26388 ts_tablet_manager.cc:1403] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.143s	user 0.059s	sys 0.066s
I20260709 13:11:02.622143 26391 raft_consensus.cc:359] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.623015 26391 raft_consensus.cc:385] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.623348 26391 raft_consensus.cc:740] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.623929 26388 raft_consensus.cc:359] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.624691 26388 raft_consensus.cc:385] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.624264 26391 consensus_queue.cc:260] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.625056 26388 raft_consensus.cc:740] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.625977 26388 consensus_queue.cc:260] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.628361 26388 ts_tablet_manager.cc:1434] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:11:02.628711 26389 tablet_bootstrap.cc:654] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.626763 26391 ts_tablet_manager.cc:1434] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:11:02.629467 26388 tablet_bootstrap.cc:492] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.629837 26391 tablet_bootstrap.cc:492] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.637298 26388 tablet_bootstrap.cc:654] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.641831 26391 tablet_bootstrap.cc:654] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.644204 26389 tablet_bootstrap.cc:492] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3: No bootstrap required, opened a new log
I20260709 13:11:02.644929 26389 ts_tablet_manager.cc:1403] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 13:11:02.647491 26389 raft_consensus.cc:359] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.648299 26389 raft_consensus.cc:385] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.648613 26389 raft_consensus.cc:740] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.649292 26389 consensus_queue.cc:260] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.651587 26389 ts_tablet_manager.cc:1434] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:11:02.654788 26388 tablet_bootstrap.cc:492] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.654811 26391 tablet_bootstrap.cc:492] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.656101 26391 ts_tablet_manager.cc:1403] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 13:11:02.655488 26388 ts_tablet_manager.cc:1403] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 13:11:02.659075 26388 raft_consensus.cc:359] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.659312 26391 raft_consensus.cc:359] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.659757 26388 raft_consensus.cc:385] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.660023 26391 raft_consensus.cc:385] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.660095 26388 raft_consensus.cc:740] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.660425 26391 raft_consensus.cc:740] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.660900 26388 consensus_queue.cc:260] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.661226 26391 consensus_queue.cc:260] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.663198 26388 ts_tablet_manager.cc:1434] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:02.664204 26388 tablet_bootstrap.cc:492] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.664709 26391 ts_tablet_manager.cc:1434] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:02.665715 26391 tablet_bootstrap.cc:492] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.670154 26388 tablet_bootstrap.cc:654] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.672006 26391 tablet_bootstrap.cc:654] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.675020 26388 tablet_bootstrap.cc:492] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.675441 26388 ts_tablet_manager.cc:1403] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:02.676678 26391 tablet_bootstrap.cc:492] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.677153 26391 ts_tablet_manager.cc:1403] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:11:02.677806 26388 raft_consensus.cc:359] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.678298 26388 raft_consensus.cc:385] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.678488 26388 raft_consensus.cc:740] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.679023 26388 consensus_queue.cc:260] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.679903 26391 raft_consensus.cc:359] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.680469 26391 raft_consensus.cc:385] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.680685 26391 raft_consensus.cc:740] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.680931 26388 ts_tablet_manager.cc:1434] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:11:02.681280 26391 consensus_queue.cc:260] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.681840 26388 tablet_bootstrap.cc:492] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5: Bootstrap starting.
I20260709 13:11:02.683003 26391 ts_tablet_manager.cc:1434] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:11:02.684055 26391 tablet_bootstrap.cc:492] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.687573 26388 tablet_bootstrap.cc:654] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.689538 26391 tablet_bootstrap.cc:654] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.696834 26388 tablet_bootstrap.cc:492] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5: No bootstrap required, opened a new log
I20260709 13:11:02.697187 26388 ts_tablet_manager.cc:1403] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:11:02.699198 26388 raft_consensus.cc:359] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.699635 26388 raft_consensus.cc:385] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.699832 26388 raft_consensus.cc:740] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.700043 26391 tablet_bootstrap.cc:492] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.700453 26391 ts_tablet_manager.cc:1403] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 13:11:02.700333 26388 consensus_queue.cc:260] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.702117 26388 ts_tablet_manager.cc:1434] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:02.702531 26391 raft_consensus.cc:359] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.703109 26391 raft_consensus.cc:385] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.703359 26391 raft_consensus.cc:740] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.704095 26391 consensus_queue.cc:260] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.705987 26391 ts_tablet_manager.cc:1434] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:02.706820 26391 tablet_bootstrap.cc:492] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: Bootstrap starting.
I20260709 13:11:02.710868 26391 tablet_bootstrap.cc:654] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.716142 26391 tablet_bootstrap.cc:492] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: No bootstrap required, opened a new log
I20260709 13:11:02.716559 26391 ts_tablet_manager.cc:1403] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:02.718945 26391 raft_consensus.cc:359] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.719426 26391 raft_consensus.cc:385] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.719677 26391 raft_consensus.cc:740] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.720299 26391 consensus_queue.cc:260] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.721985 26391 ts_tablet_manager.cc:1434] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:02.740207 26377 raft_consensus.cc:493] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.740618 26377 raft_consensus.cc:515] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.742211 26377 leader_election.cc:290] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:02.742727 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:11:02.743117 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:11:02.743412 26095 raft_consensus.cc:2468] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:11:02.743762 26170 raft_consensus.cc:2468] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:11:02.744400 26209 leader_election.cc:304] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:11:02.745139 26377 raft_consensus.cc:2804] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.745412 26377 raft_consensus.cc:493] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.745651 26377 raft_consensus.cc:3060] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.747118 26362 raft_consensus.cc:493] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.747598 26362 raft_consensus.cc:515] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.750061 26390 raft_consensus.cc:493] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.750705 26424 raft_consensus.cc:493] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.750553 26390 raft_consensus.cc:515] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.751170 26424 raft_consensus.cc:515] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.752117 26377 raft_consensus.cc:515] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.752548 26390 leader_election.cc:290] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.753423 26424 leader_election.cc:290] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:02.753715 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd8a0f0412f4d009321e8e96dcd9239" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:11:02.754001 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:11:02.754354 26170 raft_consensus.cc:2468] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:11:02.754424 26377 leader_election.cc:290] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:02.754524 26169 raft_consensus.cc:2468] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:11:02.755738 26061 leader_election.cc:304] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.756269 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:11:02.756618 26061 leader_election.cc:304] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.756877 26169 raft_consensus.cc:2468] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:11:02.749600 26362 leader_election.cc:290] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.757829 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd8a0f0412f4d009321e8e96dcd9239" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.758447 26243 raft_consensus.cc:2468] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:11:02.758543 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:11:02.758735 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:02.759248 26170 raft_consensus.cc:3060] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.759871 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:02.758440 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.760511 26245 raft_consensus.cc:2468] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 0.
I20260709 13:11:02.760440 26094 raft_consensus.cc:3060] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.762013 26210 leader_election.cc:304] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.762949 26377 raft_consensus.cc:2804] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.763338 26377 raft_consensus.cc:493] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.763720 26377 raft_consensus.cc:3060] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.756480 26404 raft_consensus.cc:2804] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.764786 26404 raft_consensus.cc:493] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.765105 26404 raft_consensus.cc:3060] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.765865 26170 raft_consensus.cc:2468] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:11:02.766940 26210 leader_election.cc:304] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.768072 26424 raft_consensus.cc:2804] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.757388 26390 raft_consensus.cc:2804] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.769974 26094 raft_consensus.cc:2468] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:11:02.770218 26095 raft_consensus.cc:2468] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:11:02.771643 26390 raft_consensus.cc:493] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.773479 26390 raft_consensus.cc:3060] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.772989 26424 raft_consensus.cc:697] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:02.775079 26424 consensus_queue.cc:237] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.775749 26394 raft_consensus.cc:493] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.776299 26394 raft_consensus.cc:515] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.777607 26377 raft_consensus.cc:515] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.778936 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accf7ab19fa4952844a344af29d758b" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:11:02.779618 26095 raft_consensus.cc:2468] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:11:02.780263 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:02.780802 26135 leader_election.cc:304] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.781420 26377 leader_election.cc:290] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:02.781749 26288 raft_consensus.cc:2804] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.782123 26288 raft_consensus.cc:493] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.782260 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:02.782482 26288 raft_consensus.cc:3060] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.782860 26170 raft_consensus.cc:3060] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.780879 26390 raft_consensus.cc:515] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.784214 26094 raft_consensus.cc:2393] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e8492604e174aeabbc9c46ebb659dc3 in current term 1: Already voted for candidate 66542e9b217f43d7ae827345bc7a93b5 in this term.
I20260709 13:11:02.789393 26390 leader_election.cc:290] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.790108 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:02.791493 26394 leader_election.cc:290] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.791640 26245 raft_consensus.cc:2393] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66542e9b217f43d7ae827345bc7a93b5 in current term 1: Already voted for candidate 2e8492604e174aeabbc9c46ebb659dc3 in this term.
I20260709 13:11:02.792696 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accf7ab19fa4952844a344af29d758b" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.790472 26170 raft_consensus.cc:2468] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:11:02.789680 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:02.793285 26243 raft_consensus.cc:2468] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:11:02.793144 26288 raft_consensus.cc:515] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.794613 26061 leader_election.cc:304] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5; no voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:11:02.795257 26390 raft_consensus.cc:2749] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.797806 26210 leader_election.cc:304] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:11:02.797827 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accf7ab19fa4952844a344af29d758b" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:02.775569 26404 raft_consensus.cc:515] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.798736 26243 raft_consensus.cc:3060] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.799944 26377 raft_consensus.cc:493] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.800392 26404 leader_election.cc:290] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.800457 26377 raft_consensus.cc:515] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.803974 26377 leader_election.cc:290] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:02.804508 26377 raft_consensus.cc:2804] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.804581 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:11:02.805074 26377 raft_consensus.cc:697] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:02.805241 26094 raft_consensus.cc:2468] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:11:02.805562 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442" is_pre_election: true
I20260709 13:11:02.805892 26377 consensus_queue.cc:237] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.806658 26209 leader_election.cc:304] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:11:02.807389 26171 raft_consensus.cc:2468] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 0.
I20260709 13:11:02.807489 26425 raft_consensus.cc:2804] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.806998 25994 catalog_manager.cc:5697] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.807951 26425 raft_consensus.cc:493] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.808420 26425 raft_consensus.cc:3060] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.806998 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd8a0f0412f4d009321e8e96dcd9239" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:02.809311 26169 raft_consensus.cc:3060] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.810498 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accf7ab19fa4952844a344af29d758b" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:02.811039 26095 raft_consensus.cc:3060] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.815461 26425 raft_consensus.cc:515] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.818332 26425 leader_election.cc:290] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:02.818357 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:02.816111 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd8a0f0412f4d009321e8e96dcd9239" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:02.819068 26094 raft_consensus.cc:3060] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.819422 26245 raft_consensus.cc:3060] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.821120 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:02.821352 26243 raft_consensus.cc:2468] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:11:02.821707 26171 raft_consensus.cc:3060] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.824412 26134 leader_election.cc:304] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.825640 26094 raft_consensus.cc:2468] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:11:02.826053 26245 raft_consensus.cc:2468] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:11:02.826917 26209 leader_election.cc:304] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:11:02.827190 26394 raft_consensus.cc:493] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.827647 26394 raft_consensus.cc:515] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.827944 26059 leader_election.cc:304] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:11:02.828794 26404 raft_consensus.cc:2804] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.829229 26404 raft_consensus.cc:697] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:11:02.797902 26288 leader_election.cc:290] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.829902 26288 raft_consensus.cc:2804] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.829968 26404 consensus_queue.cc:237] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.830618 26171 raft_consensus.cc:2468] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 1.
I20260709 13:11:02.829916 26169 raft_consensus.cc:2468] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 1.
I20260709 13:11:02.832314 26095 raft_consensus.cc:2468] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:11:02.833487 26394 leader_election.cc:290] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.833654 26425 raft_consensus.cc:2804] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.834404 26425 raft_consensus.cc:697] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:02.835327 26425 consensus_queue.cc:237] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.830428 26288 raft_consensus.cc:697] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:11:02.835347 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.837514 26243 raft_consensus.cc:2468] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:11:02.837756 26288 consensus_queue.cc:237] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.839623 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:11:02.840417 26095 raft_consensus.cc:2468] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:11:02.840519 26134 leader_election.cc:304] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.843006 26288 raft_consensus.cc:2804] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.843394 26288 raft_consensus.cc:493] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.843775 26288 raft_consensus.cc:3060] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.847663 25994 catalog_manager.cc:5697] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 1 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.849888 25993 catalog_manager.cc:5697] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.850883 26288 raft_consensus.cc:515] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.852855 26288 leader_election.cc:290] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.855244 25992 catalog_manager.cc:5697] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.856841 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:02.857406 26095 raft_consensus.cc:3060] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.857677 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:02.858201 26243 raft_consensus.cc:3060] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.859382 25992 catalog_manager.cc:5697] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 1 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.863899 26243 raft_consensus.cc:2468] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:11:02.865002 26134 leader_election.cc:304] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.866012 26288 raft_consensus.cc:2804] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.866122 26095 raft_consensus.cc:2468] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:11:02.866506 26288 raft_consensus.cc:697] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:11:02.867587 26288 consensus_queue.cc:237] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.875176 25993 catalog_manager.cc:5697] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.957557 26390 consensus_queue.cc:1048] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:02.967912 26404 consensus_queue.cc:1048] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:02.980058 26428 raft_consensus.cc:493] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.980490 26428 raft_consensus.cc:515] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.982463 26428 leader_election.cc:290] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.982350 26288 consensus_queue.cc:1048] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:02.983309 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d82749b4804f96a4d43ce4c080d9c2" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5" is_pre_election: true
I20260709 13:11:02.983930 26095 raft_consensus.cc:2468] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:11:02.984306 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d82749b4804f96a4d43ce4c080d9c2" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3" is_pre_election: true
I20260709 13:11:02.984905 26243 raft_consensus.cc:2468] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 0.
I20260709 13:11:02.985042 26135 leader_election.cc:304] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:02.986181 26288 raft_consensus.cc:2804] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.986505 26288 raft_consensus.cc:493] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.986822 26288 raft_consensus.cc:3060] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.993350 26095 raft_consensus.cc:3060] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.993484 26288 raft_consensus.cc:515] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:02.995460 26288 leader_election.cc:290] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:02.996093 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d82749b4804f96a4d43ce4c080d9c2" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:02.996731 26094 raft_consensus.cc:3060] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.997310 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d82749b4804f96a4d43ce4c080d9c2" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:02.997826 26243 raft_consensus.cc:3060] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.003151 26094 raft_consensus.cc:2468] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:11:03.004200 26243 raft_consensus.cc:2468] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 1.
I20260709 13:11:03.004299 26135 leader_election.cc:304] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:03.005260 26288 raft_consensus.cc:2804] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.005617 26288 raft_consensus.cc:697] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:11:03.006397 26288 consensus_queue.cc:237] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.009595 26394 consensus_queue.cc:1048] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.014158 25993 catalog_manager.cc:5697] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 1 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.096231 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
mode: GRACEFUL
new_leader_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:11:03.096696 26243 raft_consensus.cc:606] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Received request to transfer leadership to TS 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:11:03.105319 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc201e072c414937916e27508a78e6d0"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
mode: GRACEFUL
new_leader_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:11:03.105737 26243 raft_consensus.cc:606] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Received request to transfer leadership to TS 66542e9b217f43d7ae827345bc7a93b5
I20260709 13:11:03.116914 26243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
mode: GRACEFUL
new_leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:11:03.117314 26243 raft_consensus.cc:606] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Received request to transfer leadership to TS 8fdbd6ca12394ae4b0d73c5122292442
I20260709 13:11:03.121336 26171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
mode: GRACEFUL
new_leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:55722
I20260709 13:11:03.121766 26171 raft_consensus.cc:606] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Received request to transfer leadership to TS 2e8492604e174aeabbc9c46ebb659dc3
I20260709 13:11:03.196842 26425 consensus_queue.cc:1048] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.202579 26424 raft_consensus.cc:993] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: : Instructing follower 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:11:03.203002 26424 raft_consensus.cc:1081] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Signalling peer 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:11:03.206614 26094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:35568
I20260709 13:11:03.206822 26425 consensus_queue.cc:1048] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.207175 26094 raft_consensus.cc:493] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.207571 26094 raft_consensus.cc:3060] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.214342 26094 raft_consensus.cc:515] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.215242 26095 raft_consensus.cc:1240] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Rejecting Update request from peer 2e8492604e174aeabbc9c46ebb659dc3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.216323 26094 leader_election.cc:290] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:03.216938 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:03.217331 26245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9df3303627a470bb9a209ec24043c44" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:03.217603 26171 raft_consensus.cc:3060] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.218497 26425 consensus_queue.cc:1059] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.220758 26245 raft_consensus.cc:3055] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.221081 26245 raft_consensus.cc:740] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:03.221853 26245 consensus_queue.cc:260] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.223140 26245 raft_consensus.cc:3060] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.224999 26171 raft_consensus.cc:2468] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:11:03.226058 26061 leader_election.cc:304] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:03.226853 26404 raft_consensus.cc:2804] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.227398 26404 raft_consensus.cc:697] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:11:03.228214 26404 consensus_queue.cc:237] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.229140 26245 raft_consensus.cc:2468] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
W20260709 13:11:03.229674 26424 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:03.236317 25993 catalog_manager.cc:5697] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 1 to 2, leader changed from 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3) to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.244513 26288 consensus_queue.cc:1048] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.247386 26404 consensus_queue.cc:1048] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.255182 26394 consensus_queue.cc:1048] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.267100 26424 consensus_queue.cc:1048] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.271940 26390 consensus_queue.cc:1048] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.289009 26429 consensus_queue.cc:1048] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.294384 26394 consensus_queue.cc:1048] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.296917 26425 consensus_queue.cc:1048] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:03.314776 26425 raft_consensus.cc:993] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: : Instructing follower 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:11:03.315290 26424 raft_consensus.cc:1081] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Signalling peer 66542e9b217f43d7ae827345bc7a93b5 to start an election
I20260709 13:11:03.317123 26094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc201e072c414937916e27508a78e6d0"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
 from {username='slave'} at 127.0.0.1:35568
I20260709 13:11:03.317653 26094 raft_consensus.cc:493] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.317977 26094 raft_consensus.cc:3060] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.323603 26428 raft_consensus.cc:993] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: : Instructing follower 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:11:03.324995 26428 raft_consensus.cc:1081] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Signalling peer 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:11:03.329960 26245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:36438
I20260709 13:11:03.330596 26245 raft_consensus.cc:493] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.331030 26245 raft_consensus.cc:3060] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.336933 26094 raft_consensus.cc:515] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.337936 26245 raft_consensus.cc:515] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.339532 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:03.340160 26171 raft_consensus.cc:3060] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.340713 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:03.341300 26095 raft_consensus.cc:3060] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.345973 26243 raft_consensus.cc:1240] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Rejecting Update request from peer 8fdbd6ca12394ae4b0d73c5122292442 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.346527 26171 raft_consensus.cc:2468] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:11:03.348879 26094 leader_election.cc:290] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:03.348934 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db637d3500f340ef9ec580ee2c7d7ed4" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:03.349718 26061 leader_election.cc:304] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:03.350144 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc201e072c414937916e27508a78e6d0" candidate_uuid: "66542e9b217f43d7ae827345bc7a93b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:03.350492 26404 raft_consensus.cc:2804] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.347275 26095 raft_consensus.cc:2468] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 2.
I20260709 13:11:03.347972 26245 leader_election.cc:290] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 2 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:03.348131 26288 consensus_queue.cc:1059] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.351040 26404 raft_consensus.cc:697] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Becoming Leader. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:11:03.351678 26209 leader_election.cc:304] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:11:03.352061 26169 raft_consensus.cc:3055] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.351971 26404 consensus_queue.cc:237] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.352542 26169 raft_consensus.cc:740] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:11:03.352559 26425 raft_consensus.cc:2804] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.353173 26425 raft_consensus.cc:697] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:03.353461 26169 consensus_queue.cc:260] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.353991 26425 consensus_queue.cc:237] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.354750 26169 raft_consensus.cc:3060] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.360419 26169 raft_consensus.cc:2468] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 2.
W20260709 13:11:03.360829 26429 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:03.362039 25994 catalog_manager.cc:5697] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 1 to 2, leader changed from 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2) to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.350626 26243 raft_consensus.cc:3055] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.363142 26243 raft_consensus.cc:740] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:03.363776 26243 consensus_queue.cc:260] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.369076 26243 raft_consensus.cc:3060] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.366583 25993 catalog_manager.cc:5697] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 reported cstate change: term changed from 1 to 2, leader changed from 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3) to 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1). New cstate: current_term: 2 leader_uuid: "66542e9b217f43d7ae827345bc7a93b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.374294 26243 raft_consensus.cc:2468] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66542e9b217f43d7ae827345bc7a93b5 in term 2.
I20260709 13:11:03.446250 26425 consensus_queue.cc:1048] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.449080 26424 consensus_queue.cc:1048] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.452505 26425 raft_consensus.cc:993] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: : Instructing follower 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:11:03.453053 26425 raft_consensus.cc:1081] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Signalling peer 8fdbd6ca12394ae4b0d73c5122292442 to start an election
I20260709 13:11:03.457433 26171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:11:03.457940 26171 raft_consensus.cc:493] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.458276 26171 raft_consensus.cc:3060] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.467187 26171 raft_consensus.cc:515] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.468098 26169 raft_consensus.cc:1240] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Rejecting Update request from peer 2e8492604e174aeabbc9c46ebb659dc3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.469843 26095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:03.469951 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcb0ed33c6240ff929ff0f070204f64" candidate_uuid: "8fdbd6ca12394ae4b0d73c5122292442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
I20260709 13:11:03.470196 26425 consensus_queue.cc:1059] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.470544 26095 raft_consensus.cc:3060] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.471096 26171 leader_election.cc:290] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3:40949)
I20260709 13:11:03.471112 26243 raft_consensus.cc:3055] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.476017 26243 raft_consensus.cc:740] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:03.476567 26095 raft_consensus.cc:2468] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
I20260709 13:11:03.476652 26243 consensus_queue.cc:260] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.477660 26135 leader_election.cc:304] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66542e9b217f43d7ae827345bc7a93b5, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:03.477838 26243 raft_consensus.cc:3060] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.478451 26429 raft_consensus.cc:2804] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.478940 26429 raft_consensus.cc:697] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:11:03.479717 26429 consensus_queue.cc:237] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:03.482295 26243 raft_consensus.cc:2468] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdbd6ca12394ae4b0d73c5122292442 in term 2.
W20260709 13:11:03.482748 26424 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:03.486786 25993 catalog_manager.cc:5697] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 reported cstate change: term changed from 1 to 2, leader changed from 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3) to 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2). New cstate: current_term: 2 leader_uuid: "8fdbd6ca12394ae4b0d73c5122292442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.595343 26428 consensus_queue.cc:1048] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.598915 26429 consensus_queue.cc:1048] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.716869 26245 raft_consensus.cc:1275] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.717928 26404 consensus_queue.cc:1048] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.721264 26171 raft_consensus.cc:1275] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.722535 26407 consensus_queue.cc:1048] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.786705 26171 raft_consensus.cc:1275] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.787731 26404 consensus_queue.cc:1048] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.794430 26245 raft_consensus.cc:1275] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 66542e9b217f43d7ae827345bc7a93b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.796324 26404 consensus_queue.cc:1048] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.915627 26095 raft_consensus.cc:1275] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.916774 26429 consensus_queue.cc:1048] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.926870 26245 raft_consensus.cc:1275] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Refusing update from remote peer 8fdbd6ca12394ae4b0d73c5122292442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.928097 26428 consensus_queue.cc:1048] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.930673 26171 raft_consensus.cc:1275] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.932194 26424 consensus_queue.cc:1048] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.940121 26094 raft_consensus.cc:1275] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.942162 26425 consensus_queue.cc:1048] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.124730 25993 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37524:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:06.147902 25993 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37524:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:06.211714 15384 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:06.442071 26492 log.cc:927] Time spent T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
W20260709 13:11:06.372586 26061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.6.2:44095, user_credentials={real_user=slave}} blocked reactor thread for 81037us
W20260709 13:11:06.445755 26490 log.cc:927] Time spent T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 13:11:06.503670 26524 tablet.cc:1724] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.503947 26514 tablet.cc:1724] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.516592 26517 tablet.cc:1724] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.536337 26522 tablet.cc:1724] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.537060 26521 tablet.cc:1724] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.548606 26527 tablet.cc:1724] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.556391 26516 tablet.cc:1724] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.559852 26520 tablet.cc:1724] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.568079 26519 tablet.cc:1724] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.571489 26516 tablet.cc:1724] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.579860 26527 tablet.cc:1724] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.592607 26522 tablet.cc:1724] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.592659 26517 tablet.cc:1724] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.593655 26516 tablet.cc:1724] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.599452 26530 tablet.cc:1724] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.604307 26516 tablet.cc:1724] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.604307 26517 tablet.cc:1724] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.616706 26171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a"
dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
mode: GRACEFUL
new_leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:55736
I20260709 13:11:06.617393 26171 raft_consensus.cc:606] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Received request to transfer leadership to TS 2e8492604e174aeabbc9c46ebb659dc3
I20260709 13:11:06.624380 26517 tablet.cc:1724] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.590952 26519 tablet.cc:1724] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.628594 26531 tablet.cc:1724] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.627977 26532 tablet.cc:1724] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.641805 26514 tablet.cc:1724] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.651894 26516 tablet.cc:1724] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.653194 26514 tablet.cc:1724] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.659194 26520 tablet.cc:1724] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.692404 26531 tablet.cc:1724] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.694983 26094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5"
dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
mode: GRACEFUL
new_leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:35600
I20260709 13:11:06.697113 26094 raft_consensus.cc:606] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Received request to transfer leadership to TS 2e8492604e174aeabbc9c46ebb659dc3
I20260709 13:11:06.698670 15384 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:06.699280 15384 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:06.701032 26520 tablet.cc:1724] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:06.711508 25993 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9: soft_deleted_table [id=663990db034740afaf9568a155ba6f62] alter complete (version 1)
I20260709 13:11:06.816929 26526 raft_consensus.cc:993] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442: : Instructing follower 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:11:06.817405 26510 raft_consensus.cc:1081] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Signalling peer 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:11:06.818771 26240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:36438
I20260709 13:11:06.819224 26240 raft_consensus.cc:493] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:06.819504 26240 raft_consensus.cc:3060] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.824906 26240 raft_consensus.cc:515] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:06.826483 26240 leader_election.cc:290] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 2 election: Requested vote from peers 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973), 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095)
I20260709 13:11:06.827157 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:06.827683 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5406c83ce5a34f9c91467a72b4a1ed2a" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:06.827822 26094 raft_consensus.cc:3060] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.828209 26169 raft_consensus.cc:3055] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:06.828438 26169 raft_consensus.cc:740] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fdbd6ca12394ae4b0d73c5122292442, State: Running, Role: LEADER
I20260709 13:11:06.829130 26169 consensus_queue.cc:260] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:06.830081 26169 raft_consensus.cc:3060] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.833078 26094 raft_consensus.cc:2468] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 2.
I20260709 13:11:06.834122 26209 leader_election.cc:304] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 66542e9b217f43d7ae827345bc7a93b5; no voters: 
I20260709 13:11:06.834717 26169 raft_consensus.cc:2468] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 2.
I20260709 13:11:06.834947 26515 raft_consensus.cc:2804] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.835443 26515 raft_consensus.cc:697] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:06.836222 26515 consensus_queue.cc:237] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:06.843667 25993 catalog_manager.cc:5697] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 1 to 2, leader changed from 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2) to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.237989 26478 raft_consensus.cc:993] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5: : Instructing follower 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:11:07.238428 26464 raft_consensus.cc:1081] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Signalling peer 2e8492604e174aeabbc9c46ebb659dc3 to start an election
I20260709 13:11:07.239950 26240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5"
dest_uuid: "2e8492604e174aeabbc9c46ebb659dc3"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:11:07.240398 26240 raft_consensus.cc:493] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.240674 26240 raft_consensus.cc:3060] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.245489 26240 raft_consensus.cc:515] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:07.247253 26240 leader_election.cc:290] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095), 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973)
I20260709 13:11:07.247947 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdbd6ca12394ae4b0d73c5122292442"
I20260709 13:11:07.248288 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d276d7eb4be54876b82e6628b3cc00d5" candidate_uuid: "2e8492604e174aeabbc9c46ebb659dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66542e9b217f43d7ae827345bc7a93b5"
I20260709 13:11:07.248693 26171 raft_consensus.cc:3060] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.248937 26094 raft_consensus.cc:3055] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:07.249274 26094 raft_consensus.cc:740] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66542e9b217f43d7ae827345bc7a93b5, State: Running, Role: LEADER
I20260709 13:11:07.249850 26094 consensus_queue.cc:260] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:07.250697 26094 raft_consensus.cc:3060] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.253657 26171 raft_consensus.cc:2468] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 2.
I20260709 13:11:07.254624 26210 leader_election.cc:304] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e8492604e174aeabbc9c46ebb659dc3, 8fdbd6ca12394ae4b0d73c5122292442; no voters: 
I20260709 13:11:07.255131 26094 raft_consensus.cc:2468] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e8492604e174aeabbc9c46ebb659dc3 in term 2.
I20260709 13:11:07.255268 26515 raft_consensus.cc:2804] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:07.255738 26515 raft_consensus.cc:697] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 LEADER]: Becoming Leader. State: Replica: 2e8492604e174aeabbc9c46ebb659dc3, State: Running, Role: LEADER
I20260709 13:11:07.256621 26515 consensus_queue.cc:237] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } }
I20260709 13:11:07.262897 25993 catalog_manager.cc:5697] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 reported cstate change: term changed from 1 to 2, leader changed from 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1) to 2e8492604e174aeabbc9c46ebb659dc3 (127.15.6.3). New cstate: current_term: 2 leader_uuid: "2e8492604e174aeabbc9c46ebb659dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e8492604e174aeabbc9c46ebb659dc3" member_type: VOTER last_known_addr { host: "127.15.6.3" port: 40949 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.438180 26094 raft_consensus.cc:1275] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.439340 26515 consensus_queue.cc:1048] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.450749 26171 raft_consensus.cc:1275] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.452493 26515 consensus_queue.cc:1048] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.732177 26169 raft_consensus.cc:1275] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.733408 26515 consensus_queue.cc:1048] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdbd6ca12394ae4b0d73c5122292442" member_type: VOTER last_known_addr { host: "127.15.6.2" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.743306 26093 raft_consensus.cc:1275] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Refusing update from remote peer 2e8492604e174aeabbc9c46ebb659dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.745518 26542 consensus_queue.cc:1048] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66542e9b217f43d7ae827345bc7a93b5" member_type: VOTER last_known_addr { host: "127.15.6.1" port: 32973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.770777 15384 tablet_server.cc:179] TabletServer@127.15.6.1:0 shutting down...
I20260709 13:11:07.794592 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:07.795415 15384 tablet_replica.cc:333] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.796242 15384 raft_consensus.cc:2243] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.796722 15384 raft_consensus.cc:2272] T 1575a79dd06648cab40ee498335bcaf7 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.799472 15384 tablet_replica.cc:333] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.800625 15384 raft_consensus.cc:2243] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.801736 15384 raft_consensus.cc:2272] T abd8a0f0412f4d009321e8e96dcd9239 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.803920 15384 tablet_replica.cc:333] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.804486 15384 raft_consensus.cc:2243] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.804870 15384 raft_consensus.cc:2272] T 16d82749b4804f96a4d43ce4c080d9c2 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.806711 15384 tablet_replica.cc:333] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.807236 15384 raft_consensus.cc:2243] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.807588 15384 raft_consensus.cc:2272] T db637d3500f340ef9ec580ee2c7d7ed4 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.809460 15384 tablet_replica.cc:333] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.809922 15384 raft_consensus.cc:2243] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.810314 15384 raft_consensus.cc:2272] T 0fcb0ed33c6240ff929ff0f070204f64 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.812148 15384 tablet_replica.cc:333] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.812690 15384 raft_consensus.cc:2243] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.813432 15384 raft_consensus.cc:2272] T 9733416f28ac4c7b8e9a9be19928b6c9 P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.815718 15384 tablet_replica.cc:333] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.816236 15384 raft_consensus.cc:2243] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.816672 15384 raft_consensus.cc:2272] T 1a9f756d29bb4b739a6de91536e30234 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.818616 15384 tablet_replica.cc:333] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.819169 15384 raft_consensus.cc:2243] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.819551 15384 raft_consensus.cc:2272] T 5406c83ce5a34f9c91467a72b4a1ed2a P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.822340 15384 tablet_replica.cc:333] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.822902 15384 raft_consensus.cc:2243] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.823659 15384 raft_consensus.cc:2272] T fc201e072c414937916e27508a78e6d0 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.825575 15384 tablet_replica.cc:333] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.826139 15384 raft_consensus.cc:2243] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.826563 15384 raft_consensus.cc:2272] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:07.828543 26209 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 13:11:07.829124 15384 tablet_replica.cc:333] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.830080 15384 raft_consensus.cc:2243] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.830577 15384 raft_consensus.cc:2272] T 447cb2116c704a5da2728849027a76a8 P 66542e9b217f43d7ae827345bc7a93b5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:07.831655 26209 consensus_peers.cc:597] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 -> Peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Couldn't send request to peer 66542e9b217f43d7ae827345bc7a93b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.833130 15384 tablet_replica.cc:333] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.833668 15384 raft_consensus.cc:2243] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.834326 15384 raft_consensus.cc:2272] T c9df3303627a470bb9a209ec24043c44 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.836310 15384 tablet_replica.cc:333] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.836764 15384 raft_consensus.cc:2243] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.837435 15384 raft_consensus.cc:2272] T f0d0781552dd4389b85e29ba52cc7c11 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.839547 15384 tablet_replica.cc:333] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.840004 15384 raft_consensus.cc:2243] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.840714 15384 raft_consensus.cc:2272] T 1af85ce17bc84524bfc590ed4f4613e8 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.842756 15384 tablet_replica.cc:333] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.843220 15384 raft_consensus.cc:2243] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.843595 15384 raft_consensus.cc:2272] T 4accf7ab19fa4952844a344af29d758b P 66542e9b217f43d7ae827345bc7a93b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.845463 15384 tablet_replica.cc:333] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.846026 15384 raft_consensus.cc:2243] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.846822 15384 raft_consensus.cc:2272] T 5464d8b9333e46ff8098edf4432b9ad6 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.849042 15384 tablet_replica.cc:333] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.849545 15384 raft_consensus.cc:2243] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.850020 15384 raft_consensus.cc:2272] T 4c5adcc83b6c43a2bdc027b5255268fc P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:07.850962 26135 consensus_peers.cc:597] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 -> Peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Couldn't send request to peer 66542e9b217f43d7ae827345bc7a93b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.852137 15384 tablet_replica.cc:333] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5: stopping tablet replica
I20260709 13:11:07.852669 15384 raft_consensus.cc:2243] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.853048 15384 raft_consensus.cc:2272] T d276d7eb4be54876b82e6628b3cc00d5 P 66542e9b217f43d7ae827345bc7a93b5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:07.887692 26209 consensus_peers.cc:597] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 -> Peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Couldn't send request to peer 66542e9b217f43d7ae827345bc7a93b5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:32973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.891363 15384 tablet_server.cc:196] TabletServer@127.15.6.1:0 shutdown complete.
W20260709 13:11:07.920967 26135 consensus_peers.cc:597] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 -> Peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Couldn't send request to peer 66542e9b217f43d7ae827345bc7a93b5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:32973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.927256 15384 tablet_server.cc:179] TabletServer@127.15.6.2:0 shutting down...
I20260709 13:11:07.951902 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:07.952548 15384 tablet_replica.cc:333] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.953195 15384 raft_consensus.cc:2243] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.954005 15384 raft_consensus.cc:2272] T 4accf7ab19fa4952844a344af29d758b P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.956020 15384 tablet_replica.cc:333] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.956611 15384 raft_consensus.cc:2243] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.957036 15384 raft_consensus.cc:2272] T abd8a0f0412f4d009321e8e96dcd9239 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.958953 15384 tablet_replica.cc:333] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.959465 15384 raft_consensus.cc:2243] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.960214 15384 raft_consensus.cc:2272] T 16d82749b4804f96a4d43ce4c080d9c2 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.962417 15384 tablet_replica.cc:333] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.962987 15384 raft_consensus.cc:2243] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.963449 15384 raft_consensus.cc:2272] T c9df3303627a470bb9a209ec24043c44 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:07.964973 26209 consensus_peers.cc:597] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 -> Peer 66542e9b217f43d7ae827345bc7a93b5 (127.15.6.1:32973): Couldn't send request to peer 66542e9b217f43d7ae827345bc7a93b5. Status: Network error: Client connection negotiation failed: client connection to 127.15.6.1:32973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.965822 15384 tablet_replica.cc:333] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.966384 15384 raft_consensus.cc:2243] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.967108 15384 raft_consensus.cc:2272] T 1575a79dd06648cab40ee498335bcaf7 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.969098 15384 tablet_replica.cc:333] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.969595 15384 raft_consensus.cc:2243] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.970268 15384 raft_consensus.cc:2272] T 1a9f756d29bb4b739a6de91536e30234 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.972142 15384 tablet_replica.cc:333] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.972623 15384 raft_consensus.cc:2243] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.972956 15384 raft_consensus.cc:2272] T 5406c83ce5a34f9c91467a72b4a1ed2a P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.975476 15384 tablet_replica.cc:333] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.975989 15384 raft_consensus.cc:2243] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.976354 15384 raft_consensus.cc:2272] T d276d7eb4be54876b82e6628b3cc00d5 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.978724 15384 tablet_replica.cc:333] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.979205 15384 raft_consensus.cc:2243] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.979586 15384 raft_consensus.cc:2272] T 5464d8b9333e46ff8098edf4432b9ad6 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.981519 15384 tablet_replica.cc:333] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.981945 15384 raft_consensus.cc:2243] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.982635 15384 raft_consensus.cc:2272] T 4c5adcc83b6c43a2bdc027b5255268fc P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.984459 15384 tablet_replica.cc:333] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.984890 15384 raft_consensus.cc:2243] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.985242 15384 raft_consensus.cc:2272] T fc201e072c414937916e27508a78e6d0 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.986937 15384 tablet_replica.cc:333] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.987375 15384 raft_consensus.cc:2243] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.988322 15384 raft_consensus.cc:2272] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.990824 15384 tablet_replica.cc:333] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
W20260709 13:11:07.991245 26210 consensus_peers.cc:597] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 -> Peer 8fdbd6ca12394ae4b0d73c5122292442 (127.15.6.2:44095): Couldn't send request to peer 8fdbd6ca12394ae4b0d73c5122292442. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.991412 15384 raft_consensus.cc:2243] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.992050 15384 raft_consensus.cc:2272] T 447cb2116c704a5da2728849027a76a8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.994333 15384 tablet_replica.cc:333] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.994831 15384 raft_consensus.cc:2243] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:07.995242 15384 raft_consensus.cc:2272] T db637d3500f340ef9ec580ee2c7d7ed4 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:07.997416 15384 tablet_replica.cc:333] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:07.997921 15384 raft_consensus.cc:2243] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:07.998617 15384 raft_consensus.cc:2272] T 0fcb0ed33c6240ff929ff0f070204f64 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.001093 15384 tablet_replica.cc:333] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:08.001726 15384 raft_consensus.cc:2243] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.002243 15384 raft_consensus.cc:2272] T 9733416f28ac4c7b8e9a9be19928b6c9 P 8fdbd6ca12394ae4b0d73c5122292442 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.004675 15384 tablet_replica.cc:333] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:08.005108 15384 raft_consensus.cc:2243] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.005470 15384 raft_consensus.cc:2272] T f0d0781552dd4389b85e29ba52cc7c11 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.007284 15384 tablet_replica.cc:333] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442: stopping tablet replica
I20260709 13:11:08.007682 15384 raft_consensus.cc:2243] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.008070 15384 raft_consensus.cc:2272] T 1af85ce17bc84524bfc590ed4f4613e8 P 8fdbd6ca12394ae4b0d73c5122292442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.036554 15384 tablet_server.cc:196] TabletServer@127.15.6.2:0 shutdown complete.
I20260709 13:11:08.066691 15384 tablet_server.cc:179] TabletServer@127.15.6.3:0 shutting down...
I20260709 13:11:08.090667 15384 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:08.091338 15384 tablet_replica.cc:333] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.092326 15384 raft_consensus.cc:2243] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.093050 15384 raft_consensus.cc:2272] T c9df3303627a470bb9a209ec24043c44 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.095108 15384 tablet_replica.cc:333] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.095645 15384 raft_consensus.cc:2243] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.096099 15384 raft_consensus.cc:2272] T 16d82749b4804f96a4d43ce4c080d9c2 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.097957 15384 tablet_replica.cc:333] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.098480 15384 raft_consensus.cc:2243] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.098883 15384 raft_consensus.cc:2272] T 4accf7ab19fa4952844a344af29d758b P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.100841 15384 tablet_replica.cc:333] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.101372 15384 raft_consensus.cc:2243] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.101807 15384 raft_consensus.cc:2272] T 1575a79dd06648cab40ee498335bcaf7 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.103785 15384 tablet_replica.cc:333] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.104333 15384 raft_consensus.cc:2243] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.104727 15384 raft_consensus.cc:2272] T abd8a0f0412f4d009321e8e96dcd9239 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.106616 15384 tablet_replica.cc:333] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.107085 15384 raft_consensus.cc:2243] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.107896 15384 raft_consensus.cc:2272] T 5406c83ce5a34f9c91467a72b4a1ed2a P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.110091 15384 tablet_replica.cc:333] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.110658 15384 raft_consensus.cc:2243] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.111124 15384 raft_consensus.cc:2272] T 5464d8b9333e46ff8098edf4432b9ad6 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.113161 15384 tablet_replica.cc:333] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.113656 15384 raft_consensus.cc:2243] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.114053 15384 raft_consensus.cc:2272] T 4c5adcc83b6c43a2bdc027b5255268fc P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.115993 15384 tablet_replica.cc:333] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.116474 15384 raft_consensus.cc:2243] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.117204 15384 raft_consensus.cc:2272] T d276d7eb4be54876b82e6628b3cc00d5 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.119566 15384 tablet_replica.cc:333] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.120124 15384 raft_consensus.cc:2243] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.120860 15384 raft_consensus.cc:2272] T db637d3500f340ef9ec580ee2c7d7ed4 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.122795 15384 tablet_replica.cc:333] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.123313 15384 raft_consensus.cc:2243] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.123740 15384 raft_consensus.cc:2272] T 0fcb0ed33c6240ff929ff0f070204f64 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.125800 15384 tablet_replica.cc:333] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.126292 15384 raft_consensus.cc:2243] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.126739 15384 raft_consensus.cc:2272] T 9733416f28ac4c7b8e9a9be19928b6c9 P 2e8492604e174aeabbc9c46ebb659dc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.128782 15384 tablet_replica.cc:333] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.129271 15384 raft_consensus.cc:2243] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.129827 15384 raft_consensus.cc:2272] T f0d0781552dd4389b85e29ba52cc7c11 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.131932 15384 tablet_replica.cc:333] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.132413 15384 raft_consensus.cc:2243] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.132798 15384 raft_consensus.cc:2272] T 1af85ce17bc84524bfc590ed4f4613e8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.134863 15384 tablet_replica.cc:333] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.135305 15384 raft_consensus.cc:2243] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.135733 15384 raft_consensus.cc:2272] T 1a9f756d29bb4b739a6de91536e30234 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.137631 15384 tablet_replica.cc:333] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.138157 15384 raft_consensus.cc:2243] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.138597 15384 raft_consensus.cc:2272] T fc201e072c414937916e27508a78e6d0 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.140563 15384 tablet_replica.cc:333] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.141003 15384 raft_consensus.cc:2243] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.141391 15384 raft_consensus.cc:2272] T 9e8fa2c3f6d44e0cba4b5ea953315733 P 2e8492604e174aeabbc9c46ebb659dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.143132 15384 tablet_replica.cc:333] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3: stopping tablet replica
I20260709 13:11:08.143548 15384 raft_consensus.cc:2243] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.144258 15384 raft_consensus.cc:2272] T 447cb2116c704a5da2728849027a76a8 P 2e8492604e174aeabbc9c46ebb659dc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.180931 15384 tablet_server.cc:196] TabletServer@127.15.6.3:0 shutdown complete.
I20260709 13:11:08.210708 15384 master.cc:562] Master@127.15.6.62:42167 shutting down...
I20260709 13:11:08.231529 15384 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.232056 15384 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.232370 15384 tablet_replica.cc:333] T 00000000000000000000000000000000 P 32bb2df2938b4afdbe65dd30e3cb9df9: stopping tablet replica
I20260709 13:11:08.251922 15384 master.cc:584] Master@127.15.6.62:42167 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (10990 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (22992 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (330387 ms total)
[  PASSED  ] 8 tests.
I20260709 13:11:08.298426 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 400 messages since previous log ~14 seconds ago
I20260709 13:11:08.298662 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 400 messages since previous log ~14 seconds ago
I20260709 13:11:08.298820 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 396 messages since previous log ~14 seconds ago
I20260709 13:11:08.299010 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:11:08.299171 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:11:08.299377 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~172 seconds ago
I20260709 13:11:08.299688 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:11:08.300064 15384 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~5 seconds ago
